Dynamic robotic tracking of underwater targets using reinforcement learning
Open accessThe DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
To realize the potential of autonomous underwater robots that scale up our observational capacity in the ocean, new techniques are needed. Fleets of autonomous robots could be used to study complex marine systems and animals with either new imaging configurations or by tracking tagged animals to study their behavior. These activities can then inform and create new policies for community conservation. The role of animal connectivity via active movement of animals represents a major knowledge gap related to the distribution of deep ocean populations. Tracking underwater targets represents a major challenge for observing biological processes in situ, and methods to robustly respond to a changing environment during monitoring missions are needed. Analytical techniques for optimal sensor placement and path planning to locate underwater targets are not straightforward in such cases. The aim of this study was to investigate the use of reinforcement learning as a tool for range-only underwater target-tracking optimization, whose promising capabilities have been demonstrated in terrestrial scenarios. To evaluate its usefulness, a reinforcement learning method was implemented as a path planning system for an autonomous surface vehicle while tracking an underwater mobile target. A complete description of an open-source model, performance metrics in simulated environments, and evaluated algorithms based on more than 15 hours of at-sea field experiments are presented. These efforts demonstrate that deep reinforcement learning is a powerful approach that enhances the abilities of autonomous robots in the ocean and encourages the deployment of algorithms like these for monitoring marine biological systems in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Geocentric policies are not invariant to rotations and translations of the flow field and not suitable for autonomous deployment in the open ocean without continuous support from and communication with a terrestrial control center8.”
From Sensing flow gradients is necessary for learning autonomous underwater navigation (2025) · cites this paper as [8]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Our analysis of the sensory requirements for autonomous underwater navigation (Table 1) indicates that egocentric sensing in the agent’s own world eliminates potential time delays and computations inherent to assessing inertial signals8,83 at the expense of requiring more sensors to observe spatial variations in the flow field at the scale of the navigator.”
From Sensing flow gradients is necessary for learning autonomous underwater navigation (2025) · cites this paper as [8]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 1×
“The use of deep Q-learning and off-policy algorithms in continuous state and action space presents a major challenge for stability and convergence ( 38 ).”
MethodMastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 1×
“Whereas most of the attention in deep RL has focused on game theory (for example to solve Atari games ( 24 ) or to master the game of Go ( 25 )), the same principles can be used to solve path planning and trajectory optimization problems (Table 1).”
BackgroundObject Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545
The State of World Fisheries and Aquaculture 2020
(2020) · doi:10.4060/ca9229en · Cited by 3,167
Underwater acoustic communication channels: Propagation models and statistical characterization
Stojanovic, M., & Preisig, J. (2009) · IEEE Communications Magazine · doi:10.1109/mcom.2009.4752682 · Cited by 2,060
Learning quadrupedal locomotion over challenging terrain
Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M. (2020) · Science Robotics · doi:10.1126/scirobotics.abc5986 · Cited by 1,156
Underwater sensor networks: applications, advances and challenges
Heidemann, J., Stojanovic, M., & Zorzi, M. (2012) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2011.0214 · Cited by 882
Learning quadrupedal locomotion over challenging terrain
Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M. (2020) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000448343 · Cited by 752
The generation of plankton patchiness by turbulent stirring
Abraham, E. R. (1998) · Nature · doi:10.1038/35361 · Cited by 456 · cited 1×
“Multiple robotic platforms, in coordination with each other, have been used to characterize different oceanographic phenomena, such as fronts and eddies (10, 11).”
MethodAutonomous navigation of stratospheric balloons using reinforcement learning
Bellemare, M. G., Candido, S., Castro, P. S., Gong, J., Machado, M. C., Moitra, S., Ponda, S. S., & Wang, Z. (2020) · Nature · doi:10.1038/s41586-020-2939-8 · Cited by 286
Challenges and future trends in marine robotics
Zereik, E., Bibuli, M., Mišković, N., Ridao, P., & Pascoal, A. (2018) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2018.10.002 · Cited by 284 · cited 1×
“Robotic platforms and autonomous underwater vehicles (AUVs) have become useful tools for ocean observation by reducing cost and increasing mission duration and efficiency (3, 7, 16, 17).”
BackgroundCollision avoidance for an unmanned surface vehicle using deep reinforcement learning
Woo, J., & Kim, N. (2020) · Ocean Engineering · doi:10.1016/j.oceaneng.2020.107001 · Cited by 264
Deep reinforcement learning-based controller for path following of an unmanned surface vehicle
Woo, J., Yu, C., & Kim, N. (2019) · Ocean Engineering · doi:10.1016/j.oceaneng.2019.04.099 · Cited by 246 · cited 6×
“To overcome such limitations, a separate actor network is often used to perform the maximization over actions in the optimal action-value function, such as in deep deterministic policy gradient (DDPG) ( 39 ).”
InfluentialPersonalized digital marketing recommender engine
Behera, R. K., Gunasekaran, A., Gupta, S., Kamboj, S., & Bala, P. K. (2020) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2019.03.026 · Cited by 241 · cited 1×
“Whereas supervised learning is learning from a training set of labeled examples (for 79 example object detection (21)), unsupervised learning is about finding hidden structures in 80 collections of unlabeled data (for example personalized digital marketing recommendations (22)).”
BackgroundGleason, M., McCreary, S., Miller-Henson, M., Ugoretz, J., Fox, E., Merrifield, M., McClintock, W., Serpa, P., & Hoffman, K. (2010) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2009.12.001 · Cited by 208
Adaptive low-level control of autonomous underwater vehicles using deep reinforcement learning
Carlucho, I., De Paula, M., Wang, S., Petillot, Y., & Acosta, G. G. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.05.016 · Cited by 186 · cited 1×
“However, these existing efforts 96 have been largely carried out in simulated environments or under controlled conditions (30, 31).”
BackgroundMemory-based Deep Reinforcement Learning for POMDPs
Meng, L., Gorbet, R., & Kulić, D. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636140 · Cited by 178 · cited 1×
“Specifically, two different structures were implemented: an RNN that takes as input 156 the last n states (LSTM-SAC) following (29) and (40); and a simpler implementation where one of 157 the hidden layers was replaced by an RNN (H-LSTM-SAC) with a history length of 1 and the 158 internal hidden state is used as input…”
MethodGlider soaring via reinforcement learning in the field
Reddy, G., Wong-Ng, J., Celani, A., Sejnowski, T. J., & Vergassola, M. (2018) · Nature · doi:10.1038/s41586-018-0533-0 · Cited by 177 · cited 2×
“Previous studies have shown that aerial gliders can navigate atmospheric thermals autonomously (26), stratospheric Loon superpressure balloons have learned optimal control to maintain their position at multiple locations (27), and an RL agent has been trained to efficiently navigate in simulated vortical flow fields (…”
BackgroundDepth Control of Model-Free AUVs via Reinforcement Learning
Wu, H., Song, S., You, K., & Wu, C. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2017.2785794 · Cited by 170
Path Planning for UAV Ground Target Tracking via Deep Reinforcement Learning
Li, B., & Wu, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2971780 · Cited by 168
Ullah, I., Chen, J., Su, X., Esposito, C., & Choi, C. (2019) · IEEE Access · doi:10.1109/access.2019.2909133 · Cited by 153
Deep Reinforcement Learning at the Edge of the Statistical Precipice
Agarwal, R., Schwarzer, M., Castro, P. S., Courville, A., & Bellemare, M. G. (2021) · arXiv · doi:10.48550/arxiv.2108.13264 · Cited by 142
A hybrid underwater robot for multidisciplinary investigation of the ocean twilight zone
Yoerger, D., Govindarajan, A. F., Howland, J. C., Llopiz, J. K., Wiebe, P. H., Curran, M., Fujii, J., Gomez-Ibañez, D., Katija, K., Robison, B. H., et al. (2021) · Science Robotics · doi:10.1126/scirobotics.abe1901 · Cited by 128 · cited 2×
“New vehicles driven by machine learning (ML) algorithms to increase autonomy are increasingly being developed and implemented in the hopes of filling this capability gap ( 18 , 19 ).”
BackgroundSelf-citationSmith, K. L., Ruhl, H. A., Huffard, C. L., Messié, M., & Kahru, M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1814559115 · Cited by 126
Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle
Zhang, Q., Lin, J., Sha, Q., He, B., & Li, G. (2020) · IEEE Access · doi:10.1109/access.2020.2970433 · Cited by 125
Path optimization for marine vehicles in ocean currents using reinforcement learning
Yoo, B., & Kim, J. (2015) · Journal of Marine Science and Technology · doi:10.1007/s00773-015-0355-9 · Cited by 123
Safe deep reinforcement learning-based adaptive control for USV interception mission
Du, B., Lin, B., Zhang, C., Dong, B., & Zhang, W. (2022) · Ocean Engineering · doi:10.1016/j.oceaneng.2021.110477 · Cited by 113
Learning efficient navigation in vortical flow fields
Gunnarson, P., Mandralis, I., Novati, G., Koumoutsakos, P., & Dabiri, J. O. (2021) · Nature Communications · doi:10.1038/s41467-021-27015-y · Cited by 108 · cited 1×
“Previous studies have shown that aerial gliders can 90 navigate atmospheric thermals autonomously (26), stratospheric Loon superpressure balloons have 91 learned optimal control to maintain their position at multiple locations (27), and an RL agent has 92 been trained to efficiently navigate in simulated vortical flow…”
BackgroundReinforcement learning-based NMPC for tracking control of ASVs: Theory and experiments
Martinsen, A. B., Lekkas, A. M., & Gros, S. (2021) · Control Engineering Practice · doi:10.1016/j.conengprac.2021.105024 · Cited by 97
The ARTEMIS under‐ice AUV docking system
Kimball, P. W., Clark, E. B., Scully, M., Richmond, K., Flesher, C., Lindzey, L., Harman, J., Huffstutler, K., Lawrence, J., Lelievre, S., et al. (2017) · Journal of Field Robotics · doi:10.1002/rob.21740 · Cited by 95
Self-Supervised Online Reward Shaping in Sparse-Reward Environments
Memarian, F., Goo, W., Lioutikov, R., Niekum, S., & Topcu, U. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636020 · Cited by 95
Mobile robotic platforms for the acoustic tracking of deep-sea demersal fishery resources
Rusiñol, I. M., Navarro, J., Castro, S. G., Aguzzi, J., Kieft, B., O’Reilly, T., Katija, K., Bouvet, P.-J., Fannjiang, C., Vigo, M., et al. (2020) · Science Robotics · doi:10.1126/scirobotics.abc3701 · Cited by 83 · cited 6×
“Other works have focused on field applications where acoustic-instrumented marine 305 organisms were detected by marine robots (7, 9).”
BackgroundMethodInfluentialSelf-citationCoherent Pathways for Vertical Transport from the Surface Ocean to Interior
Mahadevan, A., Pascual, A., Rudnick, D. L., Ruíz, S., Tintoré, J., & D’Asaro, E. A. (2020) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-19-0305.1 · Cited by 81
Target Search Control of AUV in Underwater Environment With Deep Reinforcement Learning
Cao, X. S., Sun, C., & Yan, M. (2019) · IEEE Access · doi:10.1109/access.2019.2929120 · Cited by 79
Zhang, Y., Ryan, J. P., Hobson, B. W., Kieft, B., Romano, A. E., Barone, B., Preston, C. M., Roman, B., Raanan, B. Y., Pargett, D. M., et al. (2021) · Science Robotics · doi:10.1126/scirobotics.abb9138 · Cited by 79
Self-citationDocking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning
Anderlini, E., Parker, G. G., & Thomas, G. A. (2019) · Applied Sciences · doi:10.3390/app9173456 · Cited by 76
Zhang, C., Cheng, P., Du, B., Dong, B., & Zhang, W. (2022) · Ocean Engineering · doi:10.1016/j.oceaneng.2022.111453 · Cited by 75
Marine Protected Area Networks in California, USA
Botsford, L. W., White, J. W., Carr, M. H., & Caselle, J. E. (2014) · Advances in marine biology · doi:10.1016/b978-0-12-800214-8.00006-2 · Cited by 74
A Behavior-Based Scheme Using Reinforcement Learning for Autonomous Underwater Vehicles
Carreras, M., Yuh, J., Batlle, J., & Ridao, P. (2005) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2004.835805 · Cited by 71
Havenstrøm, S. T., Rasheed, A., & San, O. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.566037 · Cited by 70
Yang, X. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-416743-8.00003-8 · Cited by 62
Abyssal Benthic Rover, an autonomous vehicle for long-term monitoring of deep-ocean processes
Smith, K. L., Sherman, A. D., McGill, P., Henthorn, R., Ferreira, J. G., Connolly, T., & Huffard, C. L. (2021) · Science Robotics · doi:10.1126/scirobotics.abl4925 · Cited by 56
Cui, Y., Osaki, S., & Matsubara, T. (2020) · Journal of Field Robotics · doi:10.1002/rob.21990 · Cited by 48
Dynamic Positioning using Deep Reinforcement Learning
Øvereng, S. S., Nguyen, D. T., & Hamre, G. (2021) · Ocean Engineering · doi:10.1016/j.oceaneng.2021.109433 · Cited by 45
Advancing multi-vehicle deployments in oceanographic field experiments
Ferreira, A. S., Costa, M., Py, F., Pinto, J., Silva, M. A., Nimmo-Smith, A., Johansen, T. A., de Sousa, J. B., & Rajan, K. (2018) · Autonomous Robots · doi:10.1007/s10514-018-9810-x · Cited by 38
Côté, D., Nicolas, J.-M., Whoriskey, F. G., Cook, A., Broome, J. E., Regular, P. M., & Baker, D. (2018) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2017-0472 · Cited by 36 · cited 4×
“In the study of the movement ecology of marine species, 328 adaptive AUVs and ASVs could be used in two ways: as a tool to study the movement of 329 electronically tagged individuals to inform management strategies of commercially exploited 330 species in marine protected areas (7, 9); and for tracking individuals for…”
BackgroundMethodInfluentialSim-to-Real: Mapless Navigation for USVs Using Deep Reinforcement Learning
Wang, N., Wang, Y., Zhao, Y., Wang, Y., & Li, Z. (2022) · Journal of Marine Science and Engineering · doi:10.3390/jmse10070895 · Cited by 35
Marine Protected Areas in Sri Lanka: A Review
Perera, N., & de Vos, A. (2007) · Environmental Management · doi:10.1007/s00267-005-0154-x · Cited by 33
Optimal path shape for range-only underwater target localization using a Wave Glider
Rusiñol, I. M., Castro, S. G., Fernández, J. D. R., Kieft, B., O’Reilly, T., Bouvet, P.-J., & Aguzzi, J. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918802351 · Cited by 27 · cited 4×
“In simulations, the RL agent was able to learn the optimal policy by achieving similar 322 performance of an analytical formulation (41).”
MethodInfluentialSelf-citationAn AUV Target-Tracking Method Combining Imitation Learning and Deep Reinforcement Learning
Mao, Y., Gao, F., Zhang, Q., & Yang, Z. (2022) · Journal of Marine Science and Engineering · doi:10.3390/jmse10030383 · Cited by 27
Rusiñol, I. M., Castro, S. G., Fernández, J. D. R., Kieft, B., O’Reilly, T., Bouvet, P.-J., & Aguzzi, J. (2019) · IEEE Access · doi:10.1109/access.2019.2924722 · Cited by 26
Self-citationVigo, M., Navarro, J., MASMITJA, I., Aguzzi, J., García, J., Rotllant, G., & Bahamón, N. (2021) · Marine Ecology Progress Series · doi:10.3354/meps13799 · Cited by 26 · cited 3×
“5 − eeqq) iiff eeqq > eetth 1 eeeessee , (8) 452”
BackgroundMethodSelf-citationPoupard, M., Ferrari, M., Best, P., & Glotin, H. (2022) · Scientific Reports · doi:10.1038/s41598-022-05917-1 · Cited by 25
Advancing Ocean Observation with an AI-Driven Mobile Robotic Explorer
Saad, A., Stahl, A., Våge, A., Davies, E. J., Nordam, T., Aberle, N., Ludvigsen, M., Johnsen, G. H., de Sousa, J. B., & Rajan, K. (2020) · Oceanography · doi:10.5670/oceanog.2020.307 · Cited by 24
The European Project MORPH: Distributed UUV Systems for Multimodal, 3D Underwater Surveys
Kalwa, J., Tietjen, D., Carreiro‐Silva, M., Fontes, J., Brignone, L., Gracias, N., Ridao, P., Pfingsthorn, M. F., Birk, A., Glotzbach, T., et al. (2016) · Marine Technology Society Journal · doi:10.4031/mtsj.50.4.10 · Cited by 23
Why animals swirl and how they group
Nuzhin, E. E., Panov, M., & Brilliantov, N. V. (2021) · Scientific Reports · doi:10.1038/s41598-021-99982-7 · Cited by 19
New Vectorial Propulsion System and Trajectory Control Designs for Improved AUV Mission Autonomy
Rusiñol, I. M., González, J., Galarza, C., Castro, S. G., Aguzzi, J., & Fernández, J. D. R. (2018) · Sensors · doi:10.3390/s18041241 · Cited by 14
High-speed underwater acoustic communication for multi-agent supervised autonomy
Jarrot, A., Gelman, A., Choi, G., Speck, A. J., Strunk, G., Croux, A., Osedach, T. P., Vannuffelen, S., Ossia, S., Vincent, J., et al. (2021) · Underwater Communications and Networking Conference (UComms) · doi:10.1109/ucomms50339.2021.9598036 · Cited by 13
Gwiazda, R. H., Paull, C. K., Kieft, B., Klimov, D., Herlien, R., Lundsten, E. M., McCann, M., Cartigny, M., Hamilton, A., Xu, J., et al. (2022) · Journal of Geophysical Research Earth Surface · doi:10.1029/2021jf006437 · Cited by 9
Self-citationUnderwater robot can follow marine organisms over record distances
Ravindran, S. (2010) · Nature · doi:10.1038/news.2010.573 · Cited by 3 · cited 1×
“Robotic platforms and autonomous underwater vehicles (AUVs) have become useful tools for ocean observation by reducing cost and increasing mission duration and efficiency ( 3 , 7 , 16 , 17 ).”
Background
Research works printed but not linked: 5
- R. S. Sutton A. G. Barto Reinforcement Learning: An Introduction (MIT Press ed. 2 2015).
- T. Haarnoja A. Zhou P. Abbeel S. Levine Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor in Proceedings of the 35th International Conference on (ICML 2018) (ICML 2018) vol. 5 pp. 2976–2989.
- J. K. Terry, B. Black, N. Grammel, M. Jayakumar, A. Hari, R. Sullivan, L. Santos, R. Perez, C. Horsch, C. Dieffendahl, N. L. Williams, Y. Lokesh, P. Ravi, PettingZoo: A standard API for multi-agent reinforcement learning. Adv. Neural Inf. Process. Syst. 18, 15032–15043 (2021).
- T. P. Lillicrap J. J. Hunt A. Pritzel N. Heess T. Erez Y. Tassa D. Silver D. Wierstra Continuous control with deep reinforcement learning in 4th International Conference on Learning Representations (ICLR 2016)–Conference Track Proceedings (ICLR 2016).
- K. Katija P. L. D. Roberts J. Daniels A. Lapides K. Barnard M. Risi B. Y. Ranaan B. G. Woodward J. Takahashi in 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) (IEEE 2021) pp. 859–868.
Cited by
Chu, S., Lin, M., Li, D., Lin, R., & Xiao, S. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.120139 · Cited by 79
Zheng, X., Jiang, Y., Mete, M., Li, J., Watanabe, I., Yamada, T., & Paik, J. K. (2025) · Science Robotics · doi:10.1126/scirobotics.adx1519 · Cited by 48
Dai, H., Zhang, C., Hu, H., Hu, Z., Sun, H., Liu, K., Li, T., Fu, J., Zhao, P., & Yang, H. (2024) · Advanced Science · doi:10.1002/advs.202405276 · Cited by 41
Chun, S., Kawamura, C., Ohkuma, K., & Maki, T. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3364470 · Cited by 31
“Digital Object Identifier 10.1109/LRA.2024.3364470 To compensate for the limitations of biologging, Autonomous Underwater Vehicles (AUVs) have emerged as one of the remote sensing methods [4], [5], [6].”
BackgroundInfluentialA comprehensive review on the evolution of bio-inspired sensors from aquatic creatures
Zhao, Z., Yang, Q., Li, R., Yang, J., Liu, Q., Zhu, B., Weng, C., Liu, W., Hu, P., Ma, L. M., et al. (2024) · Cell Reports Physical Science · doi:10.1016/j.xcrp.2024.102064 · Cited by 33
Metadata
- Authors
- Masmitja, I., Martin, M., O’Reilly, T., Kieft, B., Palomeras, N., Navarro, J., & Katija, K.
- Affiliations
- Institut de Ciències del Mar (ICM), CSIC, Barcelona 95062, Spain.
- Knowledge Engineering and Machine Learning Group, Universitat Politècnica de Catalunya, Barcelona Tech., Barcelona 08034, Spain.
- Monterey Bay Aquarium Research Institute (US)
- Universitat de Girona (ES)
- Institut de Ciències del Mar (ES)
- Venue
- Science Robotics
- Published
- 2023-07-12
- Volume
- 8
- Issue
- 80
- Pages
- eade7811-eade7811
- ISSN
- 2470-9476 (ISSN-L)
- OpenAlex
- W4385286939
- Cited by
- 96
- References
- 59
- Citations by year
- 2026: 29 · 2025: 44 · 2024: 23
- FWCI
- 11.66
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- Locations
- Science Robotics (publishedVersion)
- PubMed (publishedVersion)
- UPCommons institutional repository (Universitat Politècnica de Catalunya) (submittedVersion, cc-by-nc-nd)
- DIGITAL.CSIC (Spanish National Research Council (CSIC)) (submittedVersion)
- Funders
- European Commission (CEX2019-000928-S, 893089)
- Barcelona Supercomputing Center
- Topics
- Physical Sciences › Engineering › Ocean Engineering › Underwater Vehicles and Communication Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Ocean Engineering › Maritime Navigation and Safety
- Keywords
- underwater target tracking, reinforcement learning, autonomous underwater vehicles, unmanned surface vehicles, path planning, deep reinforcement learning, oceanographic monitoring, marine conservation, field experiments
- MeSH terms
- Algorithms, Animals, Learning, Reinforcement, Psychology, Robotics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.