E-VAT: An Asymmetric End-to-End Approach to Visual Active Exploration and Tracking
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The development of visual tracking systems is becoming a major goal for the Robotics community. Most of the works dealing with this topic focus exclusively on passive tracking, where the target is confined within the camera’s field of view. Only a minority propose active approaches, capable not only of identifying the object to be tracked but also of producing motion control actions to maintain visual contact with it. However, all the methods introduced so far assume that the target is initially in the immediate proximity of the tracker. This represents an undesirable constraint on the applicability of these techniques, and it is to overcome this limitation that we propose a novel End-to-End Deep Reinforcement Learning based system, capable of both exploring the surrounding environment to find the target and then of tracking it. To do this, we develop a network consisting of two sub-components: i) theTarget-Detection Network, which detects the target in the camera’sfield-of-view, and ii) theExploration and Tracking Network, which employs this information to switch between the exploration policy and the tracking policy with the goal of exploring the environment, finding the target and finally tracking it. Through different experiments, we demonstrate the effectiveness of our approach and its superior performance with respect to current state-of-the-art (SotA) methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is similar to other visual tracking methods such as E-VAT [29].”
From NavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environments (2024) · cites this paper as [29]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Thrun, S. (2002) · Communications of the ACM · doi:10.1145/504729.504754 · Cited by 7,994
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
Espeholt, L., Soyer, H., Munos, R., Simonyan, K., Mnih, V., Ward, T., Doron, Y., Firoiu, V., Harley, T., Dunning, I., et al. (2018) · arXiv · doi:10.48550/arxiv.1802.01561 · Cited by 1,708
A frontier-based approach for autonomous exploration
Yamauchi, B. (2002) · Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation' · doi:10.1109/cira.1997.613851 · Cited by 1,695
Distractor-Aware Siamese Networks for Visual Object Tracking
Zhu, Z., Wang, Q., Li, B., Wu, W., Yan, J., & Hu, W. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_7 · Cited by 1,501
Dota 2 with Large Scale Deep Reinforcement Learning
OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.06680 · Cited by 1,065
Receding Horizon "Next-Best-View" Planner for 3D Exploration
Bircher, A., Kamel, M., Alexis, K., Oleynikova, H., & Siegwart, R. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487281 · Cited by 633
VITAL: VIsual Tracking via Adversarial Learning
Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R. W. H., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00937 · Cited by 577
CREST: Convolutional Residual Learning for Visual Tracking
Song, Y., Ma, C., Gong, L., Zhang, J., Lau, R. W. H., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.279 · Cited by 562
Action-Decision Networks for Visual Tracking with Deep Reinforcement Learning
Yun, S., Choi, J., Yoo, Y., Yun, K., & Choi, J. Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.148 · Cited by 530
Motion tracking with an active camera
Murray, D., & Basu, A. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.291452 · Cited by 352
Asymmetric Actor Critic for Image-Based Robot Learning
Pinto, L., Andrychowicz, M., Welinder, P., Zaremba, W., & Abbeel, P. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.008 · Cited by 343
Object Goal Navigation using Goal-Oriented Semantic Exploration
Chaplot, D. S., Gandhi, D., Gupta, A., & Salakhutdinov, R. (2020) · arXiv · doi:10.48550/arxiv.2007.00643 · Cited by 321
Reinforcement Learning with Unsupervised Auxiliary Tasks
Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05397 · Cited by 247
Neural Topological SLAM for Visual Navigation
Singh Chaplot, D., Salakhutdinov, R., Gupta, A., & Gupta, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01289 · Cited by 241
End-to-End Active Object Tracking and Its Real-World Deployment via Reinforcement Learning
Luo, W., Sun, P., Zhong, F., Liu, W., Zhang, T., & Wang, Y. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2899570 · Cited by 236
Sample Efficient Actor-Critic with Experience Replay
Wang, Z., Bapst, V., Heess, N., Mnih, V., Munos, R., Kavukcuoglu, K., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01224 · Cited by 192
Deep Attentive Tracking via Reciprocative LearningPreprint
Pu, S., Song, Y., Ma, C., Zhang, H., & Yang, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03851 · Cited by 185
Evaluating the Efficiency of Frontier-based Exploration Strategies
Holz, D., Basilico, N., Francesco Amigoni, A., & Behnke, S. (2010) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · Cited by 126
DSVP: Dual-Stage Viewpoint Planner for Rapid Exploration by Dynamic Expansion
Zhu, H., Cao, C., Xia, Y., Scherer, S., Zhang, J., & Wang, W. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636473 · Cited by 117
Towards Generalization in Target-Driven Visual Navigation by Using Deep Reinforcement Learning
Devo, A., Mezzetti, G., Costante, G., Fravolini, M. L., & Valigi, P. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2994002 · Cited by 107
Self-citationDeep Reinforcement Learning for Visual Object Tracking in Videos
Zhang, D., Maei, H. R., Wang, X., & Wang, Y.-F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08936 · Cited by 95
AD-VAT+: An Asymmetric Dueling Mechanism for Learning and Understanding Visual Active Tracking
Zhong, F., Sun, P., Luo, W., Yan, T., & Wang, Y. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2952590 · Cited by 82
Virtual-to-Real: Learning to Control in Visual Semantic Segmentation
Hong, Z.-W., Chen, Y.-M., Yang, H.-K., Su, S.-Y., Shann, T.-Y., Chang, Y.-H., Ho, B. H.-L., Tu, C.-C., Hsiao, T.-C., Hsiao, H.-W., et al. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/682 · Cited by 68
Pose-Assisted Multi-Camera Collaboration for Active Object Tracking
Li, J., Xu, J., Zhong, F., Kong, X., Qiao, Y., & Wang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5419 · Cited by 63
Deep Reinforcement Learning for Instruction Following Visual Navigation in 3D Maze-Like Environments
Devo, A., Costante, G., & Valigi, P. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2965857 · Cited by 43
Self-citationEnhancing continuous control of mobile robots for end-to-end visual active tracking
Devo, A., Dionigi, A., & Costante, G. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103799 · Cited by 43
Self-citationReal-time active visual tracking system
Ribarič, S., Adrinek, G., & Šegvić, S. (2004) · IEEE Mediterranean Electrotechnical Conference (MELECON) · doi:10.1109/melcon.2004.1346816 · Cited by 30
Detecting and tracking moving object using an active camera
Kim, K., Cho, S. H., Kim, H. J., & Lee, J. Y. (2005) · International Conference on Advanced Communication Technology · doi:10.1109/icact.2005.246077 · Cited by 27
Cognitive visual tracking and camera control
Bellotto, N., Benfold, B., Harland, H., Nagel, H.-H., Pirlo, N., Reid, I. D., Sommerlade, E., & Zhao, C. (2011) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2011.09.011 · Cited by 26
Stable and Consistent Object Tracking: An Active Vision Approach
Das, D. K., Laha, M., Majumder, S., & Ray, D. N. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-8237-5_29 · Cited by 10
Cited by
Wang, H., Tan, A. H., & Nejat, G. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3412638 · Cited by 40
“In [8], the Asynchronous Advantage Actor Critic (A3C) [16] was used to train scene-specific FCLs to generate navigation actions using joint embedding.”
BackgroundMethodRSPT: Reconstruct Surroundings and Predict Trajectory for Generalizable Active Object Tracking
Zhong, F., Bi, X., Zhang, Y., Zhang, W., & Wang, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25482 · Cited by 40
D-VAT: End-to-End Visual Active Tracking for Micro Aerial Vehicles
Dionigi, A., Felicioni, S., Leomanni, M., & Costante, G. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3385700 · Cited by 38
Self-citationOn Deep Recurrent Reinforcement Learning for Active Visual Tracking of Space Noncooperative Objects
Zhou, D. X., Sun, G., Zhang, Z., & Wu, L. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3282792 · Cited by 34
The use of reinforcement learning algorithms in object tracking: A systematic literature review
Rojas, D., Medina, M. C. C., Fernandes, B., & Barros, P. V. A. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127954 · Cited by 21
Metadata
- Authors
- Dionigi, A., Devo, A., Guiducci, L., & Costante, G.
- Affiliations
- University of Perugia (IT)
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2022-04
- Volume
- 7
- Issue
- 2
- Pages
- 4259-4266
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W4285216306
- Cited by
- 28
- References
- 33
- Citations by year
- 2025: 8 · 2024: 9 · 2023: 11
- FWCI
- 2.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Robotics and Automation Letters (publishedVersion)
- Funders
- HiPeRT
- Autonomous Robotics Research Center
- UAE Technology Innovation Institute
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- visual object tracking, target detection, robot motion control, target search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.