The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge
Open accessAbstract
This paper presents our method for enabling a UAV quadrotor, equipped with a monocular camera, to autonomously avoid collisions with obstacles in unstructured and unknown indoor environments. When compared to obstacle avoidance in ground vehicular robots, UAV navigation brings in additional challenges because the UAV motion is no more constrained to a well-defined indoor ground or street environment. Unlike ground vehicular robots, a UAV has to navigate across more types of obstacles - for e.g., objects like decorative items, furnishings, ceiling fans, sign-boards, tree branches, etc., are also potential obstacles for a UAV. Thus, methods of obstacle avoidance developed for ground robots are clearly inadequate for UAV navigation. Current control methods using monocular images for UAV obstacle avoidance are heavily dependent on environment information. These controllers do not fully retain and utilize the extensively available information about the ambient environment for decision making. We propose a deep reinforcement learning based method for UAV obstacle avoidance (OA) which is capable of doing exactly the same. The crucial idea in our method is the concept of partial observability and how UAVs can retain relevant information about the environment structure to make better future navigation decisions. Our OA technique uses recurrent neural networks with temporal attention and provides better results compared to prior works in terms of distance covered without collisions. In addition, our technique has a high inference rate and reduces power wastage as it minimizes oscillatory motion of UAV.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Generative Adversarial Networks: An Overview
Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., & Bharath, A. A. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765202 · Cited by 4,540 · cited 1×
“Another future enhancement would be to use different GAN architectures for depth prediction (see [41], [42]).”
BackgroundDeep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910
Microsoft Kinect Sensor and Its Effect
Zhang, Z. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.24 · Cited by 2,487
Generative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
Deeper Depth Prediction with Fully Convolutional Residual Networks
Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., & Navab, N. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.32 · Cited by 1,982
Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
Liu, F., Shen, C., Lin, G., & Reid, I. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2505283 · Cited by 1,240
Help from the Sky: Leveraging UAVs for Disaster Management
Erdelj, M., Natalizio, E., Chowdhury, K. R., & Akyildiz, I. F. (2017) · IEEE Pervasive Computing · doi:10.1109/mprv.2017.11 · Cited by 996
Semi-Supervised Deep Learning for Monocular Depth Map Prediction
Kuznietsov, Y., Stuckler, J., & Leibe, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.238 · Cited by 680
BEGAN: Boundary Equilibrium Generative Adversarial Networks
Berthelot, D., Schumm, T., & Metz, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10717 · Cited by 654
CAD2RL: Real Single-Image Flight Without a Single Real Image
Sadeghi, F., & Levine, S. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.034 · Cited by 618
Ham, Y., Han, K. K., Lin, J. J., & Golparvar-Fard, M. (2016) · Visualization in Engineering · doi:10.1186/s40327-015-0029-z · Cited by 503
Playing FPS Games with Deep Reinforcement Learning
Lample, G., & Chaplot, D. S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10827 · Cited by 452
Gandhi, D., Pinto, L., & Gupta, A. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206247 · Cited by 253
MAV navigation through indoor corridors using optical flow
Zingg, S., Scaramuzza, D., Weiss, S., & Siegwart, R. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509777 · Cited by 210
A deep-network solution towards model-less obstacle avoidance
Tai, L., Li, S., & Liu, M. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759428 · Cited by 207
Learning to generate images with perceptual similarity metrics
Snell, J., Ridgeway, K., Liao, R., Roads, B. D., Mozer, M. C., & Zemel, R. S. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8297089 · Cited by 186
The influence of drone monitoring on crop health and harvest size
Reinecke, M., & Prinsloo, T. (2017) · 2017 1st International Conference on Next Generation Computing Applications (NextComp) · doi:10.1109/nextcomp.2017.8016168 · Cited by 163
Fast robust monocular depth estimation for Obstacle Detection with fully convolutional networks
Mancini, M., Costante, G., Valigi, P., & Ciarfuglia, T. A. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759632 · Cited by 110
Semi-Supervised Deep Learning for Monocular Depth Map Prediction
Kuznietsov, Y., Stückler, J., & Leibe, B. (2017) · RWTH Publications (RWTH Aachen) · doi:10.48550/arxiv.1702.02706 · Cited by 103
Temporal Attention-Gated Model for Robust Sequence Classification
Pei, W., Baltrušaitis, T., Tax, D. M. J., & Morency, L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.94 · Cited by 90
Collision Avoidance for Quadrotors with a Monocular Camera
Alvarez, H., Paz, L. M., Sturm, J., & Cremers, D. (2015) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-23778-7_14 · Cited by 83
CNN-based single image obstacle avoidance on a quadrotor
Chakravarty, P., Kelchtermans, K., Roussel, T., Wellens, S., Tuytelaars, T., & Eycken, L. V. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989752 · Cited by 78
J-MOD2: Joint Monocular Obstacle Detection and Depth Estimation
Mancini, M., Costante, G., Valigi, P., & Ciarfuglia, T. A. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800083 · Cited by 63
Regret Minimization for Partially Observable Deep Reinforcement LearningPreprint
Jin, P., Keutzer, K., & Levine, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.11424 · Cited by 53
Obstacle Avoidance through Deep Networks based Intermediate PerceptionPreprint
Yang, S., Konam, S., Ma, C., Rosenthal, S. L., Veloso, M., & Scherer, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.08759 · Cited by 48
Visual SLAM with a RGB-D Camera on a Quadrotor UAV Using on-Board Processing
Aguilar, W. G., Rodríguez, G. A., Alvarez, L. G., Sandoval, S., Quisaguano, F. J., & Limaico, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59147-6_51 · Cited by 48
Real-time scene understanding for UAV imagery based on deep convolutional neural networks
Sheppard, C., & Rahnemoonfar, M. (2017) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2017.8127435 · Cited by 32
Cited by
Path planning and obstacle avoidance for AUV: A review
Cheng, C., Sha, Q., He, B., & Li, G. (2021) · Ocean Engineering · doi:10.1016/j.oceaneng.2021.109355 · Cited by 378
Drone Deep Reinforcement Learning: A Review
Azar, A. T., Koubaa, A., Ali Mohamed, N., Ibrahim, H. A., Ibrahim, Z. F., Kazim, M., Ammar, A., Benjdira, B., Khamis, A. M., Hameed, I. A., et al. (2021) · Electronics · doi:10.3390/electronics10090999 · Cited by 314
“So it becomes an aim to design an algorithm capable of combining information collected over some time in order to enhance real-time navigation decisions [44].”
BackgroundMethodInfluentialToward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches
Bai, Y., Zhao, H., Zhang, X., Chang, Z., Jäntti, R., & Yang, K. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3323344 · Cited by 295
Reliable and Efficient Data Collection in UAV-based IoT Networks
Joshi, P., Kalita, A., & Gurusamy, M. (2023) · arXiv · doi:10.48550/arxiv.2311.05303 · Cited by 61
“…optimization, or swarm coordination—researchers can enhance the performance of UAV-assisted IoT systems, leading to improved reliability, data integrity, and overall system resilience in diverse applications, including disaster recovery, environmental monitoring, and infrastructure management.”
Metadata
- Authors
- Singla, A., Padakandla, S., & Bhatnagar, S.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2021-01
- Volume
- 22
- Issue
- 1
- Pages
- 107-118
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2899884870
- Cited by
- 317
- References
- 35
- FWCI
- 9.67
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.