The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment
Abstract
When working in dynamic environment, traditional SLAM framework performs poorly due to interference from dynamic objects. By taking advantages of deep learning in object detection, a semantic simultaneous localization and mapping framework named Dynamic-SLAM is proposed, in order to solve the problem of SLAM in dynamic environment. First, based on the convolutional neural network, an SSD object detector which combines prior knowledge is constructed to detect dynamic objects in the newly detection thread at semantic level. Then, in view of low recall rate of the existing SSD object detection network, a missed detection compensation algorithm based on the speed invariance in adjacent frames is proposed, which greatly improves the recall rate of detection. Finally, a feature-based visual SLAM system is constructed, which processes the feature points of dynamic objects through a selective tracking algorithm in the tracking thread, to significantly reduce the error of pose estimation caused by incorrect matching. The recall rate of the system is increased from 82.3% to 99.8% compared with the original SSD network. Several experiments show that the localization accuracy of Dynamic-SLAM is higher than the state-of-the-art systems. The system successfully localizes and constructs an accurate environmental map in real-world dynamic environment by using a mobile robot. In sum, our experimental demonstrations verify that Dynamic-SLAM shows improved accuracy and robustness in robot localization and mapping comparing to the state-of-the-art SLAM system in dynamic environment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2017) · doi:10.1109/cvpr35066.2017 · Cited by 7,141
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Qin, T., Li, P., & Shen, S. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2853729 · Cited by 4,669
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
2017 IEEE International Conference on Computer Vision (ICCV)
(2017) · doi:10.1109/iccv37128.2017 · Cited by 3,056
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
2011 International Conference on Computer Vision
(2011) · doi:10.1109/iccv17851.2011 · Cited by 2,860
2013 IEEE Conference on Computer Vision and Pattern Recognition
(2013) · doi:10.1109/cvpr19808.2013 · Cited by 2,396
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723
On the Representation and Estimation of Spatial Uncertainty
Smith, R. C., & Cheeseman, P. (1986) · The International Journal of Robotics Research · doi:10.1177/027836498600500404 · Cited by 1,579
DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes
Bescos, B., Facil, J. M., Civera, J., & Neira, J. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2860039 · Cited by 1,263
Mask R-CNNPreprint
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv (Cornell University) · Cited by 1,252
DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments
Yu, C., Liu, Z., Liu, X.-J., Xie, F., Yang, Y., Wei, Q., & Fei, Q. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593691 · Cited by 1,154
2014 IEEE International Conference on Robotics and Automation (ICRA)
(2014) · doi:10.1109/icra18334.2014 · Cited by 998
SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems
Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2623335 · Cited by 922
DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenes
Bescos, B., Fácil, J. M., Civera, J., & Neira, J. (2018) · Zaguan (Universidad de Zaragoza) · Cited by 893
2017 IEEE Winter Conference on Applications of Computer Vision (WACV)
(2017) · doi:10.1109/wacv37755.2017 · Cited by 564
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
Visual SLAM and Structure from Motion in Dynamic Environments: A Survey
Saputra, M. R. U., Markham, A., & Trigoni, N. (2019) · ACM Computing Surveys · doi:10.1145/3177853 · Cited by 398
Handbook of Intelligent Vehicles
(2012) · Springer eBooks · doi:10.1007/978-0-85729-085-4 · Cited by 377
A Real-Time Algorithm for Signal Analysis with the Help of the Wavelet Transform
Holschneider, M., Kronland-Martinet, R., Morlet, J., & Tchamitchian, P. (1990) · inverse problems and theoretical imaging · doi:10.1007/978-3-642-75988-8_28 · Cited by 339
Wang, C.-C., Thorpe, C., & Thrun, S. (2004) · 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422) · doi:10.1109/robot.2003.1241698 · Cited by 316
Detect-SLAM: Making Object Detection and SLAM Mutually Beneficial
Zhong, F., Wang, S., Zhang, Z., Chen, C., & Wang, Y. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00115 · Cited by 307
Girshick, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.08083 · Cited by 276
Mobile Robot Simultaneous Localization and Mapping in Dynamic Environments
Wolf, D. F., & Sukhatme, G. S. (2005) · Autonomous Robots · doi:10.1007/s10514-005-0606-4 · Cited by 248
StaticFusion: Background Reconstruction for Dense RGB-D SLAM in Dynamic Environments
Scona, R., Jaimez, M., Petillot, Y. R., Fallon, M., & Cremers, D. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460681 · Cited by 212
Motion removal for reliable RGB-D SLAM in dynamic environments
Sun, Y., Liu, M., & Meng, M. Q.-H. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.07.002 · Cited by 201
Dynamic pose graph SLAM: Long-term mapping in low dynamic environments
Walcott-Bryant, A., Kaess, M., Johannsson, H., & Leonard, J. J. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385561 · Cited by 149
Grid-based localization and local mapping with moving object detection and tracking
Vu, T. D., Burlet, J., & Aycard, O. (2010) · Information Fusion · doi:10.1016/j.inffus.2010.01.004 · Cited by 113
Detection and Tracking of Moving Objects Using 2.5D Motion Grids
Asvadi, A., Peixoto, P., & Nunes, U. (2015) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2015.133 · Cited by 82
Simultaneous Localisation and Mapping in Dynamic Environments (SLAMIDE) with Reversible Data Associa
Bibby, C., & Reid, I. D. (2007) · Robotics: Science and Systems · doi:10.15607/rss.2007.iii.014 · Cited by 78
Barnes, D., Maddern, W., Pascoe, G., & Posner, I. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460564 · Cited by 57
Long-range terrain perception using convolutional neural networks
Zhang, W., Chen, Q., Zhang, W., & He, X. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.09.012 · Cited by 53
Multiple target tracking using recursive RANSAC
Niedfeldt, P. C., & Beard, R. W. (2014) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2014.6859273 · Cited by 51
Awareness of Road Scene Participants for Autonomous Driving
Petrovskaya, A., Perrollaz, M., de Oliveira, L. R., Spinello, L., Triebel, R., Makris, A., Yoder, J.-D., Laugier, C., Nunes, U., & Bessìère, P. (2012) · Springer eBooks · doi:10.1007/978-0-85729-085-4_54 · Cited by 41
A SURVEY OF MOTION-BASED MULTITARGET TRACKING METHODS
Qiu, C., Zhang, Z., Lu, H., & Luo, H. (2015) · Progress In Electromagnetics Research B · doi:10.2528/pierb15010503 · Cited by 32
SLAM ESTIMATION IN DYNAMIC OUTDOOR ENVIRONMENTS
Lu, Z., Hu, Z., & Uchimura, K. (2010) · International Journal of Humanoid Robotics · doi:10.1142/s021984361000212x · Cited by 9
Cited by
Deep Learning Sensor Fusion for Autonomous Vehicle Perception and Localization: A Review
Fayyad, J., Jaradat, M. A., Gruyer, D., & Najjaran, H. (2020) · Sensors · doi:10.3390/s20154220 · Cited by 498
A Comprehensive Survey of Visual SLAM Algorithms
Macario Barros, A., Michel, M., Moline, Y., Corre, G., & Carrel, F. (2022) · Robotics · doi:10.3390/robotics11010024 · Cited by 429
A survey of state-of-the-art on visual SLAM
Abaspur Kazerouni, I., Fitzgerald, L., Dooly, G., & Toal, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117734 · Cited by 383
DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM
Bescos, B., Campos, C., Tardos, J. D., & Neira, J. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068640 · Cited by 335
RDS-SLAM: Real-Time Dynamic SLAM Using Semantic Segmentation Methods
Liu, Y., & Miura, J. (2021) · IEEE Access · doi:10.1109/access.2021.3050617 · Cited by 324
Metadata
- Authors
- Xiao, L., Wang, J., Qiu, X., Rong, Z., & Zou, X.
- Venue
- Robotics and Autonomous Systems
- Publisher
- Elsevier BV
- Published
- 2019-07
- Volume
- 117
- Pages
- 1-16
- ISSN
- 0921-8890 (ISSN-L)
- OpenAlex
- W2927562344
- Cited by
- 348
- References
- 57
- FWCI
- 24.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.