The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Detect-SLAM: Making Object Detection and SLAM Mutually Beneficial
Abstract
Although significant progress has been made in SLAM and object detection in recent years, there are still a series of challenges for both tasks, e.g., SLAM in dynamic environments and detecting objects in complex environments. To address these challenges, we present a novel robotic vision system, which integrates SLAM with a deep neural networkbased object detector to make the two functions mutually beneficial. The proposed system facilitates a robot to accomplish tasks reliably and efficiently in an unknown and dynamic environment. Experimental results show that compare to the state-of-the-art robotic vision systems, the proposed system has three advantages: i) it greatly improves the accuracy and robustness of SLAM in dynamic environments by removing unreliable features from moving objects leveraging the object detector, ii) it builds an instance-level semantic map of the environment in an online fashion using the synergy of the two functions for further semantic applications; and iii) it improves the object detector so that it can detect/recognize objects effectively under more challenging conditions such as unusual viewpoints, poor lighting condition, and motion blur, by leveraging the object map.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
(2016) · Cited by 31,590
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 3×
“Single Shot Multibox Object Detector (SSD) [14] is the first DNN-based real-time object detector that achieves above 70 % mAP in PAS-CAL VOC dataset [6] with 40 FPS in TitanX.”
BackgroundMethodORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037
ROS: an open-source Robot Operating System
Quigley, M. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · Cited by 8,729
Thrun, S. (2002) · Communications of the ACM · doi:10.1145/504729.504754 · Cited by 7,994
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898 · cited 1×
“4.1 shows some examples of computed trajectories of our system using the TUM dataset, with comparison to the ground-truth and the original RGB-D-based ORB-SLAM [19].”
MethodInfluentialORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
Training Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686 · cited 1×
“Previous works [30] have demonstrate that selecting hard examples to train or finetune deep neural network can yield significant boosts in detection performance.”
BackgroundProbabilistic Robotics (Intelligent Robotics and Autonomous Agents)
Thrun, S., Burgard, W., & Fox, D. (2005) · The MIT Press eBooks · Cited by 1,422
SLAM++: Simultaneous Localisation and Mapping at the Level of Objects
Salas-Moreno, R. F., Newcombe, R. A., Strasdat, H., Kelly, P. H. J., & Davison, A. J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.178 · Cited by 945
Dense visual SLAM for RGB-D cameras
Kerl, C., Sturm, J., & Cremers, D. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696650 · Cited by 909
ElasticFusion: Dense SLAM Without A Pose Graph
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., & Davison, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.001 · Cited by 835
3-D Mapping With an RGB-D Camera
Endres, F., Hess, J., Sturm, J., Cremers, D., & Burgard, W. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2279412 · Cited by 820
SemanticFusion: Dense 3D semantic mapping with convolutional neural networks
McCormac, J., Handa, A., Davison, A., & Leutenegger, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989538 · Cited by 682
Simultaneous Localization, Mapping and Moving Object Tracking
Wang, C.-C., Thorpe, C., Thrun, S., Hebert, M., & Durrant-Whyte, H. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907081229 · Cited by 596
Probabilistic data association for semantic SLAM
Bowman, S. L., Atanasov, N., Daniilidis, K., & Pappas, G. J. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989203 · Cited by 462
Improving RGB-D SLAM in dynamic environments: A motion removal approach
Sun, Y., Liu, M., & Meng, M. Q.-H. (2017) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.11.012 · Cited by 385
Online global loop closure detection for large-scale multi-session graph-based SLAM
Labbe, M., & Michaud, F. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942926 · Cited by 373
UnrealCV: Connecting Computer Vision to Unreal Engine
Qiu, W., & Yuille, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_75 · Cited by 251
Mobile Robot Simultaneous Localization and Mapping in Dynamic Environments
Wolf, D. F., & Sukhatme, G. S. (2005) · Autonomous Robots · doi:10.1007/s10514-005-0606-4 · Cited by 248 · cited 1×
“[9, 37] attempted to treat those moving objects, mostly people, as outliers and remove them from the environment representations.”
BackgroundUnrealCV: Virtual Worlds for Computer Vision
Qiu, W., Zhong, F., Zhang, Y., Qiao, S., Xiao, Z., Kim, T. S., & Wang, Y. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3129396 · Cited by 186
Self-citationMonocular SLAM Supported Object Recognition
Pillai, S., & Leonard, J. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.034 · Cited by 118 · cited 4×
“Inspired by the recent success of combing SLAM with object detection [2, 3, 7, 21, 32], we propose a novel framework, Detect-SLAM, which integrates visual SLAM with a deep neural network (DNN) based object detector to make them mutually beneficial.”
MethodInfluentialStereo-based simultaneous localization, mapping and moving object tracking
Lin, K.-H., & Wang, C. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5649653 · Cited by 104
Mobile robot mapping in populated environments
Hähnel, D., Schulz, D., & Burgard, W. (2003) · Advanced Robotics · doi:10.1163/156855303769156965 · Cited by 88
Direct Sparse OdometryPreprint
Engel, J. J., Koltun, V., & Cremers, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02565 · Cited by 70
Object-aware bundle adjustment for correcting monocular scale drift
Frost, D., Kähler, O., & Murray, D. W. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487680 · Cited by 67
Migliore, D., Rigamonti, R., Marzorati, D., Matteucci, M., & Sorrenti, D. G. (2009) · BOA (University of Milano-Bicocca) · Cited by 64
Modeling dynamic scenarios for local sensor-based motion planning
Montesano, L., Mínguez, J., & Montano, L. (2008) · Autonomous Robots · doi:10.1007/s10514-008-9092-9 · Cited by 46
Monocular reconstruction of vehicles: Combining SLAM with shape priors
Chhaya, F., Reddy, D. S., Upadhyay, S., Chari, V., Zia, M. Z., & Krishna, K. M. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487799 · Cited by 38
Vision-Based SLAM and Moving Objects Tracking for the Perceptual Support of a Smart Walker Platform
Panteleris, P., & Argyros, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16199-0_29 · Cited by 19
Probabilistic Global Scale Estimation for MonoSLAM Based on Generic Object Detection
Sucar, E., & Hayet, J.-B. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.135 · Cited by 18
Optimizing Deep CNN-Based Queries over Video Streams at ScalePreprint
Kang, D. D., Emmons, J., Abuzaid, F., Bailis, P. D., & Zaharia, M. (2017) · arXiv (Cornell University) · Cited by 11
Object Recognition from Short Videos for Robotic PerceptionPreprint
Bogun, I., Angelova, A., & Jaitly, N. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01602 · Cited by 7
Cited by
Xiao, L., Wang, J., Qiu, X., Rong, Z., & Zou, X. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.012 · Cited by 348
RDS-SLAM: Real-Time Dynamic SLAM Using Semantic Segmentation Methods
Liu, Y., & Miura, J. (2021) · IEEE Access · doi:10.1109/access.2021.3050617 · Cited by 324
SEAL: Self-supervised embodied active learning using exploration and 3D consistency
Chaplot, D. S., Dalal, M., Gupta, S., Malik, J., & Salakhutdinov, R. (2021) · arXiv · doi:10.48550/arxiv.2112.01001 · Cited by 22
Metadata
- Authors
- Zhong, F., Wang, S., Zhang, Z., Chen, C., & Wang, Y.
- Venue
- 2018 IEEE Winter Conference on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2018-03
- Pages
- 1001-1010
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W2802671577
- Cited by
- 307
- References
- 40
- FWCI
- 29.86
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.