M2DGR: A Multi-Sensor and Multi-Scenario SLAM Dataset for Ground Robots
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
We introduce M2DGR: a novel large-scale dataset collected by a ground robot with a full sensor-suite including six fish-eye and one sky-pointing RGB cameras, an infrared camera, an event camera, a Visual-Inertial Sensor (VI-sensor), an inertial measurement unit (IMU), a LiDAR, a consumer-grade Global Navigation Satellite System (GNSS) receiver and a GNSS-IMU navigation system with real-time kinematic (RTK) signals. All those sensors were well-calibrated and synchronized, and their data were recorded simultaneously. The ground truth trajectories were obtained by the motion capture device, a laser 3D tracker, and an RTK receiver. The dataset comprises 36 sequences (about 1 TB) captured in diverse scenarios including both indoor and outdoor environments. We evaluate state-of-the-art SLAM algorithms on M2DGR. Results show that existing solutions perform poorly in some scenarios. For the benefit of the research community, we make the dataset and tools public. The webpage of our project ishttps://github.com/SJTU-ViSYS/M2DGR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 2×
“Most existing SLAM datasets focus on autonomous driving [27], [26], [28] or UAVs [32].”
BackgroundMethodnuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Qin, T., Li, P., & Shen, S. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2853729 · Cited by 4,669 · cited 3×
“For example, ORB-SLAM3 [9] and VINS-Mono [7] integrate vision and IMU.”
BackgroundORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodriguez, J. J. G., M. Montiel, J. M., & D. Tardos, J. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,274
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596 · cited 2×
“Though SLAM research has made a substantial progress in the past decades [2], [3], existing solutions frequently perform poorly in practice.”
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00252 · Cited by 3,437
LOAM: Lidar Odometry and Mapping in Real-time
Zhang, J., & Singh, S. (2014) · Robotics: Science and Systems X · doi:10.15607/rss.2014.x.007 · Cited by 3,303 · cited 2×
“Method / Sequence Street02 Street06 Street07 Roomdark06 Hall05 Door01 Lift04 A-LOAM [44] 5.”
MethodPast, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain
Shan, T., & Englot, B. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594299 · Cited by 2,295
LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping
Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., & Rus, D. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341176 · Cited by 2,199
The EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M. W., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,066
A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses
Kannala, J., & Brandt, S. S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.153 · Cited by 949
Unified temporal and spatial calibration for multi-sensor systems
Furgale, P., Rehder, J., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696514 · Cited by 807
An introduction to inertial navigation
Woodman, O. J. (2021) · doi:10.48456/tr-696 · Cited by 791
Lvi-sam: Tightly-coupled lidar-visual-inertial odometry via smoothing and mapping
Shan, T., Englot, B., Ratti, C., & Rus, D. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561996 · Cited by 624
Mueggler, E., Rebecq, H., Gallego, G., Delbruck, T., & Scaramuzza, D. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917691115 · Cited by 606
University of Michigan North Campus long-term vision and lidar dataset
Carlevaris-Bianco, N., Ushani, A. K., & Eustice, R. M. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915614638 · Cited by 576 · cited 2×
“…[31] Inland USV Short-term 2 EUROC [32] Indoors UAV Short-term 2 UZH-FPV [33] In/Outdoors UAV Short-term 2 TUM VI [34] In/Outdoors Hand-held Short-term 2 LaFiDa [35] In/Outdoors Helmet Short-term 3 NCLT [36] In/Outdoors Ground Robot Long-term 6 OpenLORIS [6] Indoors Ground Robot Short-term 2”
MethodAn Open Approach to Autonomous Vehicles
Kato, S., Takeuchi, E., Ishiguro, Y., Ninomiya, Y., Takeda, K., & Hamada, T. (2015) · IEEE Micro · doi:10.1109/mm.2015.133 · Cited by 564
Vidal, A. R., Rebecq, H., Horstschaefer, T., & Scaramuzza, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2793357 · Cited by 541
A Toolbox for Easily Calibrating Omnidirectional Cameras
Scaramuzza, D., Martinelli, A., & Siegwart, R. (2006) · 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2006.282372 · Cited by 510
The TUM VI Benchmark for Evaluating Visual-Inertial Odometry
Schubert, D., Goll, T., Demmel, N., Usenko, V., Stuckler, J., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593419 · Cited by 473
Single View Point Omnidirectional Camera Calibration from Planar Grids
Mei, C., & Rives, P. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364084 · Cited by 441
EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time
Rebecq, H., Horstschaefer, T., Gallego, G., & Scaramuzza, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2645143 · Cited by 410
GVINS: Tightly Coupled GNSS–Visual–Inertial Fusion for Smooth and Consistent State Estimation
Cao, S., Lu, X., & Shen, S. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3133730 · Cited by 406
LINS: A Lidar-Inertial State Estimator for Robust and Efficient Navigation
Qin, C., Ye, H., Pranata, C. E., Han, J., Zhang, S., & Liu, M. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197567 · Cited by 391
CoSLAM: Collaborative Visual SLAM in Dynamic Environments
Zou, D., & Tan, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.104 · Cited by 382
Self-citationKAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving
Choi, Y., Kim, N., Hwang, S., Park, K., Yoon, J. S., An, K., & Kweon, I. S. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2791533 · Cited by 370 · cited 1×
“The KAIST D/N [29] dataset collected data from a stereo camera and a thermal infrared camera on a car, as well as a 32-beam LiDAR.”
MethodR $^2$ LIVE: A Robust, Real-Time, LiDAR-Inertial-Visual Tightly-Coupled State Estimator and Mapping
Lin, J., Zheng, C., Xu, W., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3095515 · Cited by 293
A2D2: Audi Autonomous Driving Dataset
Geyer, J., Kassahun, Y., Mahmudi, M., Ricou, X., Durgesh, R., Chung, A. S., Hauswald, L., Pham, V. H., Mühlegg, M., Dorn, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.06320 · Cited by 250
Are We Ready for Autonomous Drone Racing? The UZH-FPV Drone Racing Dataset
Delmerico, J., Cieslewski, T., Rebecq, H., Faessler, M., & Scaramuzza, D. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793887 · Cited by 235
Benefit of large field-of-view cameras for visual odometry
Zhang, Z., Rebecq, H., Förster, C., & Scaramuzza, D. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487210 · Cited by 205
A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors
Qin, T., Cao, S., Pan, J., & Shen, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03642 · Cited by 202
Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM
Shi, X., Li, D., Zhao, P., Tian, Q., Tian, Y., Long, Q., Zhu, C., Song, J., Qiao, F., Song, L., et al. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196638 · Cited by 185
UrbanLoco: A Full Sensor Suite Dataset for Mapping and Localization in Urban Scenes
Wen, W., Zhou, Y., Zhang, G., Fahandezh-Saadi, S., Bai, X., Zhan, W., Tomizuka, M., & Hsu, L.-T. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196526 · Cited by 172
Cheng, Y., Jiang, M., Zhu, J., & Liu, Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3067271 · Cited by 161
Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Estimation
Lv, J., Xu, J., Hu, K., Liu, Y., & Zuo, X. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341405 · Cited by 132
The UTIAS multi-robot cooperative localization and mapping dataset
Leung, K. Y. K., Halpern, Y., Barfoot, T. D., & Liu, H. H. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911398404 · Cited by 130
Panoramic SLAM from a multiple fisheye camera rig
Ji, S., Qin, Z., Shan, J., & Lü, M. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.11.014 · Cited by 83
Li, T., Pei, L., Xiang, Y., Wu, Q., Xia, S., Tao, L., Guan, X., & Yu, W. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3042968 · Cited by 80
Self-citationToward accurate localization in guided transport: Combining GNSS data and imaging information
Marais, J., Meurie, C., Attia, D., Ruichek, Y., & Flancquart, A. (2013) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2013.11.008 · Cited by 77
Brno Urban Dataset - The New Data for Self-Driving Agents and Mapping Tasks
Ligocki, A., Jelínek, A., & Žalud, L. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197277 · Cited by 62
Thermal-Inertial Odometry for Autonomous Flight Throughout the Night
Delaune, J. H., Hewitt, R. A., Lytle, L., Sorice, C., Thakker, R., & Matthies, L. H. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968238 · Cited by 60
ROVO: Robust Omnidirectional Visual Odometry for Wide-baseline Wide-FOV Camera Systems
Seok, H., & Lim, J. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793758 · Cited by 52
CubemapSLAM: A Piecewise-Pinhole Monocular Fisheye SLAM System
Wang, Y., Cai, S., Li, S., Liu, Y., Guo, Y.-Y., Li, T., & Cheng, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20876-9_3 · Cited by 44
Self-citationPanoraMIS: An ultra-wide field of view image dataset for vision-based robot-motion estimation
Benseddik, H. E., Morbidi, F., & Caron, G. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920915248 · Cited by 22
Pit30M: A Benchmark for Global Localization in the Age of Self-Driving Cars
Martínez, J., Doubov, S., Fan, J., Bârsan, I. A., Wang, S., Máttyus, G., & Urtasun, R. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340924 · Cited by 20
Li, A., Zou, D., & Yu, W. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636045 · Cited by 11
Self-citation
Metadata
- Authors
- Yin, J., Li, A., Li, T., Yu, W., & Zou, D.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2022-04
- Volume
- 7
- Issue
- 2
- Pages
- 2266-2273
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W4285512293
- Cited by
- 299
- References
- 48
- FWCI
- 20.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.