The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
DSEC: A Stereo Event Camera Dataset for Driving Scenarios
Open accessAbstract
Once an academic venture, autonomous driving has received unparalleled corporate funding in the last decade. Still, operating conditions of current autonomous cars are mostly restricted to ideal scenarios. This means that driving in challenging illumination conditions such as night, sunrise, and sunset remains an open problem. In these cases, standard cameras are being pushed to their limits in terms of low light and high dynamic range performance. To address these challenges, we propose, DSEC, a new dataset that contains such demanding illumination conditions and provides a rich set of sensory data. DSEC offers data from a wide-baseline stereo setup of two color frame cameras and two high-resolution monochrome event cameras. In addition, we collect lidar data and RTK GPS measurements, both hardware synchronized with all camera data. One of the distinctive features of this dataset is the inclusion of high-resolution event cameras. Event cameras have received increasing attention for their high temporal resolution and high dynamic range performance. However, due to their novelty, event camera datasets in driving scenarios are rare. This work presents the first high resolution, large scale stereo dataset with event cameras. The dataset contains 53 sequences collected by driving in a variety of illumination conditions and provides ground truth disparity for the development and evaluation of event-based stereo algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
Stereo Processing by Semiglobal Matching and Mutual Information
Hirschmuller, H. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1166 · Cited by 4,195
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00252 · Cited by 3,437
Object modelling by registration of multiple range images
Chen, Y., & Medioni, G. (1992) · Image and Vision Computing · doi:10.1016/0262-8856(92)90066-c · Cited by 3,154
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Self-citationRos, G., Sellart, L., Materzynska, J., Vazquez, D., & Lopez, A. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.352 · Cited by 2,338
Object scene flow for autonomous vehicles
Menze, M., & Geiger, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298925 · Cited by 2,270
1 year, 1000 km: The Oxford RobotCar dataset
Maddern, W., Pascoe, G., Linegar, C., & Newman, P. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916679498 · Cited by 1,632 · cited 1×
“Oxford RobotCar [27] and KAIST Urban [28] target localization and mapping, while DDAD [29] and DrivingStereo [6] are specialized for monocular or stereo depth estimation respectively.”
MethodThe Mapillary Vistas Dataset for Semantic Understanding of Street Scenes
Neuhold, G., Ollmann, T., Bulo, S. R., & Kontschieder, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.534 · Cited by 1,434
High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth
Scharstein, D., Hirschmüller, H., Kitajima, Y., Krathwohl, G., Nešić, N., Wang, X., & Westling, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-11752-2_3 · Cited by 1,305
A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor
Brandli, C., Berner, R., Yang, M., Liu, S.-C., & Delbruck, T. (2014) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2342715 · Cited by 1,144
VirtualWorlds as Proxy for Multi-object Tracking Analysis
Gaidon, A., Wang, Q., Cabon, Y., & Vig, E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.470 · Cited by 1,079
Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., & Geiger, A. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00012 · Cited by 924
Unified temporal and spatial calibration for multi-sensor systems
Furgale, P., Rehder, J., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696514 · Cited by 807
3D Packing for Self-Supervised Monocular Depth Estimation
Guizilini, V., Ambrus, R., Pillai, S., Raventos, A., & Gaidon, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00256 · Cited by 741
The ApolloScape Dataset for Autonomous Driving
Huang, X., Cheng, X., Geng, Q., Cao, B., Zhou, D., Wang, P., Lin, Y., & Yang, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00141 · Cited by 679
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
Self-citationTightly Coupled 3D Lidar Inertial Odometry and Mapping
Ye, H., Chen, Y., & Liu, M. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793511 · Cited by 574
Unsupervised Event-Based Learning of Optical Flow, Depth, and Egomotion
Zhu, A. Z., Yuan, L., Chaney, K., & Daniilidis, K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00108 · Cited by 571
The Multivehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception
Zhu, A. Z., Thakur, D., Ozaslan, T., Pfrommer, B., Kumar, V., & Daniilidis, K. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800793 · Cited by 567
HATS: Histograms of Averaged Time Surfaces for Robust Event-Based Object Classification
Sironi, A., Brambilla, M., Bourdis, N., Lagorce, X., & Benosman, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00186 · Cited by 486
Learning to Detect Objects with a 1 Megapixel Event CameraPreprint
Perot, E., de Tournemire, P., Nitti, D., Masci, J., & Sironi, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13436 · Cited by 382
Markley, F. L., Cheng, Y., Crassidis, J. L., & Oshman, Y. (2007) · Journal of Guidance, Control, and Dynamics · doi:10.2514/1.28949 · Cited by 363
Bringing a Blurry Frame Alive at High Frame-Rate With an Event Camera
Pan, L., Scheerlinck, C., Yu, X., Hartley, R., Liu, M., & Dai, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00698 · Cited by 308
Complex urban dataset with multi-level sensors from highly diverse urban environments
Jeong, J., Cho, Y., Shin, Y.-S., Roh, H., & Kim, A. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919843996 · Cited by 296
Finateu, T., Niwa, A., Matolin, D., Tsuchimoto, K., Mascheroni, A., Reynaud, E., Mostafalu, P., Brady, F., Chotard, L., LeGoff, F., et al. (2020) · 2020 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc19947.2020.9063149 · Cited by 256
A2D2: Audi Autonomous Driving Dataset
Geyer, J., Kassahun, Y., Mahmudi, M., Ricou, X., Durgesh, R., Chung, A. S., Hauswald, L., Pham, V. H., Mühlegg, M., Dorn, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.06320 · Cited by 250
DrivingStereo: A Large-Scale Dataset for Stereo Matching in Autonomous Driving Scenarios
Yang, G., Song, X., Huang, C., Deng, Z., Shi, J., & Zhou, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00099 · Cited by 237
EKLT: Asynchronous Photometric Feature Tracking Using Events and Frames
Gehrig, D., Rebecq, H., Gallego, G., & Scaramuzza, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01209-w · Cited by 234
Self-citationA Large Scale Event-based Detection Dataset for AutomotivePreprint
de Tournemire, P., Nitti, D., Perot, E., Migliore, D., & Sironi, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08499 · Cited by 196
Semi-dense 3D Reconstruction with a Stereo Event Camera
Zhou, Y., Gallego, G., Rebecq, H., Kneip, L., Li, H., & Scaramuzza, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_15 · Cited by 195
Self-citationLearning Event-Based Motion Deblurring
Jiang, Z., Zhang, Y., Zou, D., Ren, J., Lv, J., & Liu, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00338 · Cited by 195
Semantic Instance Annotation of Street Scenes by 3D to 2D Label Transfer
Xie, J., Kiefel, M., Sun, M.-T., & Geiger, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.401 · Cited by 167
Learning an Event Sequence Embedding for Dense Event-Based Deep Stereo
Tulyakov, S., Fleuret, F., Kiefel, M., Gehler, P., & Hirsch, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00161 · Cited by 134
Hu, Y., Binas, J., Neil, D., Liu, S., & Delbrück, T. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294515 · Cited by 98
DDD17: End-To-End DAVIS Driving Dataset
Binas, J., Neil, D., Liu, S.-C., & Delbruck, T. (2017) · arXiv · doi:10.48550/arxiv.1711.01458 · Cited by 96
Single Image Optical Flow Estimation With an Event Camera
Pan, L., Liu, M., & Hartley, R. I. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00174 · Cited by 96
Realtime Time Synchronized Event-Based Stereo
Zhu, A. Z., Chen, Y., & Daniilidis, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_27 · Cited by 93
Event-Based Visual Place Recognition With Ensembles of Temporal Windows
Fischer, T., & Milford, M. J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3025505 · Cited by 88
DET: A High-Resolution DVS Dataset for Lane Extraction
Cheng, W., Luo, H., Yang, W. T., Yu, L., Chen, S., & Li, W. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00210 · Cited by 81
A Low Power, High Throughput, Fully Event-Based Stereo System
Andreopoulos, A., Kashyap, H. J., Nayak, T. K., Amir, A., & Flickner, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00786 · Cited by 72
Neuromorphic Stereo Vision: A Survey of Bio-Inspired Sensors and Algorithms
Steffen, L., Reichard, D., Weinland, J., Kaiser, J., Roennau, A., & Dillmann, R. (2019) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00028 · Cited by 72
Semi-dense 3D Reconstruction with a Stereo Event Camera
Zhou, Y. B., Gallego, G., Rebecq, H., Kneip, L., Li, H., & Scaramuzza, D. (2018) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-176054 · Cited by 58
Self-citationHigh Speed and High Dynamic Range Video with an Event Camera
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2963386 · Cited by 50 · cited 2×
“trinsic and extrinsic calibration procedure uses E2VID, a neural network-based image reconstruction [40], in combination with Kalibr [41].”
MethodSelf-citationEvent-driven stereo matching for real-time 3D panoramic vision
Schraml, S., Belbachir, A. N., & Bischof, H. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298644 · Cited by 44
Cited by
Training Spiking Neural Networks Using Lessons From Deep Learning
Eshraghian, J. K., Ward, M., Neftci, E. O., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D. S., & Lu, W. D. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3308088 · Cited by 782
Hu, M., Yin, W., Zhang, C., Cai, Z., Long, X., Chen, H., Wang, K., Yu, G., Shen, C., & Shen, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3444912 · Cited by 260
Metadata
- Authors
- Gehrig, M., Aarents, W., Gehrig, D., & Scaramuzza, D.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2021-07
- Volume
- 6
- Issue
- 3
- Pages
- 4947-4954
- ISSN
- 2377-3766
- 2377-3774
- OpenAlex
- W3139658937
- Cited by
- 428
- References
- 48
- FWCI
- 25.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.