The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Predicting Semantic Map Representations From Images Using Pyramid Occupancy Networks
Open accessAbstract
Autonomous vehicles commonly rely on highly detailed birds-eye-view maps of their environment, which capture both static elements of the scene such as road layout as well as dynamic elements such as other cars and pedestrians. Generating these map representations on the fly is a complex multi-stage process which incorporates many important vision-based elements, including ground plane estimation, road segmentation and 3D object detection. In this work we present a simple, unified approach for estimating these map representations directly from monocular images using a single end-to-end deep learning architecture. For the maps themselves we adopt a semantic Bayesian occupancy grid framework, allowing us to trivially accumulate information over multiple cameras and timesteps. We demonstrate the effectiveness of our approach by evaluating against several challenging baselines on the NuScenes and Argoverse datasets, and show that we are able to achieve a relative improvement of 9.1% and 22.3% respectively compared to the best-performing existing method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Argoverse: 3D Tracking and Forecasting With Rich Maps
Chang, M.-F., Lambert, J., Sangkloy, P., Singh, J., Bak, S., Hartnett, A., Wang, D., Carr, P., Lucey, S., Ramanan, D., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00895 · Cited by 1,474
Colorization using optimization
Levin, A., Lischinski, D., & Weiss, Y. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015780 · Cited by 1,411
ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst
Bansal, M., Krizhevsky, A., & Ogale, A. (2019) · Robotics: Science and Systems XV · doi:10.15607/rss.2019.xv.031 · Cited by 731
Cross-View Semantic Segmentation for Sensing Surroundings
Pan, B., Sun, J., Leung, H. Y. T., Andonian, A., & Zhou, B. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3004325 · Cited by 291
Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Driving
Djuric, N., Radosavljevic, V., Cui, H., Nguyen, T., Chou, F.-C., Lin, T.-H., Singh, N., & Schneider, J. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093332 · Cited by 225
IntentNet: Learning to Predict Intention from Raw Sensor Data
Casas, S., Luo, W., & Urtasun, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07907 · Cited by 218
Occupancy Grids: A Stochastic Spatial Representation for Active Robot Perception
Elfes, A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1304.1098 · Cited by 216
Orthographic feature transform for monocular 3d object detection
Roddick, T., Kendall, A., & Cipolla, R. (2018) · arXiv · doi:10.48550/arxiv.1811.08188 · Cited by 211
Self-citationEnd-to-End Learning of Driving Models with Surround-View Cameras and Route Planners
Hecker, S., Dai, D., & Van Gool, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_27 · Cited by 191
MapNet: An Allocentric Spatial Memory for Mapping Environments
Henriques, J. F., & Vedaldi, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00884 · Cited by 186
Monocular Semantic Occupancy Grid Mapping With Convolutional Variational Encoder–Decoder Networks
Lu, C., van de Molengraft, M. J. G., & Dubbelman, G. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2891028 · Cited by 172
Restricted Deformable Convolution-Based Road Scene Semantic Segmentation Using Surround View Cameras
Deng, L., Yang, M. Z., Li, H., Li, T., Hu, B. Q., & Wang, C. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2939832 · Cited by 147
Exploiting Sparse Semantic HD Maps for Self-Driving Vehicle Localization
Ma, W.-C., Tartavull, I., Bârsan, I. A., Wang, S., Bai, M., Máttyus, G., Homayounfar, N., Lakshmikanth, S. K., Pokrovsky, A., & Urtasun, R. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968122 · Cited by 138
Monocular Plan View Networks for Autonomous Driving
Wang, D., Devin, C., Cai, Q.-Z., Krähenbühl, P., & Darrell, T. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967897 · Cited by 101
A Vision Based Top-View Transformation Model for a Vehicle Parking Assistant
Lin, C.-C., & Wang, M.-S. (2012) · Sensors · doi:10.3390/s120404431 · Cited by 91
Generative Adversarial Frontal View to Bird View Synthesis
Zhu, X., Yin, Z., Shi, J., Li, H., & Lin, D. (2018) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00059 · Cited by 69
Learning to Map Vehicles into Bird’s Eye View
Palazzi, A., Borghi, G., Abati, D., Calderara, S., & Cucchiara, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68560-1_21 · Cited by 52
Motion Prediction of Traffic Actors for Autonomous Driving using Deep Convolutional Networks.Preprint
Djuric, N., Radosavljević, V., Cui, H., Nguyen, T., Chou, F., Lin, T.-H., & Schneider, J. (2018) · arXiv (Cornell University) · Cited by 49
A Geometric Approach to Obtain a Bird's Eye View from an ImagePreprint
Abbas, A. N., & Zisserman, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02231 · Cited by 21
Efficient Semantic Segmentation for Visual Bird’s-Eye View Interpretation
Sämann, T., Amende, K., Milz, S., Witt, C., Simón, M., & Petzold, J. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-01370-7_53 · Cited by 17
Cited by
Bevfusion: Multi-task multi-sensor fusion with unified bird’s-eye view representation
Liu, Z., Tang, H., Amini, A., Yang, X., Mao, H., Rus, D. L., & Han, S. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10160968 · Cited by 1,307
Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D
Philion, J., & Fidler, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_12 · Cited by 1,271
TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers
Bai, X., Hu, Z., Zhu, X., Huang, Q., Chen, Y., Fu, H., & Tai, C.-L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00116 · Cited by 990
Categorical Depth Distribution Network for Monocular 3D Object Detection
Reading, C., Harakeh, A., Chae, J., & Waslander, S. L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00845 · Cited by 595
HDMapNet: An Online HD Map Construction and Evaluation Framework
Li, Q., Wang, Y., Wang, Y., & Zhao, H. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9812383 · Cited by 374
Metadata
- Authors
- Roddick, T., & Cipolla, R.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 11135-11144
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3013823321
- Cited by
- 260
- References
- 26
- FWCI
- 27.45
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.