CoChat
Sign Up
PreprintCited by 615Autonomous Vehicle Technology and SafetyAdvanced Neural Network ApplicationsRobotics and Sensor-Based Localization

The ApolloScape Open Dataset for Autonomous Driving and its Application

Open access
Huang, Xinyu, Wang, Peng, Cheng, Xinjing, Zhou, Dingfu, Geng, Qichuan, Yang, Ruigang·2018·arXiv
DOI 10.48550/arxiv.1803.06184arXiv 1803.06184
Open this paper in CoChat — free accountOpen PDF

Abstract

Autonomous driving has attracted tremendous attention especially in the past few years. The key techniques for a self-driving car include solving tasks like 3D map construction, self-localization, parsing the driving road and understanding objects, which enable vehicles to reason and act. However, large scale data set for training and system evaluation is still a bottleneck for developing robust perception models. In this paper, we present the ApolloScape dataset [1] and its applications for autonomous driving. Compared with existing public datasets from real scenes, e.g. KITTI [2] or Cityscapes [3], ApolloScape contains much large and richer labelling including holistic semantic dense point cloud for each site, stereo, per-pixel semantic labelling, lanemark labelling, instance segmentation, 3D car instance, high accurate location for every frame in various driving videos from multiple sites, cities and daytimes. For each task, it contains at lease 15x larger amount of images than SOTA datasets. To label such a complete dataset, we develop various tools and algorithms specified for each task to accelerate the labelling process, such as 3D-2D segment labeling tools, active labelling in videos etc. Depend on ApolloScape, we are able to develop algorithms jointly consider the learning and inference of multiple tasks. In this paper, we provide a sensor fusion scheme integrating camera videos, consumer-grade motion sensors (GPS/IMU), and a 3D semantic map in order to achieve robust self-localization and semantic segmentation for autonomous driving. We show that practically, sensor fusion and joint learning of multiple tasks are beneficial to achieve a more robust and accurate system. We expect our dataset and proposed relevant algorithms can support and motivate researchers for further development of multi-sensor fusion and multi-task learning in the field of computer vision.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1803.06184

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The ApolloScape 3D car instance challenge disentangles these by defining thresholds for each error type and recall threshold.

    “The ApolloScape [41] 3D car instance challenge disentangles these by defining thresholds for each error type and recall threshold.”

    From nuScenes: A Multimodal Dataset for Autonomous Driving (2020) · cites this paper as [41]

    The Introduction (p. 1) says the 3D car instance task was still under development and that the paper would elaborate it in future work. It does not describe a 3D car instance challenge with thresholds for error types or recall; its description of the task as forthcoming runs contrary to the claim that this paper defines them. (LLM, conf=0.82)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

  • At the time of the initial nuScenes release, only a few datasets annotated objects using 3D boxes, and they did not provide the full sensor suite.

    “At the time of the initial nuScenes release, only a few datasets annotated objects using 3D boxes [32, 41, 61], and they did not provide the full sensor suite.”

    From nuScenes: A Multimodal Dataset for Autonomous Driving (2020) · cites this paper as [41]

    The Introduction (p. 1) and dataset comparison (p. 3) describe ApolloScape's 3D car-instance labels, but call them fitted 3D car models, not 3D bounding boxes. The Conclusion (p. 14) says a panoramic camera and Velodyne were planned for the future, consistent with an incomplete sensor suite; it does not establish the broader claim that only a few datasets had 3D-box annotations at the time of nuScenes' release. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Most existing datasets provide the vehicle location based on GPS and IMU.

    “Most existing datasets provide the vehicle location based on GPS and IMU [32, 41, 19, 61].”

    From nuScenes: A Multimodal Dataset for Autonomous Driving (2020) · cites this paper as [41]

    Section 3.1 (p. 4) says ApolloScape uses GPS/IMU information to localize its camera, supporting this as an example of a dataset using those sensors. The paper does not establish that most existing datasets provide vehicle locations based on GPS and IMU. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 83

  1. [3][3] M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, 'The cityscapes dataset for semantic urban scene understanding,' in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2016. 1, 3, 4, 5, 11, 12, 14 -
  2. [2][2] A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, 'Vision meets robotics: The kitti dataset,' International Journal of Robotics Research (IJRR) , 2013. 1, 2, 3, 4, 5, 11, 14 -
  3. [6][6] P.-H. Huang, K. Matzen, J. Kopf, N. Ahuja, and J.-B. Huang, 'Deepmvs: Learning multi-view stereopsis,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2018, pp. 2821-2830. 1 -
  4. [5][5] A. Kar, C. H¨ ane, and J. Malik, 'Learning a multi-view stereo machine,' in Advances in neural information processing systems , 2017, pp. 365376. 1 -
  5. [7][7] Y. Yao, Z. Luo, S. Li, T. Fang, and L. Quan, 'Mvsnet: Depth inference for unstructured multi-view stereo,' in The European Conference on Computer Vision (ECCV) , September 2018. 1 -
  6. [9][9] A. Kendall, M. Grimes, and R. Cipolla, 'Posenet: A convolutional network for real-time 6-dof camera relocalization,' in Proceedings of the IEEE international conference on computer vision , 2015, pp. 2938-2946. 1, 2, 3, 11 -
  7. [8][8] X. Cheng, P. Wang, and R. Yang, 'Depth estimation via affinity learned with convolutional spatial propagation network,' European Conference on Computer Vision , 2018. 1 -
  8. [10][10] J. L. Sch¨ onberger, M. Pollefeys, A. Geiger, and T. Sattler, 'Semantic visual localization,' ISPRS Journal of Photogrammetry and Remote Sensing (JPRS) , 2018. 1, 3, 6 -
  9. [12][12] L. Chen, G. Papandreou, F. Schroff, and H. Adam, 'Rethinking atrous convolution for semantic image segmentation,' CoRR , vol. abs/1706.05587, 2017. 1, 2, 4 - · arXiv
  10. [11][11] J. Long, E. Shelhamer, and T. Darrell, 'Fully convolutional networks for semantic segmentation,' in Proceedings of the IEEE conference on computer vision and pattern recognition , 2015, pp. 3431-3440. 1, 4 -
  11. [13][13] K. He, G. Gkioxari, P. Doll´ ar, and R. Girshick, 'Mask r-cnn,' IEEE transactions on pattern analysis and machine intelligence , 2018. 1, 7, 13 -
  12. [15][15] Y. Xiang, R. Mottaghi, and S. Savarese, 'Beyond pascal: A benchmark for 3d object detection in the wild,' in Applications of Computer Vision (WACV), 2014 IEEE Winter Conference on . IEEE, 2014, pp. 75-82. 1 -
  13. [14][14] L.-C. Chen, A. Hermans, G. Papandreou, F. Schroff, P. Wang, and H. Adam, 'Masklab: Instance segmentation by refining object detection with semantic and direction features,' arXiv preprint arXiv:1712.04837 , 2017. 1 - · arXiv
  14. [16][16] A. Kar, S. Tulsiani, J. Carreira, and J. Malik, 'Category-specific object reconstruction from a single image,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2015, pp. 1966-1974. 1 -
  15. [18][18] A. Kundu, Y. Li, and J. M. Rehg, '3d-rcnn: Instance-level 3d object reconstruction via render-and-compare,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2018, pp. 3559-3568. 1 -
  16. [17][17] F. Guney and A. Geiger, 'Displets: Resolving stereo ambiguities using object knowledge,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2015, pp. 4165-4175. 1 -
  17. [19][19] X. Song, P. Wang, D. Zhou, R. Zhu, C. Guan, Y. Dai, H. Su, H. Li, and R. Yang, 'Apollocar3d: A large 3d car instance understanding benchmark for autonomous driving,' CVPR , 2019. 1, 14 -
  18. [25][25] A. Kundu, Y. Li, F. Dellaert, F. Li, and J. M. Rehg, 'Joint semantic segmentation and 3d reconstruction from monocular video,' in European Conference on Computer Vision . Springer, 2014, pp. 703-718. 2, 4 -
  19. [26][26] G. J. Brostow, J. Fauqueur, and R. Cipolla, 'Semantic object classes in video: A high-definition ground truth database,' Pattern Recognition Letters , vol. 30, no. 2, pp. 88-97, 2009. 2, 3 -
  20. [27][27] S. Wang, M. Bai, G. Mattyus, H. Chu, W. Luo, B. Yang, J. Liang, J. Cheverie, S. Fidler, and R. Urtasun, 'Torontocity: Seeing the world with a million eyes,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2017, pp. 3009-3017. 3 -
  21. [29][29] F. Yu, W. Xian, Y. Chen, F. Liu, M. Liao, V. Madhavan, and T. Darrell, 'Bdd100k: A diverse driving video database with scalable annotation tooling,' arXiv preprint arXiv:1805.04687 , 2018. 3, 4 - · arXiv
  22. [28][28] G. Neuhold, T. Ollmann, S. R. Bulo, and P. Kontschieder, 'The mapillary vistas dataset for semantic understanding of street scenes,' in Proceedings of the International Conference on Computer Vision (ICCV), Venice, Italy , 2017, pp. 22-29. 3 -
  23. [30][30] G. Ros, L. Sellart, J. Materzynska, D. Vazquez, and A. M. Lopez, 'The synthia dataset: A large collection of synthetic images for semantic segmentation of urban scenes,' in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 3234-3243. 3 -
  24. [32][32] D. Scharstein, H. Hirschm¨ uller, Y. Kitajima, G. Krathwohl, N. Neˇ si´ c, X. Wang, and P. Westling, 'High-resolution stereo datasets with subpixelaccurate ground truth,' in German Conference on Pattern Recognition . Springer, 2014, pp. 31-42. 2 -
  25. [31][31] S. R. Richter, Z. Hayder, and V. Koltun, 'Playing for benchmarks,' in International Conference on Computer Vision (ICCV) , 2017. 3 -
  26. [33][33] N. Silberman, D. Hoiem, P. Kohli, and R. Fergus, 'Indoor segmentation and support inference from rgbd images,' in European Conference on Computer Vision . Springer, 2012, pp. 746-760. 2 -
  27. [35][35] M. Everingham, L. Van Gool, C. K. Williams, J. Winn, and A. Zisserman, 'The pascal visual object classes (voc) challenge,' International journal of computer vision , vol. 88, no. 2, pp. 303-338, 2010. 2 -
  28. [34][34] T. Sattler, W. Maddern, C. Toft, A. Torii, L. Hammarstrand, E. Stenborg, D. Safari, M. Okutomi, M. Pollefeys, J. Sivic et al. , 'Benchmarking 6dof outdoor visual localization in changing conditions,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , vol. 1, 2018. 2 -
  29. [36][36] T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll´ ar, and C. L. Zitnick, 'Microsoft coco: Common objects in context,' in European conference on computer vision . Springer, 2014, pp. 740-755. 2, 12 -
  30. [38][38] J. Hoffman, D. Wang, F. Yu, and T. Darrell, 'Fcns in the wild: Pixel-level adversarial and constraint-based adaptation,' arXiv preprint arXiv:1612.02649 , 2016. 3 - · arXiv
  31. [39][39] Y. Zhang, P. David, and B. Gong, 'Curriculum domain adaptation for semantic segmentation of urban scenes,' in The IEEE International Conference on Computer Vision (ICCV) , vol. 2, no. 5, 2017, p. 6. 3 -
  32. [41][41] B. M. Haralick, C.-N. Lee, K. Ottenberg, and M. N¨ olle, 'Review and analysis of solutions of the three point perspective pose estimation problem,' IJCV , vol. 13, no. 3, pp. 331-356, 1994. 3 -
  33. [40][40] Y. Chen, W. Li, and L. Van Gool, 'Road: Reality oriented adaptation for semantic segmentation of urban scenes,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2018, pp. 7892-7901. 3 -
  34. [42][42] L. Kneip, H. Li, and Y. Seo, 'Upnp: An optimal o (n) solution to the absolute pose problem with universal applicability,' in European Conference on Computer Vision . Springer, 2014, pp. 127-142. 3 -
  35. [44][44] F. Moreno-Noguer, V. Lepetit, and P. Fua, 'Pose priors for simultaneously solving alignment and correspondence,' European Conference on Computer Vision , pp. 405-418, 2008. 3 -
  36. [43][43] P. David, D. Dementhon, R. Duraiswami, and H. Samet, 'Softposit: Simultaneous pose and correspondence determination,' IJCV , vol. 59, no. 3, pp. 259-284, 2004. 3 -
  37. [45][45] D. Campbell, L. Petersson, L. Kneip, and H. Li, 'Globally-optimal inlier set maximisation for simultaneous camera pose and feature correspondence,' in The IEEE International Conference on Computer Vision (ICCV) , vol. 1, no. 3, 2017. 3 -
  38. [47][47] J. Engel, T. Sch¨ ops, and D. Cremers, 'Lsd-slam: Large-scale direct monocular slam,' in European Conference on Computer Vision . Springer, 2014, pp. 834-849. 3 -
  39. [46][46] T. Sattler, A. Torii, J. Sivic, M. Pollefeys, H. Taira, M. Okutomi, and T. Pajdla, 'Are large-scale 3d models really necessary for accurate visual localization?' in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, 2017, pp. 6175-6184. 3 -
  40. [48][48] A. Kendall, R. Cipolla et al. , 'Geometric loss functions for camera pose regression with deep learning,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , vol. 3, 2017, p. 8. 3, 9, 10, 11 -
  41. [49][49] F. Walch, C. Hazirbas, L. Leal-Taixe, T. Sattler, S. Hilsenbeck, and D. Cremers, 'Image-based localization using lstms for structured feature correlation,' in Int. Conf. Comput. Vis.(ICCV) , 2017, pp. 627-637. 3 -
  42. [50][50] R. Clark, S. Wang, A. Markham, N. Trigoni, and H. Wen, 'Vidloc: A deep spatio-temporal model for 6-dof video-clip relocalization,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , vol. 3, 2017. 3 -
  43. [52][52] K.-N. Lianos, J. L. Sch¨ onberger, M. Pollefeys, and T. Sattler, 'Vso: Visual semantic odometry,' in Proceedings of the European Conference on Computer Vision (ECCV) , 2018, pp. 234-250. 3 -
  44. [51][51] H. Coskun, F. Achilles, R. DiPietro, N. Navab, and F. Tombari, 'Long short-term memory kalman filters: Recurrent neural estimators for pose regularization,' in Proceedings of the International Conference on Computer Vision (ICCV) , 2017. 3 -
  45. [53][53] K. Vishal, C. Jawahar, and V. Chari, 'Accurate localization by fusing images and gps signals,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops , 2015, pp. 17-24. 4, 11 -
  46. [55][55] B. Ummenhofer, H. Zhou, J. Uhrig, N. Mayer, E. Ilg, A. Dosovitskiy, and T. Brox, 'Demon: Depth and motion network for learning monocular stereo,' in IEEE Conference on computer vision and pattern recognition (CVPR) , vol. 5, 2017, p. 6. 4, 9, 10 -
  47. [54][54] Z. Laskar, I. Melekhov, S. Kalia, and J. Kannala, 'Camera relocalization by computing pairwise relative poses using convolutional neural network,' Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2017. 4 -
  48. [56][56] H. Zhao, J. Shi, X. Qi, X. Wang, and J. Jia, 'Pyramid scene parsing network,' CVPR , 2017. 4 -
  49. [58][58] W. Byeon, T. M. Breuel, F. Raue, and M. Liwicki, 'Scene labeling with lstm recurrent neural networks,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2015, pp. 3547-3555. 4 -
  50. [57][57] A. Arnab, S. Jayasumana, S. Zheng, and P. H. Torr, 'Higher order conditional random fields in deep neural networks,' in European Conference on Computer Vision . Springer, 2016, pp. 524-540. 4 -
  51. [59][59] K. He, X. Zhang, S. Ren, and J. Sun, 'Deep residual learning for image recognition,' in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770-778. 4, 13 -
  52. [61][61] H. Zhao, X. Qi, X. Shen, J. Shi, and J. Jia, 'Icnet for real-time semantic segmentation on high-resolution images,' CoRR , vol. abs/1704.08545, 2017. 4 - · arXiv
  53. [60][60] A. Paszke, A. Chaurasia, S. Kim, and E. Culurciello, 'Enet: A deep neural network architecture for real-time semantic segmentation,' CoRR , vol. abs/1606.02147, 2016. 4 - · arXiv
  54. [62][62] A. Kundu, V. Vineet, and V. Koltun, 'Feature space optimization for semantic video segmentation,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2016, pp. 3168-3175. 4 -
  55. [64][64] R. Gadde, V. Jampani, and P. V. Gehler, 'Semantic video cnns through representation warping,' Proceedings of the International Conference on Computer Vision (ICCV) , 2017. 4 -
  56. [63][63] A. Dosovitskiy, P. Fischer, E. Ilg, P. Hausser, C. Hazirbas, V. Golkov, P. Van Der Smagt, D. Cremers, and T. Brox, 'Flownet: Learning optical flow with convolutional networks,' in Proceedings of the IEEE International Conference on Computer Vision , 2015, pp. 2758-2766. 4 -
  57. [65][65] X. Zhu, Y. Xiong, J. Dai, L. Yuan, and Y. Wei, 'Deep feature flow for video recognition,' Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2017. 4 -
  58. [67][67] K. Tateno, F. Tombari, I. Laina, and N. Navab, 'Cnn-slam: Real-time dense monocular slam with learned depth prediction,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , vol. 2, 2017. 4 -
  59. [66][66] C. Hane, C. Zach, A. Cohen, R. Angst, and M. Pollefeys, 'Joint 3d scene reconstruction and class segmentation,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2013, pp. 97104. 4 -
  60. [70][70] J. Revaud, P. Weinzaepfel, Z. Harchaoui, and C. Schmid, 'Deepmatching: Hierarchical deformable dense matching,' IJCV , vol. 120, no. 3, pp. 300323, 2016. 5 -
  61. [71][71] C. Luo, Z. Yang, P. Wang, Y. Wang, W. Xu, R. Nevatia, and A. Yuille, 'Every pixel counts++: Joint learning of geometry and motion with 3d holistic understanding,' arXiv preprint arXiv:1810.06125 , 2018. 5 - · arXiv
  62. [73][73] S. Christoph Stein, M. Schoeler, J. Papon, and F. Worgotter, 'Object partitioning using local convexity,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2014, pp. 304-311. 6 -
  63. [72][72] J. Xie, M. Kiefel, M.-T. Sun, and A. Geiger, 'Semantic instance annotation of street scenes by 3d to 2d label transfer,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2016, pp. 3688-3697. 6 -
  64. [75][75] C. R. Qi, L. Yi, H. Su, and L. J. Guibas, 'Pointnet++: Deep hierarchical feature learning on point sets in a metric space,' in Advances in Neural Information Processing Systems , 2017, pp. 5105-5114. 6 -
  65. [77][77] S. Ren, K. He, R. Girshick, and J. Sun, 'Faster r-cnn: Towards real-time object detection with region proposal networks,' in Advances in neural information processing systems , 2015, pp. 91-99. 7 -
  66. [76][76] Z. Wu, C. Shen, and A. v. d. Hengel, 'Wider or deeper: Revisiting the resnet model for visual recognition,' arXiv preprint arXiv:1611.10080 , 2016. 7, 11, 12, 13, 14 - · arXiv
  67. [78][78] P. Wang, X. Shen, Z. Lin, S. Cohen, B. Price, and A. L. Yuille, 'Joint object and part segmentation using deep learned potentials,' in Proceedings of the IEEE International Conference on Computer Vision , 2015, pp. 1573-1581. 7 -
  68. [80][80] A. Kovashka, O. Russakovsky, L. Fei-Fei, K. Grauman et al. , 'Crowdsourcing in computer vision,' Foundations and Trends R © in Computer Graphics and Vision , vol. 10, no. 3, pp. 177-243, 2016. 8 -
  69. [79][79] H. Su, J. Deng, and L. Fei-Fei, 'Crowdsourcing annotations for visual object detection,' in Workshops at the Twenty-Sixth AAAI Conference on Artificial Intelligence , vol. 1, no. 2, 2012. 8 -
  70. [81][81] G. Li, J. Wang, Y. Zheng, and M. J. Franklin, 'Crowdsourced data management: A survey,' IEEE Transactions on Knowledge and Data Engineering , vol. 28, no. 9, pp. 2296-2319, 2016. 8 -
  71. [83][83] Y. Wu, M. Schuster, Z. Chen, Q. V. Le, M. Norouzi, W. Macherey, M. Krikun, Y. Cao, Q. Gao, K. Macherey et al. , 'Google's neural machine translation system: Bridging the gap between human and machine translation,' arXiv preprint arXiv:1609.08144 , 2016. 9 - · arXiv
  72. [82][82] P. Wang, R. Yang, B. Cao, W. Xu, and Y. Lin, 'Dels-3d: Deep localization and segmentation with a 3d semantic map,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2018, pp. 5860-5869. 9 -
  73. [84][84] R. E. Kalman et al. , 'A new approach to linear filtering and prediction problems,' Journal of basic Engineering , vol. 82, no. 1, pp. 35-45, 1960. 9, 12 -
  74. [86][86] D. Eigen and R. Fergus, 'Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture,' in Proceedings of the IEEE International Conference on Computer Vision , 2015, pp. 2650-2658. 10 -
  75. [85][85] T. Pohlen, A. Hermans, M. Mathias, and B. Leibe, 'Full-resolution residual networks for semantic segmentation in street scenes,' Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2017. 10 -
  76. [87][87] B.-H. Lee, J.-H. Song, J.-H. Im, S.-H. Im, M.-B. Heo, and G.-I. Jee, 'Gps/dr error estimation for autonomous vehicle localization,' Sensors , vol. 15, no. 8, pp. 20 779-20 798, 2015. 11 -
  77. [89][89] T. Chen, M. Li, Y. Li, M. Lin, N. Wang, M. Wang, T. Xiao, B. Xu, C. Zhang, and Z. Zhang, 'Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems,' CoRR , vol. abs/1512.01274, 2015. 11 - · arXiv
  78. [90][90] R. Mur-Artal, J. M. M. Montiel, and J. D. Tardos, 'Orb-slam: a versatile and accurate monocular slam system,' IEEE transactions on robotics , vol. 31, no. 5, pp. 1147-1163, 2015. 11 -
  79. [91][91] B. Hariharan, P. Arbel´ aez, R. Girshick, and J. Malik, 'Simultaneous detection and segmentation,' in European Conference on Computer Vision . Springer, 2014, pp. 297-312. 12 -
  80. [93][93] S. Liu, L. Qi, H. Qin, J. Shi, and J. Jia, 'Path aggregation network for instance segmentation,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2018, pp. 8759-8768. 13, 14 -
  81. [95][95] Smart Vision SG, 'Wad instance segmentation 2nd place,' https://github.com/Computational-Camera/ Kaggle-CVPR-2018-WAD-Video-Segmentation-Challenge-Solution, 2018. 14 -
  82. [98][98] Y. Ma, X. Zhu, S. Zhang, R. Yang, W. Wang, and D. Manocha, 'Trafficpredict: Trajectory prediction for heterogeneous traffic-agents,' AAAI , 2019. 14 -
  83. [97][97] L. Liu, H. Li, and Y. Dai, 'Deep stochastic attraction and repulsion embedding for image based localization,' arXiv preprint arXiv:1808.08779 , 2018. 14 <!-- image --> <!-- image --> <!-- image --> <!-- image --> Xinyu Huang is currently a senior research scientist at Baidu Research and an associate professor at the North Carolina Central University. He obtained his Ph.D. degree from the University of Kentucky and B.S. degree from Huazhong University of Science and Technology. His research areas include computer vision, image processing, pattern recognition, and machine learning. Peng Wang is a senior research scientist in Baidu USA LLC. He obtained his Ph.D. degree in University of California, Los Angeles, advised by Prof. Alan Yuille. Before that, he received his B.S. and M.S. from Peking University, China. His research interest is image parsing and 3D understanding, and vision based autonomous driving system. He has around 30 published papers in ECCV/CVPR/ICCV/NIPS. Xinjing Cheng is a research scientist with Robotics and Autonomous Driving Lab, Baidu Research, Baidu Inc., Beijing, China. Before that, he was a research assistant with the Intelligent Bionic Center, Shenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Sciences(CAS), Shenzhen, China. His current research interests include computer vision, deep learning, robotics and autonomous driving. Dingfu Zhou a senior researcher at Robotics and Autonomous Driving Laboratory (RAL) of Baidu. Before joining in Baidu, he worked as a PostDoc Researcher in the Research School of Engineering at the Australian National University, Canberra, Australia. He obtained his Ph.D degree in System and Control from Sorbonne Universit´ es, Universit´ e de Technologie de Compi` egne, Compi` egne, France, in 2014. He received the B.E. degree and M.E degree both in signal and information processing from North- western Polytechnical University, Xian, China. His research interests include Simultaneous Localization and Mapping, Structure from Motion, Classification and their application in Autonomous Driving. <!-- image --> 品 Qichuan Geng is a Ph.D. candidate, at State Key Lab of Virtual Reality Technology and Systems, Beihang University, Beijing, China. He received his B.S. degree from Beihang University in 2012. His main research interests include computer vision, semantic segmentation and scene geometry recovery. <!-- image --> Ruigang Yang is the chief scientist for 3D vision at Baidu. He is also a full professor at the University of Kentucky (on leave). His research interests include 3D computer vision and 3D computer graphics, in particular 3D modeling and 3D data analysis. He has published over 100 papers with an H-index of 48. He is an Associate Editor for IEEE T-PAMI. He has been a program cochair for 3DIMPVT (now 3DV) 2011 and WACV 2014, and he has been area chairs for both ICCV and CVPR multiple times. · arXiv

Cited by

Sorted by citations

Authors
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R.
Affiliations
Baidu (China) (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2018
Volume
42
Issue
10
Pages
2702-2719
ISSN
0162-8828 (ISSN-L)
DOI
10.48550/arxiv.1803.06184
arXiv
1803.06184
OpenAlex
W2892614179
Cited by
615
References
0
Citations by year
2026: 42 · 2025: 77 · 2024: 115 · 2023: 112 · 2022: 107 · 2021: 83 · 2020: 62 · 2019: 15 · 2018: 2
FWCI
30.46
Type
journal article
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
Keywords
autonomous driving, semantic segmentation, instance segmentation, 3D mapping, self-localization, sensor fusion, GPS/IMU, multi-task learning, driving scene understanding

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review