An Empirical Evaluation of Deep Learning on Highway Driving
Open accessAbstract
Numerous groups have applied a variety of deep learning techniques to computer vision problems in highway perception scenarios. In this paper, we presented a number of empirical evaluations of recent deep learning advances. Computer vision, combined with deep learning, has the potential to bring about a relatively inexpensive, robust solution to autonomous driving. To prepare deep learning for industry uptake and practical applications, neural networks will require large data sets that represent all possible driving environments and scenarios. We collect a large data set of highway data and apply deep learning and computer vision algorithms to problems such as car and lane detection. We show how existing convolutional neural networks (CNNs) can be used to perform lane and vehicle detection while running at frame rates required for a real-time system. Our results lend credence to the hypothesis that deep learning holds promise for autonomous driving.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Tracking in monocular images was achieved in real-time through a CNN-based method.
“Tracking in monocular images was achieved in real-time through a CNN-based method [194], [195].”
From A Survey of Autonomous Driving: <i>Common Practices and Emerging Technologies</i> (2020) · cites this paper as [195]
Section III (p. 2) describes a CNN-based vehicle detection system designed for real-time operation, and the Conclusion (p. 7) reports that it ran at 44 Hz. The paper reports detection in individual images, not tracking objects across frames; it identifies the use of temporal information across frames as future work. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · see citing works
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853 · see citing works
Flagged first, then by citations
Research works printed but not linked: 17
- [1][1] Sermanet, Pierre, et al. 'Overfeat: Integrated recognition, localization and detection using convolutional networks.' arXiv preprint arXiv:1312.6229 (2013). - · arXiv
- [2][2] Rothengatter, Talib Ed, and Enrique Carbonell Ed Vaya. 'Traffic and transport psychology: Theory and application.' International Conference of Traffic and Transport Psychology, May, 1996, Valencia, Spain. Pergamon/Elsevier Science Inc, 1997. -
- [3][3] Cho, Hyunggi, et al. 'A multi-sensor fusion system for moving object detection and tracking in urban driving environments.' Robotics and Automation (ICRA), 2014 IEEE International Conference on. IEEE, 2014. -
- [4][4] Held, David, Jesse Levinson, and Sebastian Thrun. 'A probabilistic framework for car detection in images using context and scale.' Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 2012. -
- [5][5] Levinson, Jesse, et al. 'Towards fully autonomous driving: systems and algorithms.' Intelligent Vehicles Symposium, 2011. -
- [6][6] Caraffi, Claudio, et al. 'A system for real-time detection and tracking of vehicles from a single car-mounted camera.' Intelligent Transportation Systems (ITSC), 2012 15th International IEEE Conference on. IEEE, 2012. -
- [7][7] Jazayeri, Amirali, et al. 'Vehicle detection and tracking in car video based on motion model.' Intelligent Transportation Systems, IEEE Transactions on 12.2 (2011): 583-595. -
- [8][8] Bradski, Gary. 'The opencv library.' Doctor Dobbs Journal 25.11 (2000): 120-126. -
- [10][10] Szegedy, Christian, Alexander Toshev, and Dumitru Erhan. 'Deep neural networks for object detection.' Advances in Neural Information Processing Systems. 2013. -
- [11][11] Sutskever, Ilya, et al. 'On the importance of initialization and momentum in deep learning.' Proceedings of the 30th International Conference on Machine Learning (ICML-13). 2013. -
- [12][12] Eigen, David, Christian Puhrsch, and Rob Fergus. 'Depth map prediction from a single image using a multi-scale deep network.' Advances in Neural Information Processing Systems. 2014. -
- [14][14] Szegedy, Christian, et al. 'Scalable, High-Quality Object Detection.' arXiv preprint arXiv:1412.1441 (2014). - · arXiv
- [15][15] Girshick, Ross, et al. 'Rich feature hierarchies for accurate object detection and semantic segmentation.' Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on. IEEE, 2014. -
- [16][16] Uijlings, Jasper RR, et al. 'Selective search for object recognition.' International journal of computer vision 104.2 (2013): 154-171. -
- [17][17] Szegedy, Christian, et al. 'Going deeper with convolutions.' arXiv preprint arXiv:1409.4842 (2014). - · arXiv
- [19][19] Simonyan, Karen, and Andrew Zisserman. 'Very deep convolutional networks for large-scale image recognition.' arXiv preprint arXiv:1409.1556 (2014). - · arXiv
- [20][20] Jia, Yangqing, et al. 'Caffe: Convolutional architecture for fast feature embedding.' Proceedings of the ACM International Conference on Multimedia. ACM, 2014.
Cited by
Sorted by citations
A Survey of Autonomous Driving: <i>Common Practices and Emerging Technologies</i>
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889 · see citing works
“Tracking in monocular images was achieved in real-time through a CNN-based method [191], [192].”
MethodDeep Reinforcement Learning framework for Autonomous Driving
Sallab, A. E., Abdou, M., Perot, E., & Yogamani, S. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.19.avm-023 · Cited by 1,045 · see citing works
End-to-End People Detection in Crowded Scenes
Stewart, R., Andriluka, M., & Ng, A. Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.255 · Cited by 539 · see citing works
Self-citationDeng, Y., Xia, C. S., Peng, H., Yang, C., & Zhang, L. (2023) · Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3597926.3598067 · Cited by 326 · see citing works
Pre-trained convolutional neural networks as feature extractors for tuberculosis detection
Lopes, U. K., & Valiati, J. F. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.08.001 · Cited by 294 · see citing works
End-to-End Learning of Driving Models with Surround-View Cameras and Route Planners
Hecker, S., Dai, D., & Van Gool, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_27 · Cited by 191 · see citing works
Deep learning in the automotive industry: Applications and tools
Luckow, A., Cook, M., Ashcraft, N., Weill, E., Djerekarov, E., & Vorster, B. (2016) · 2016 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2016.7841045 · Cited by 164 · see citing works
Fortelny, N., & Bock, C. (2020) · Genome Biology · doi:10.1186/s13059-020-02100-5 · Cited by 135 · see citing works
Hierarchical Recurrent Attention Networks for Structured Online Maps
Homayounfar, N., Ma, W.-C., Lakshmikanth, S. K., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00360 · Cited by 71 · see citing works
- Authors
- Huval, B., Wang, T., Tandon, S., Kiske, J., Song, W., Pazhayampallil, J., Andriluka, M., Rajpurkar, P., Migimatsu, T., Cheng-Yue, R., Mujica, F., Coates, A., & Ng, A. Y.
- Affiliations
- Baidu (China) (CN)
- Stanford University (US)
- Twitter (United States) (US)
- Texas Instruments (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1504.01716
- OpenAlex
- W1585377561
- Cited by
- 537
- References
- 3
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 54 · 2023: 29 · 2022: 32 · 2021: 61 · 2020: 89 · 2019: 100 · 2018: 82 · 2017: 52 · 2016: 23 · 2015: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- highway driving, autonomous driving, lane detection, vehicle detection, convolutional neural networks, real-time object detection, computer vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
