The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Pedestrian Detection at Day/Night Time with Visible and FIR Cameras: A Comparison
Open accessAbstract
Despite all the significant advances in pedestrian detection brought by computer vision for driving assistance, it is still a challenging problem. One reason is the extremely varying lighting conditions under which such a detector should operate, namely day and nighttime. Recent research has shown that the combination of visible and non-visible imaging modalities may increase detection accuracy, where the infrared spectrum plays a critical role. The goal of this paper is to assess the accuracy gain of different pedestrian models (holistic, part-based, patch-based) when training with images in the far infrared spectrum. Specifically, we want to compare detection accuracy on test images recorded at day and nighttime if trained (and tested) using (a) plain color images; (b) just infrared images; and (c) both of them. In order to obtain results for the last item, we propose an early fusion approach to combine features from both modalities. We base the evaluation on a new dataset that we have built for this purpose as well as on the publicly available KAIST multispectral dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Pedestrian Detection: An Evaluation of the State of the Art
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.155 · Cited by 3,190
An HOG-LBP human detector with partial occlusion handling
Wang, X., Han, T. X., & Yan, S. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459207 · Cited by 1,727
Multispectral pedestrian detection: Benchmark dataset and baseline
Hwang, S., Park, J., Kim, N., Choi, Y., & Kweon, I. S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298706 · Cited by 1,249
Dollar, P., Tu, Z., Perona, P., & Belongie, S. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.91 · Cited by 1,237
Monocular Pedestrian Detection: Survey and Experiments
Enzweiler, M., & Gavrila, D. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.260 · Cited by 1,213 · cited 1×
“It is worth mentioning also that, although for stereo-based systems it is possible to use a scene-based generation of candidate windows to be classified [1,2], in this paper, the visible and FIR modalities are treated as monocular systems regarding candidate generation.”
Background
Cited by
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
LLVIP: A Visible-infrared Paired Dataset for Low-light Vision
Jia, X., Zhu, C., Li, M., Tang, W., & Zhou, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00389 · Cited by 896
Illumination-aware faster R-CNN for robust multispectral pedestrian detection
Li, C., Song, D., Tong, R., & Tang, M. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.005 · Cited by 533
Dual-band infrared imaging using stacked colloidal quantum dot photodiodes
Tang, X., Ackerman, M. M., Chen, M., & Guyot-Sionnest, P. (2019) · Nature Photonics · doi:10.1038/s41566-019-0362-1 · Cited by 520
A Systematic Review of Perception System and Simulators for Autonomous Vehicles Research
Rosique, F., Navarro, P. J., Fernández, C., & Padilla, A. (2019) · Sensors · doi:10.3390/s19030648 · Cited by 469
Visible and Infrared Image Fusion Using Deep Learning
Zhang, X., & Demiris, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261282 · Cited by 392
An Overview of Autonomous Vehicles Sensors and Their Vulnerability to Weather Conditions
Vargas, J., Alsweiss, S., Toker, O., Razdan, R., & Santos, J. (2021) · Sensors · doi:10.3390/s21165397 · Cited by 354
Guan, D., Cao, Y., Yang, J., Cao, Y., & Yang, M. Y. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.017 · Cited by 342
Multimodal end-to-end autonomous driving
Xiao, Y., Codevilla, F., Gurram, A., Urfalioglu, O., & Lopez, A. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3013234 · Cited by 319
Thermal Object Detection in Difficult Weather Conditions Using YOLO
Kristo, M., Ivasic-Kos, M., & Pobar, M. (2020) · IEEE Access · doi:10.1109/access.2020.3007481 · Cited by 309
Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problems
Zhou, K., Chen, L., & Cao, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58523-5_46 · Cited by 301
A survey of infrared and visual image fusion methods
Jin, X., Jiang, Q., Yao, S., Zhou, D., Nie, R., Hai, J., & He, K. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.010 · Cited by 280
Weakly Aligned Cross-Modal Learning for Multispectral Pedestrian Detection
Zhang, L., Zhu, X., Chen, X., Yang, X., Lei, Z., & Liu, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00523 · Cited by 271
Pedestrian Detection in Severe Weather Conditions
Tumas, P., Nowosielski, A., & Serackis, A. (2020) · IEEE Access · doi:10.1109/access.2020.2982539 · Cited by 100
Kim, J., Hong, H., & Park, K. (2017) · Sensors · doi:10.3390/s17051065 · Cited by 78
“In addition, in order to evaluate the human detection performance in nighttime images captured with a moving camera rather than a fixed camera, we used the KAIST [61] and CVC-14 databases [62] as shown in”
MethodPedestrian detection in poor weather conditions using moving camera
Jegham, I., & Ben Khalifa, A. (2017) · 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa.2017.35 · Cited by 34
Improving single-stage object detectors for nighttime pedestrian detection
Devi, S., Thopalli, K., Malarvezhi, P., & Thiagarajan, J. J. (2022) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001422500343 · Cited by 15
Guo, J., Kurup, U., & Shah, M. (2018) · arXiv · doi:10.48550/arxiv.1811.11277 · Cited by 14
“However, nighttime pedestrian detection is much harder and more often additional thermal or far infrared data is needed for accurate detection [40], [41].”
BackgroundChoi, W., Jang, B., Jung, I., Sung, H., & Jang, Y. (2023) · Applied Sciences · doi:10.3390/app132011591 · Cited by 5
Metadata
- Authors
- González, A., Fang, Z., Socarras, Y., Serrat, J., Vázquez, D., Xu, J., & López, A.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2016-06-04
- Volume
- 16
- Issue
- 6
- Pages
- 820
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2415234561
- Cited by
- 322
- References
- 40
- FWCI
- 16.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.