The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
YOLO-FIRI: Improved YOLOv5 for Infrared Image Object Detection
Open accessAbstract
To solve object detection issues in infrared images, such as a low recognition rate and a high false alarm rate caused by long distances, weak energy, and low resolution, we propose a region-free object detector named YOLO-FIR for infrared (IR) images with YOLOv5 core by compressing channels, optimizing parameters, etc. An improved infrared image object detection network, YOLO-FIRI, is further developed. Specifically, while designing the feature extraction network, the cross-stage-partial-connections (CSP) module in the shallow layer is expanded and iterated to maximize the use of shallow features. In addition, an improved attention module is introduced in residual blocks to focus on objects and suppress background. Moreover, multiscale detection is added to improve small object detection accuracy. Experimental results on the KAIST and FLIR datasets show that YOLO-FIRI demonstrates a qualitative improvement compared with the state-of-the-art detectors. Compared with YOLOv4, the mean average precision (mAP50) of YOLO-FIRI is increased by 21% on the KAIST dataset, the speed is reduced by 62%, the parameters are decreased by 89%, the weight size is reduced by more than 94%, and the computational costs are reduced by 84%. Compared with YOLO-FIR, YOLO-FIRI has an approximately 5% to 20% improvement in AP, AR (average recall), mAP50, F1, and mAP50:75. Furthermore, due to the shortcomings of high noise and weak features, image fusion can be applied to image preprocessing as a data enhancement method by fusing visible and infrared images based on a convolutional neural network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, A., Wang, C.-Y., & Liao, H.-Y. M. (2020) · arXiv · doi:10.48550/arxiv.2004.10934 · Cited by 10,307
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
Yun, S., Han, D., Chun, S., Oh, S. J., Yoo, Y., & Choe, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00612 · Cited by 5,400
Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression
Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., & Ren, D. (2019) · arXiv · doi:10.48550/arxiv.1911.08287 · Cited by 5,313
Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression
Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., & Ren, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6999 · Cited by 5,288
CSPNet: A New Backbone that can Enhance Learning Capability of CNN
Wang, C.-Y., Mark Liao, H.-Y., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W., & Yeh, I.-H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00203 · Cited by 5,265
Pedestrian Detection: An Evaluation of the State of the Art
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.155 · Cited by 3,190
Li, X., Wang, W., Hu, X., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00060 · Cited by 3,134
Improved regularization of convolutional neural networks with cutout
DeVries, T., & Taylor, G. W. (2017) · arXiv · doi:10.48550/arxiv.1708.04552 · Cited by 2,776
Jocher, G., Stoken, A., Borovec, J., NanoCode012, ChristopherSTAN, Changyu, L., Laughing, Hogan, A., Lorenzomammana, Tkianai, et al. (2020) · Zenodo · doi:10.5281/zenodo.3983579 · Cited by 2,738
ultralytics/yolov5: v4.0 - nn.SiLU() activations, Weights & Biases logging, PyTorch Hub integration
Jocher, G., Stoken, A., Borovec, J., NanoCode012, ChristopherSTAN, Changyu, L., Laughing, Tkianai, YxNONG, Hogan, A., et al. (2021) · Zenodo · doi:10.5281/zenodo.4418161 · Cited by 2,738
ultralytics/yolov5: Initial Release
Jocher, G., Stoken, A., Borovec, J., NanoCode012, ChristopherSTAN, Changyu, L., Laughing, Hogan, A., Lorenzomammana, Tkianai, et al. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3908559 · Cited by 2,731
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Soft-NMS — Improving Object Detection with One Line of Code
Bodla, N., Singh, B., Chellappa, R., & Davis, L. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.593 · Cited by 2,274 · cited 1×
“…of object detection, especially when objects are small and occluded, Y. Li et al. [44] developed a detector, YOLO-ACN, by introducing an attention module, CIoU (Complete Intersection over Union) [45], [46] loss, improved Soft-NMS (Non-Maximum Suppression) [47], and depthwise separable convolution.”
MethodEfficient Non-Maximum Suppression
Neubeck, A., & Van Gool, L. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.479 · Cited by 2,118
DenseFuse: A Fusion Approach to Infrared and Visible Images
Li, H., & Wu, X.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887342 · Cited by 2,032
Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction
Masci, J., Meier, U., Cireşan, D., & Schmidhuber, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_7 · Cited by 1,955
Single-Shot Refinement Neural Network for Object Detection
Zhang, S., Wen, L., Bian, X., Lei, Z., & Li, S. Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00442 · Cited by 1,678
Self-citationDSSD : Deconvolutional Single Shot Detector
Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., & Berg, A. C. (2017) · arXiv · doi:10.48550/arxiv.1701.06659 · Cited by 1,624
Sparse R-CNN: End-to-End Object Detection with Learnable Proposals
Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Li, L., Yuan, Z., Wang, C., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01422 · Cited by 1,617
Zheng, Z., Wang, P., Ren, D., Liu, W., Ye, R., Hu, Q., & Zuo, W. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3095305 · Cited by 1,552
Recent advances in deep learning for object detection
Wu, X., Sahoo, D., & Hoi, S. C. H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.085 · Cited by 1,047
PanNet: A Deep Network Architecture for Pan-Sharpening
Yang, J., Fu, X., Hu, Y., Huang, Y., Ding, X., & Paisley, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.193 · Cited by 802
(2015) · Cited by 656
Multispectral Deep Neural Networks for Pedestrian Detection
Liu, J., Zhang, S., Wang, S., & Metaxas, D. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.73 · Cited by 543
A tutorial on ν‐support vector machines
Chen, P., Lin, C., & Schölkopf, B. (2005) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.537 · Cited by 479
KAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving
Choi, Y., Kim, N., Hwang, S., Park, K., Yoon, J. S., An, K., & Kweon, I. S. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2791533 · Cited by 370
Thermal Object Detection in Difficult Weather Conditions Using YOLO
Kristo, M., Ivasic-Kos, M., & Pobar, M. (2020) · IEEE Access · doi:10.1109/access.2020.3007481 · Cited by 309
Learning Deep Embeddings with Histogram Loss
Ustinova, E., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00822 · Cited by 222
Kandlikar, S. G., Perez-Raya, I., Raghupathi, P. A., Gonzalez-Hernandez, J.-L., Dabydeen, D., Medeiros, L., & Phatak, P. (2017) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2017.01.086 · Cited by 208
KeepAugment: A Simple Information-Preserving Data Augmentation Approach
Gong, C., Wang, D., Li, M., Chandra, V., & Liu, Q. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00111 · Cited by 207
Self-citationMultispectral Pedestrian Detection via Simultaneous Detection and SegmentationPreprint
Li, C., Song, D., Tong, R., & Tang, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04818 · Cited by 195
TIRNet: Object detection in thermal infrared images for autonomous driving
Dai, X., Yuan, X., & Wei, X. (2021) · Applied Intelligence · doi:10.1007/s10489-020-01882-2 · Cited by 175
A Survey of Computer Vision Methods for 2D Object Detection from Unmanned Aerial Vehicles
Cazzato, D., Cimarelli, C., Sánchez-López, J. L., Voos, H., & Leo, M. (2020) · Journal of Imaging · doi:10.3390/jimaging6080078 · Cited by 172
YOLO-ACN: Focusing on Small Target and Occluded Object Detection
Li, Y., Li, S., Du, H., Chen, L., Zhang, D., & Li, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3046515 · Cited by 166
Self-citationBorrow From Anywhere: Pseudo Multi-Modal Object Detection in Thermal Imagery
Devaguptapu, C., Akolekar, N., Sharma, M. M., & Balasubramanian, V. N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00135 · Cited by 160
CNN-Based Person Detection Using Infrared Images for Night-Time Intrusion Warning Systems
Park, J., Chen, J., Cho, Y. K., Kang, D. Y., & Son, B.-J. (2019) · Sensors · doi:10.3390/s20010034 · Cited by 99
Pedestrian Detection in Thermal Images Using Saliency Maps
Ghose, D., Desai, S., Bhattacharya, S., Chakraborty, D., Fiterau, M., & Rahman, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00130 · Cited by 98
A novel infrared video surveillance system using deep learning based techniques
Zhang, H., Luo, C., Wang, Q., Kitchin, M. R., Parmley, A., Monge-Álvarez, J., & Casaseca‐de‐la‐Higuera, P. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-5883-y · Cited by 61
A multispectral feature fusion network for robust pedestrian detection
Song, X., Gao, S., & Chen, C. (2020) · Alexandria Engineering Journal · doi:10.1016/j.aej.2020.05.035 · Cited by 53
Every Feature Counts: An Improved One-Stage Detector in Thermal Imagery
Cao, Y., Zhou, T., Zhu, X., & Su, Y. L. (2019) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc47050.2019.9064036 · Cited by 45
Research of Infrared Small Pedestrian Target Detection Based on YOLOv3
张, 涛., 崔, 文., & 李, 慕. (2020) · Infrared Technoiogy · doi:10.3724/sp.j.7100931204 · Cited by 17
Efficient pedestrian detection with enhanced object segmentation in far IR night vision
Piniarski, K., & Pawłowski, P. (2017) · Signal Processing: Algorithms, Architectures, Arrangements, and Applications · doi:10.23919/spa.2017.8166857 · Cited by 13
(1996)
Cited by
Small-object detection based on YOLOv5 in autonomous driving systems
Mahaur, B., & Mishra, K. K. (2023) · Pattern Recognition Letters · doi:10.1016/j.patrec.2023.03.009 · Cited by 260
Dinh, H. T., & Kim, E.-T. (2025) · Electronics · doi:10.3390/electronics14040783 · Cited by 17
Metadata
- Authors
- Li, S., Li, Y., Li, Y., Li, M., & Xu, X.
- Venue
- IEEE Access
- Published
- 2021
- Volume
- 9
- Pages
- 141861-141875
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3206023204
- Cited by
- 300
- References
- 60
- FWCI
- 16.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.