The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Cross-modality interactive attention network for multispectral pedestrian detection
Open accessAbstract
Abstract Multispectral pedestrian detection is an emerging solution with great promise in many around-the-clock applications, such as automotive driving and security surveillance. To exploit the complementary nature and remedy contradictory appearance between modalities, in this paper, we propose a novel cross-modality interactive attention network that takes full advantage of the interactive properties of multispectral input sources. Specifically, we first utilize the color (RGB) and thermal streams to build up two detached feature hierarchy for each modality, then by taking the global features, correlations between two modalities are encoded in the attention module. Next, the channel responses of halfway feature maps are recalibrated adaptively for subsequent fusion operation. Our architecture is constructed in the multi-scale format to better deal with different scales of pedestrians, and the whole network is trained in an end-to-end way. The proposed method is extensively evaluated on the challenging KAIST multispectral pedestrian dataset and achieves state-of-the-art performance with high efficiency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
(2016) · Cited by 31,590
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
(2010) · Cited by 14,134
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Path Aggregation Network for Instance Segmentation
Liu, S., Qi, L., Qin, H., Shi, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00913 · Cited by 10,011
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2017) · doi:10.1109/cvpr35066.2017 · Cited by 7,141
2009 IEEE Conference on Computer Vision and Pattern Recognition
(2009) · doi:10.1109/cvpr14067.2009 · Cited by 5,550
Pedestrian Detection: An Evaluation of the State of the Art
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.155 · Cited by 3,190
R-FCN: Object Detection via Region-based Fully Convolutional Networks
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 3,149
(2011) · Cited by 2,752
Fast Feature Pyramids for Object Detection
Dollar, P., Appel, R., Belongie, S., & Perona, P. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2300479 · Cited by 1,955
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Single-Shot Refinement Neural Network for Object Detection
Zhang, S., Wen, L., Bian, X., Lei, Z., & Li, S. Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00442 · Cited by 1,678
Self-citationProceedings of the 29th International Conference on Machine Learning (ICML-12)
Langford, J. C., & Pineau, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4676 · Cited by 1,618
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
Luo, W., Li, Y., Urtasun, R., & Zemel, R. (2017) · arXiv · doi:10.48550/arxiv.1701.04128 · Cited by 1,575
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2016) · doi:10.1109/cvpr33180.2016 · Cited by 1,534
Context Encoding for Semantic Segmentation
Zhang, H., Dana, K., Shi, J., Zhang, Z., Wang, X., Tyagi, A., & Agrawal, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00747 · Cited by 1,464
Pedestrian detection: A benchmark
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206631 · Cited by 1,313
Multimodal fusion for multimedia analysis: a survey
Atrey, P. K., Hossain, M. A., El Saddik, A., & Kankanhalli, M. S. (2010) · Multimedia Systems · doi:10.1007/s00530-010-0182-0 · Cited by 1,279
Multispectral pedestrian detection: Benchmark dataset and baseline
Hwang, S., Park, J., Kim, N., Choi, Y., & Kweon, I. S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298706 · Cited by 1,249
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06228 · Cited by 1,246
Dollar, P., Tu, Z., Perona, P., & Belongie, S. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.91 · Cited by 1,237
ParseNet: Looking Wider to See Better
Liu, W., Rabinovich, A., & Berg, A. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04579 · Cited by 941
HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection
Kong, T., Yao, A., Chen, Y., & Sun, F. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.98 · Cited by 934
Is Faster R-CNN Doing Well for Pedestrian Detection?
Zhang, L., Lin, L., Liang, X., & He, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_28 · Cited by 852
Self-citationS^3FD: Single Shot Scale-Invariant Face Detector
Zhang, S., Zhu, X., Lei, Z., Shi, H., Wang, X., & Li, S. Z. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.30 · Cited by 653
Self-citationMultispectral Deep Neural Networks for Pedestrian Detection
Liu, J., Zhang, S., Wang, S., & Metaxas, D. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.73 · Cited by 543
Self-citationDiagnosing Error in Object Detectors
Hoiem, D., Chodpathumwan, Y., & Dai, Q. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_25 · Cited by 520
Computer Vision (ICCV), 2011 IEEE International Conference on
Vezhnevets, A. S., Ferrari, V., & Buhmann, J. M. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 477
How Far are We from Solving Pedestrian Detection?
Zhang, S., Benenson, R., Omran, M., Hosang, J., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.141 · Cited by 454
Self-citationComputer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on
Ferrari, V., Marín-Jiménez, M. J., & Zisserman, A. (2008) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 397
Filtered channel features for pedestrian detection
Zhang, S., Benenson, R., & Schiele, B. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298784 · Cited by 395
Self-citationLocal Decorrelation for Improved Pedestrian Detection
Nam, W., Stradvision Inc, & Han, J. H. (2015) · Cited by 336
Automatic gait recognition based on statistical shape analysis
Wang, L., Tan, T., Hu, W., & Ning, H. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.815251 · Cited by 334
What Can Help Pedestrian Detection?
Mao, J., Xiao, T., Jiang, Y., & Cao, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.639 · Cited by 306
CoupleNet: Coupling Global Structure with Local Parts for Object Detection
Zhu, Y., Zhao, C., Wang, J., Zhao, X., Wu, Y., & Lu, H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.444 · Cited by 304
Convolutional Channel Features
Yang, B., Yan, J., Lei, Z., & Li, S. Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.18 · Cited by 301
Fully Convolutional Region Proposal Networks for Multispectral Person Detection
Konig, D., Adam, M., Jarvers, C., Layher, G., Neumann, H., & Teutsch, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.36 · Cited by 287
Girshick, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.08083 · Cited by 276
Multispectral Pedestrian Detection using Deep Fusion Convolutional Neural Networks.
Wagner, J., Fischer, V., Herman, M., & Behnke, S. (2016) · The European Symposium on Artificial Neural Networks · Cited by 244
Learning Cross-Modal Deep Representations for Robust Pedestrian Detection
Xu, D., Ouyang, W., Ricci, E., Wang, X., & Sebe, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.451 · Cited by 237
Multiscale Fusion of Visible and Thermal IR Images for Illumination-Invariant Face Recognition
Kong, S. G., Heo, J., Boughorbel, F., Zheng, Y., Abidi, B. R., Koschan, A., Yi, M., & Abidi, M. A. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-6655-0 · Cited by 218
Scene-Specific Pedestrian Detection for Static Video Surveillance
Wang, X., Wang, M., & Li, W. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.124 · Cited by 157
Ocular biometrics: A survey of modalities and fusion approaches
Nigam, I., Mayank Vatsa, A., & Singh, R. (2015) · Information Fusion · doi:10.1016/j.inffus.2015.03.005 · Cited by 139
Learning Bidirectional Temporal Cues for Video-Based Person Re-Identification
Zhang, W., Yu, X., & He, X. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2718188 · Cited by 114
Video-Based Pedestrian Re-Identification by Adaptive Spatio-Temporal Appearance Model
Zhang, W., Ma, B., Liu, K., & Huang, R. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2672440 · Cited by 73
Multimodal data fusion for sensitive scene localization
Moreira, D., Avila, S., Pérez, M., Moraes, D., Testoni, V., Junior, E. A. D. V., Goldenstein, S. K., & Rocha, A. D. R. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.03.001 · Cited by 33
Cited by
Drone-Based RGB-Infrared Cross-Modality Vehicle Detection Via Uncertainty-Aware Learning
Sun, Y., Cao, B., Zhu, P., & Hu, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3168279 · Cited by 693
ICAFusion: Iterative cross-attention guided feature fusion for multispectral object detection
Shen, J., Chen, Y., Liu, Y., Zuo, X., Fan, H., & Yang, W. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2023.109913 · Cited by 544
Big data and IoT-based applications in smart environments: A systematic review
Hajjaji, Y., Boulila, W., Farah, I. R., Romdhani, I., & Hussain, A. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2020.100318 · Cited by 383
Self-citationCross-modality attentive feature fusion for object detection in multispectral remote sensing imagery
Qingyun, F., & Zhaokui, W. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108786 · Cited by 303
Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problems
Zhou, K., Chen, L., & Cao, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58523-5_46 · Cited by 301
Metadata
- Authors
- Zhang, L., Liu, Z., Zhang, S., Yang, X., Qiao, H., Huang, K., & Hussain, A.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2019-10
- Volume
- 50
- Pages
- 20-29
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2929607865
- Cited by
- 320
- References
- 54
- FWCI
- 4.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.