How Much Position Information Do Convolutional Neural Networks Encode?
Open accessAbstract
In contrast to fully connected networks, Convolutional Neural Networks (CNNs) achieve efficiency by learning weights associated with local filters with a finite spatial extent. An implication of this is that a filter may know what it is looking at, but not where it is positioned in the image. Information concerning absolute position is inherently useful, and it is reasonable to assume that deep CNNs may implicitly learn to encode this information if there is a means to do so. In this paper, we test this hypothesis revealing the surprising degree of absolute position information that is encoded in commonly used neural networks. A comprehensive set of experiments show the validity of this hypothesis and shed light on how and where this information is represented while offering clues to where positional information is derived from in deep CNNs.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Relative positional encodings cannot work equally well as absolute ones because image recognition requires absolute position information.
“Last but not least, the relative positional encodings cannot work equally well as the absolute ones, because the image recognition task still requires absolute position information (Islam et al., 2020), which the relative positional encodings fail to provide.”
From Conditional Positional Encodings for Vision Transformers (2021) · cites this paper as Islam et al., 2020
The Introduction (p. 1) says absolute spatial information is important in position-dependent tasks, such as semantic segmentation and salient object detection. It does not establish that image recognition generally requires absolute position information, or compare the performance of relative and absolute positional encodings. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 56,035 · see citing works
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · see citing works
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392 · see citing works
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works
(2010) · Cited by 14,134 · see citing works
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542 · see citing works
The mythos of model interpretability
Lipton, Z. C. (2018) · Communications of the ACM · doi:10.1145/3233231 · Cited by 5,427 · see citing works
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422 · see citing works
Dynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167 · see citing works
Global contrast based salient region detection
Cheng, M., Zhang, G., Mitra, N. J., Huang, X., & Hu, S. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995344 · Cited by 3,072 · see citing works
Understanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838 · see citing works
The Secrets of Salient Object Segmentation
Li, Y., Hou, X., Christof Koch, A., Rehg, J. M., & Yuille, A. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.43 · Cited by 1,401 · see citing works
Learning to Detect Salient Objects with Image-Level Supervision
Wang, L., Lu, H., Wang, Y., Feng, M., Wang, D., Yin, B., & Ruan, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.404 · Cited by 1,329 · see citing works
Adaptive deconvolutional networks for mid and high level feature learning
Zeiler, M. D., Taylor, G. W., & Fergus, R. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126474 · Cited by 1,265 · see citing works
Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detection
Zhang, P., Wang, D., Lu, H., Wang, H., & Ruan, X. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.31 · Cited by 913 · see citing works
Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2851672 · Cited by 583 · see citing works
Deep convolutional networks do not classify based on global object shape
Baker, N., Lu, H., Erlikhman, G., & Kellman, P. J. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006613 · Cited by 346 · see citing works
ReNet: A Recurrent Neural Network Based Alternative to Convolutional NetworksPreprint
Visin, F., Kastner, K., Cho, K., Matteucci, M., Courville, A. C., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00393 · Cited by 258 · see citing works
EML-NET: An Expandable Multi-Layer NETwork for saliency prediction
Jia, S., & Bruce, N. D. B. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.103887 · Cited by 170 · see citing works
Self-citationUnsupervised Discovery of Nonlinear Structure Using Contrastive Backpropagation
Hinton, G. E., Osindero, S., Welling, M., & Teh, Y. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_76 · Cited by 132 · see citing works
Liu, N., & Han, J. (2017) · arXiv (Cornell University) · Cited by 5 · see citing works
Flagged first, then by citations
1 of the 25 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla. Segnet: A deep convolutional encoderdecoder architecture for scene segmentation. TPAMI , 2017.
- Md Amirul Islam, Mrigank Rochan, Neil DB Bruce, and Yang Wang. Gated feedback refinement network for dense image labeling. In CVPR , 2017.
- Md Amirul Islam, Mahmoud Kalash, and Neil DB Bruce. Revisiting salient object detection: Simultaneous detection, ranking, and subitizing of multiple salient objects. In CVPR , 2018.
- Sen Jia and Neil DB Bruce. Richer and deeper supervision network for salient object detection. arXiv preprint arXiv:1901.02425 , 2019. · arXiv
- Nian Liu, Junwei Han, and Ming-Hsuan Yang. Picanet: Learning pixel-wise contextual attention for saliency detection. In CVPR , 2018.
- Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. Grad-cam: Visual explanations from deep networks via gradient-based localization. In ICCV , 2017.
Cited by
Sorted by citations
Pvt v2: Improved baselines with pyramid vision transformer
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0274-8 · Cited by 2,439 · see citing works
RoFormer: Enhanced transformer with rotary position embedding
Su, J., Ahmed, M., Lu, Y., Pan, S., Bo, W., & Liu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2023.127063 · Cited by 1,957 · see citing works
Lin, T., Wang, Y., Liu, X., & Qiu, X. (2022) · AI Open · doi:10.1016/j.aiopen.2022.10.001 · Cited by 1,422 · see citing works
Vision Transformers for Single Image Dehazing
Song, Y., He, Z., Qian, H., & Du, X. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3256763 · Cited by 1,248 · see citing works
Alias-Free Generative Adversarial NetworksPreprint
Karras, T., Aittala, M., Laine, S., Härkönen, E., Hellsten, J., Lehtinen, J., & Aila, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12423 · Cited by 1,226 · see citing works
CMT: Convolutional Neural Networks Meet Vision Transformers
Guo, J., Han, K., Wu, H., Tang, Y., Chen, X., Wang, Y., & Xu, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01186 · Cited by 1,005 · see citing works
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J. M., & Luo, P. (2021) · arXiv · doi:10.48550/arxiv.2105.15203 · Cited by 5,090 · see citing works
SOLO: Segmenting Objects by Locations
Wang, X., Kong, T., Shen, C., Jiang, Y., & Li, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_38 · Cited by 887 · see citing works
TS2Vec: Towards Universal Representation of Time Series
Yue, Z., Wang, Y., Duan, J., Yang, T., Huang, C., Tong, Y., & Xu, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20881 · Cited by 850 · see citing works
MISSFormer: An Effective Transformer for 2D Medical Image Segmentation
Huang, X., Deng, Z., Li, D., Yuan, X., & Fu, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3230943 · Cited by 606 · see citing works
A Survey of Visual Transformers
Liu, Y., Zhang, Y., Wang, Y., Hou, F., Yuan, J. S., Tian, J., Zhang, Y. S., Shi, Z., Jianping Fan, B., & He, Z. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3227717 · Cited by 614 · see citing works
EMCAD: Efficient Multi-Scale Convolutional Attention Decoding for Medical Image Segmentation
Rahman, M. M., Munir, M., & Marculescu, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01118 · Cited by 568 · see citing works
Machine Learning Methods for Small Data Challenges in Molecular Science
Dou, B., Zhu, Z., Merkurjev, E., Ke, L., Chen, L., Jian, J., Zhu, Y., Liu, J., Zhang, B., & Wei, G. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00189 · Cited by 522 · see citing works
SOLOv2: Dynamic and Fast Instance Segmentation
Wang, X., Zhang, R., Kong, T., Li, L., & Shen, C. (2020) · arXiv · doi:10.48550/arxiv.2003.10152 · Cited by 549 · see citing works
TransNeXt: Robust Foveal Visual Perception for Vision Transformers
Shi, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01683 · Cited by 452 · see citing works
TransPose: Keypoint Localization via Transformer
Yang, S., Quan, Z., Nie, M., & Yang, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01159 · Cited by 449 · see citing works
Medical Image Segmentation via Cascaded Attention Decoding
Rahman, M. M., & Mărculescu, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00616 · Cited by 429 · see citing works
StyTr 2 : Image Style Transfer with Transformers
Deng, Y., Tang, F., Dong, W., Ma, C., Pan, X., Wang, L., & Xu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01104 · Cited by 442 · see citing works
Conditional Positional Encodings for Vision Transformers
Chu, X., Tian, Z., Zhang, B., Wang, X., & Shen, C. (2021) · arXiv · doi:10.48550/arxiv.2102.10882 · Cited by 489 · see citing works
“However, the relative positional encoding cannot provide absolute position information , which is also important to the classification performance (Islam et al., 2020).”
BackgroundInfluentialMPViT: Multi-Path Vision Transformer for Dense Prediction
Lee, Y., Kim, J., Willette, J., & Hwang, S. J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00714 · Cited by 388 · see citing works
StyleSwin: Transformer-based GAN for High-resolution Image Generation
Zhang, B., Gu, S., Zhang, B., Bao, J., Chen, D., Wen, F., Wang, Y., & Guo, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01102 · Cited by 264 · see citing works
A Graph-Transformer for Whole Slide Image Classification
Zheng, Y., Gindra, R. H., Green, E. J., Burks, E. J., Betke, M., Beane, J. E., & Kolachalama, V. B. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3176598 · Cited by 255 · see citing works
Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding
Dong, Q., Cao, C., & Fu, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01107 · Cited by 224 · see citing works
Medical Image Segmentation using Squeeze-and-Expansion Transformers
Li, S., Sui, X., Luo, X., Xu, X., Liu, Y., & Goh, R. S. M. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/112 · Cited by 216 · see citing works
On Translation Invariance in CNNs: Convolutional Layers Can Exploit Absolute Spatial Location
Kayhan, O. S., & van Gemert, J. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01428 · Cited by 215 · see citing works
ResT: An Efficient Transformer for Visual RecognitionPreprint
Zhang, Q., & Yang, Y.-B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13677 · Cited by 214 · see citing works
Defect transformer: An efficient hybrid transformer architecture for surface defect detection
Wang, J., Xu, G., Yan, F., Wang, J., & Wang, Z. (2023) · Measurement · doi:10.1016/j.measurement.2023.112614 · Cited by 151 · see citing works
SegFormer3D: an Efficient Transformer for 3D Medical Image Segmentation
Perera, S. R., Navard, P., & Yılmaz, A. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00503 · Cited by 147 · see citing works
SOLO: A Simple Framework for Instance Segmentation
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3111116 · Cited by 131 · see citing works
G-CASCADE: Efficient Cascaded Graph Convolutional Decoding for 2D Medical Image Segmentation
Rahman, M. M., & Mărculescu, R. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00755 · Cited by 132 · see citing works
ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks
Saini, R., Jha, N. K., Das, B., Mittal, S., & Mohan, C. K. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093341 · Cited by 128 · see citing works
MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection
Dai, R., Das, S., Kahatapitiya, K., Ryoo, M. S., & Brémond, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01941 · Cited by 113 · see citing works
NHBS-Net: A Feature Fusion Attention Network for Ultrasound Neonatal Hip Bone Segmentation
Liu, R., Liu, M., Sheng, B., Li, H., Li, P., Song, H., Zhang, P., Jiang, L., & Shen, D. G. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3087857 · Cited by 106 · see citing works
MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation
Sarandi, I., Linder, T., Arras, K. O., & Leibe, B. (2020) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2020.3037257 · Cited by 106 · see citing works
ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks
Saini, R., Jha, N. K., Das, B. K., Mittal, S., & Mohan, C. K. (2020) · Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) · Cited by 89 · see citing works
MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation
Sárándi, I., Linder, T., Arras, K. O., & Leibe, B. (2021) · RWTH Publications (RWTH Aachen) · Cited by 88 · see citing works
Super-Resolution Neural Operator
Wei, M., & Zhang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01750 · Cited by 86 · see citing works
SST: Spatial and Semantic Transformers for Multi-Label Image Recognition
Chen, Z.-M., Cui, Q., Zhao, B., Song, R., Zhang, X., & Yoshie, O. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3148867 · Cited by 85 · see citing works
Positional Encoding as Spatial Inductive Bias in GANs
Xu, R., Wang, X., Chen, K., Zhou, B., & Loy, C. C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01336 · Cited by 81 · see citing works
Transformer Fusion and Pixel-Level Contrastive Learning for RGB-D Salient Object Detection
Wu, J., Hao, F., Liang, W., & Xu, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3275308 · Cited by 80 · see citing works
ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors
Cao, C., Dong, Q., & Fu, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3280222 · Cited by 78 · see citing works
Tian, Y., Wang, J., Wang, Y., Zhao, C., Yao, F., & Wang, X. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3197815 · Cited by 72 · see citing works
Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model
Zheng, Z., Ermon, S., Kim, D., Zhang, L., & Zhong, Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3475824 · Cited by 67 · see citing works
PiSLTRc: Position-Informed Sign Language Transformer With Content-Aware Convolution
Xie, P., Zhao, M., & Hu, X. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3109665 · Cited by 61 · see citing works
Truly shift-invariant convolutional neural networks
Chaman, A., & Dokmanić, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00377 · Cited by 58 · see citing works
Mind the Pad -- CNNs can Develop Blind SpotsPreprint
Alsallakh, B., Kokhlikyan, N., Miglani, V., Yuan, J., & Reblitz-Richardson, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02178 · Cited by 55 · see citing works
Chen, Y., Yang, J., Chen, B., & Du, S. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3208714 · Cited by 54 · see citing works
Yi, D., Ahmedov, H. B., Jiang, S., Li, Y., Flinn, S. J., & Fernandes, P. G. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127488 · Cited by 53 · see citing works
Vision transformer: To discover the “four secrets” of image patches
Zhou, T., Niu, Y., Lu, H., Peng, C., Guo, Y., & Zhou, H. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102248 · Cited by 52 · see citing works
JIANG, P., Xu, X., Tao, H., Zhao, L., & Zou, C. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3123979 · Cited by 49 · see citing works
Wang, J., Tang, S., Heap, M. J., Tang, C., & Tang, L.-H. (2021) · International Journal of Rock Mechanics and Mining Sciences · doi:10.1016/j.ijrmms.2021.104685 · Cited by 47 · see citing works
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning
Li, L.-L., Zhou, T.-F., Wang, W.-G., Yang, L., Li, J.-W., & Yang, Y. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52688.2022.00852 · Cited by 63 · see citing works
Zhou, H., Xu, Q., Nie, Z., & Li, N. (2021) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4051604 · Cited by 47 · see citing works
Chen, H., Lan, C., Song, J. H., Broni-Bediako, C., Xia, J., & Yokoya, N. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3410389 · Cited by 46 · see citing works
Viewpoint-Adaptive Representation Disentanglement Network for Change Captioning
Tu, Y., Li, L., Su, L., Du, J., Lü, K., & Huang, Q. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3268004 · Cited by 45 · see citing works
Learning Long-Range Relationships for Temporal Aircraft Anomaly Detection
Zhang, D., Gao, J., & Li, X. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3404360 · Cited by 44 · see citing works
Wang, L., Cao, M., & Yuan, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01772 · Cited by 43 · see citing works
Multi-scale local-temporal similarity fusion for continuous sign language recognition
Xie, P., Cui, Z. M., Du, Y., Zhao, M., Cui, J., Wang, B., & Hu, X. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109233 · Cited by 42 · see citing works
GreedyViG: Dynamic Axial Graph Construction for Efficient Vision GNNs
Munir, M., Avery, W., Rahman, M. M., & Mărculescu, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00585 · Cited by 43 · see citing works
Padding Module : Learning the Padding in Deep Neural Networks
Alrasheedi, F., Zhong, X. R., & Huang, P.-C. (2023) · IEEE Access · doi:10.1109/access.2023.3238315 · Cited by 44 · see citing works
Bello, J. L. G., & Kim, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00678 · Cited by 37 · see citing works
New Benchmark for Household Garbage Image Recognition
Wu, Z., Li, H., Wang, X., Wu, Z., Zou, L., Xu, L., & Tan, M. (2022) · Tsinghua Science & Technology · doi:10.26599/tst.2021.9010072 · Cited by 37 · see citing works
Exploring Geometric Consistency for Monocular 3D Object Detection
Lian, Q., Ye, B., Xu, R., Yao, W., & Zhang, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00173 · Cited by 37 · see citing works
Positional Attention Guided Transformer-Like Architecture for Visual Question Answering
Mao, A., Yang, Z. X., Lin, K., Xuan, J., & Liu, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3216770 · Cited by 37 · see citing works
PaCa-ViT: Learning Patch-to-Cluster Attention in Vision Transformers
Grainger, R., Paniagua, T., Song, X., Cuntoor, N. P., Lee, M. W., & Wu, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01781 · Cited by 37 · see citing works
Global Pooling, More than Meets the Eye: Position Information is Encoded Channel-Wise in CNNs
Islam, M. A., Kowal, M. D., Jia, S., Derpanis, K. G., & Bruce, N. D. B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00083 · Cited by 34 · see citing works
Self-citationAPT-Net: Adaptive encoding and parallel decoding transformer for medical image segmentation
Zhang, N., Yu, L., Zhang, D.-Z., Wu, W., Tian, S., & Kang, X. (2022) · Comput. Biol. Medicine · doi:10.1016/j.compbiomed.2022.106292 · Cited by 32 · see citing works
Multivariate time series classification with crucial timestamps guidance
Zhang, D., Gao, J., & Li, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124591 · Cited by 33 · see citing works
Zhu, S., Liao, B. Y., Hua, Y., Zhang, C., Wan, F., & Qing, X. (2022) · ISA Transactions · doi:10.1016/j.isatra.2022.07.016 · Cited by 33 · see citing works
(2021) · arXiv (Cornell University) · Cited by 31 · see citing works
OAFormer: Occlusion Aware Transformer for Camouflaged Object Detection
Yang, X., Zhu, H., Mao, G., & Xing, S. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00246 · Cited by 30 · see citing works
EAIS-Former: An efficient and accurate image segmentation method for fruit leaf diseases
Lu, J., Lu, B., Ma, W., & Sun, Y. S. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.108739 · Cited by 31 · see citing works
CSTA: CNN-based Spatiotemporal Attention for Video Summarization
Son, J., Park, J., & Kim, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01783 · Cited by 30 · see citing works
SOLO: Segmenting Objects by LocationsPreprint
Wang, X., Kong, T., Shen, C., Jiang, Y., & Li, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.04488 · Cited by 30 · see citing works
StegFormer: Rebuilding the Glory of Autoencoder-Based Steganography
Ke, X., Wu, H., & Guo, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.28051 · Cited by 29 · see citing works
Dynamically Pruning Segformer for Efficient Semantic Segmentation
Bai, H., Mao, H., & Nair, D. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747634 · Cited by 30 · see citing works
MXT: A New Variant of Pyramid Vision Transformer for Multi-label Chest X-ray Image Classification
Jiang, X., Zhu, Y. M., Cai, G., Zheng, B., & Yang, D. (2022) · Cognitive Computation · doi:10.1007/s12559-022-10032-4 · Cited by 29 · see citing works
Convolution Transformer Fusion Splicing Network for Hyperspectral Image Classification
Zhao, F., Li, S., Zhang, J., & Liu, H. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3231874 · Cited by 28 · see citing works
Distilling Inter-Class Distance for Semantic Segmentation
Zhang, Z., Zhou, C., & Tu, Z. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/235 · Cited by 28 · see citing works
Hybrid CNN-Transformer Architecture for Efficient Large-Scale Video Snapshot Compressive Imaging
Cao, M., Wang, L., Zhu, M., & Yuan, X. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02101-y · Cited by 26 · see citing works
Zheng, Z., Zhong, Y., Zhao, J. J., Ma, A., & Zhang, L. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.07.001 · Cited by 26 · see citing works
Global Transport for Fluid Reconstruction with Learned Self-Supervision
Franz, A., Solenthaler, B., & Thuerey, N. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00168 · Cited by 26 · see citing works
Wang, K., Xu, J., Zhang, S., Tan, J., & Qin, J. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.136168 · Cited by 26 · see citing works
Spatial–Temporal Enhanced Network for Continuous Sign Language Recognition
Yin, W., Hou, Y., Guo, Z., & Liu, K. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3296668 · Cited by 26 · see citing works
Convolution-Embedded Vision Transformer With Elastic Positional Encoding for Pansharpening
Wang, N., Meng, X., Meng, X., & Shao, F. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3227405 · Cited by 24 · see citing works
Deep-Learning-Based Morphological Feature Segmentation for Facial Skin Image Analysis
Yoon, H., Kim, S., Lee, J., & Yoo, S. (2023) · Diagnostics · doi:10.3390/diagnostics13111894 · Cited by 24 · see citing works
Zhao, R., Yu, J., Zhao, H., & Ngai, E. C. ‐. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610873 · Cited by 24 · see citing works
Zhuang, Y., Cheng, S. L., & Duraisamy, K. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.117623 · Cited by 22 · see citing works
Graph Neural Networks with Diverse Spectral Filtering
Guo, J., Huang, K., Yi, X., & Zhang, R. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583324 · Cited by 22 · see citing works
Luo, Z.-Q., Zhou, K., Tan, Y.-M., Wang, X.-L., Zhu, R., & Zhang, L.-Q. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3289583 · Cited by 24 · see citing works
Tiny Object Detection via Regional Cross Self-Attention Network
Cheng, K., Cui, H., Ghafoor, H. A., Wan, H., Mao, Q., & Zhan, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3232688 · Cited by 23 · see citing works
Automatic pixel-level detection of tire defects based on a lightweight Transformer architecture
Sun, Y., Liu, X., Zhai, X., Sun, K., Zhao, M., Chang, Y., & Zhang, Y. (2023) · Measurement Science and Technology · doi:10.1088/1361-6501/acd5f2 · Cited by 21 · see citing works
Air target intent recognition method combining graphing time series and diffusion models
Chenghai, L. I., Wang, K., Song, Y., Wang, P., & Li, L. (2024) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2024.08.008 · Cited by 21 · see citing works
DNA-T: Deformable Neighborhood Attention Transformer for Irregular Medical Time Series
Huang, J., Yang, B., Yin, K., & Xu, J. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3395446 · Cited by 20 · see citing works
GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation
He, X., Wandt, B., & Rhodin, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00129 · Cited by 20 · see citing works
Hierarchical ConViT with Attention-Based Relational Reasoner for Visual Analogical Reasoning
He, W., Zhang, J., Ren, J., Bai, R., & Jiang, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25072 · Cited by 19 · see citing works
WS-MTST: Weakly Supervised Multi-Label Brain Tumor Segmentation With Transformers
Chen, H., An, J., Jiang, B., Xia, L., Bai, Y., & Gao, Z. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3321602 · Cited by 21 · see citing works
Shift Equivariance in Object Detection
Manfredi, M., & Wang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65414-6_4 · Cited by 19 · see citing works
Transformer-Based High-Fidelity Facial Displacement Completion for Detailed 3D Face Reconstruction
Liu, R., Cheng, Y., Huang, S., Li, C., & Cheng, X. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3271816 · Cited by 18 · see citing works
Joint Learning of Token Context and Span Feature for Span-Based Nested NER
Sun, L. J., Sun, Y., Ji, F., & Wang, C. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3024944 · Cited by 18 · see citing works
- Authors
- Islam, M. A., Jia, S., & Bruce, N. D. B.
- Affiliations
- Toronto Metropolitan University (CA)
- Vector Institute (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2001.08248
- OpenAlex
- W2995426144
- Cited by
- 253
- References
- 25
- Citations by year
- 2026: 3 · 2025: 18 · 2024: 61 · 2023: 62 · 2022: 52 · 2021: 37 · 2020: 19 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- positional information, convolutional neural networks, spatial representation, local filters
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
