The DOI matches its DataCite record; 25 of the 25 references it cites were found in a registry or an index.
How Much Position Information Do Convolutional Neural Networks Encode?
Open accessAbstract
In contrast to fully connected networks, Convolutional Neural Networks (CNNs) achieve efficiency by learning weights associated with local filters with a finite spatial extent. An implication of this is that a filter may know what it is looking at, but not where it is positioned in the image. Information concerning absolute position is inherently useful, and it is reasonable to assume that deep CNNs may implicitly learn to encode this information if there is a means to do so. In this paper, we test this hypothesis revealing the surprising degree of absolute position information that is encoded in commonly used neural networks. A comprehensive set of experiments show the validity of this hypothesis and shed light on how and where this information is represented while offering clues to where positional information is derived from in deep CNNs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Last but not least, the relative positional encodings cannot work equally well as the absolute ones, because the image recognition task still requires absolute position information (Islam et al., 2020), which the relative positional encodings fail to provide.”
From Conditional Positional Encodings for Vision Transformers (2021) · cites this paper as Islam et al., 2020
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
(2010) · Cited by 14,134
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Research works printed but not linked: 6
- Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla. Segnet: A deep convolutional encoderdecoder architecture for scene segmentation. TPAMI , 2017.
- Md Amirul Islam, Mrigank Rochan, Neil DB Bruce, and Yang Wang. Gated feedback refinement network for dense image labeling. In CVPR , 2017.
- Md Amirul Islam, Mahmoud Kalash, and Neil DB Bruce. Revisiting salient object detection: Simultaneous detection, ranking, and subitizing of multiple salient objects. In CVPR , 2018.
- Sen Jia and Neil DB Bruce. Richer and deeper supervision network for salient object detection. arXiv preprint arXiv:1901.02425 , 2019. · arXiv
- Nian Liu, Junwei Han, and Ming-Hsuan Yang. Picanet: Learning pixel-wise contextual attention for saliency detection. In CVPR , 2018.
- Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. Grad-cam: Visual explanations from deep networks via gradient-based localization. In ICCV , 2017.
Cited by
Sorted by citations
Pvt v2: Improved baselines with pyramid vision transformer
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0274-8 · Cited by 2,439
RoFormer: Enhanced transformer with rotary position embedding
Su, J., Ahmed, M., Lu, Y., Pan, S., Bo, W., & Liu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2023.127063 · Cited by 1,957
Lin, T., Wang, Y., Liu, X., & Qiu, X. (2022) · AI Open · doi:10.1016/j.aiopen.2022.10.001 · Cited by 1,422
Vision Transformers for Single Image Dehazing
Song, Y., He, Z., Qian, H., & Du, X. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3256763 · Cited by 1,317
Alias-Free Generative Adversarial NetworksPreprint
Karras, T., Aittala, M., Laine, S., Härkönen, E., Hellsten, J., Lehtinen, J., & Aila, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12423 · Cited by 1,302
CMT: Convolutional Neural Networks Meet Vision Transformers
Guo, J., Han, K., Wu, H., Tang, Y., Chen, X., Wang, Y., & Xu, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01186 · Cited by 1,005
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J. M., & Luo, P. (2021) · arXiv · doi:10.48550/arxiv.2105.15203 · Cited by 5,090
SOLO: Segmenting Objects by Locations
Wang, X., Kong, T., Shen, C., Jiang, Y., & Li, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_38 · Cited by 926
TS2Vec: Towards Universal Representation of Time Series
Yue, Z., Wang, Y., Duan, J., Yang, T., Huang, C., Tong, Y., & Xu, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20881 · Cited by 850
MISSFormer: An Effective Transformer for 2D Medical Image Segmentation
Huang, X., Deng, Z., Li, D., Yuan, X., & Fu, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3230943 · Cited by 949
A Survey of Visual Transformers
Liu, Y., Zhang, Y., Wang, Y., Hou, F., Yuan, J. S., Tian, J., Zhang, Y. S., Shi, Z., Jianping Fan, B., & He, Z. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3227717 · Cited by 652
EMCAD: Efficient Multi-Scale Convolutional Attention Decoding for Medical Image Segmentation
Rahman, M. M., Munir, M., & Marculescu, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01118 · Cited by 594
Machine Learning Methods for Small Data Challenges in Molecular Science
Dou, B., Zhu, Z., Merkurjev, E., Ke, L., Chen, L., Jian, J., Zhu, Y., Liu, J., Zhang, B., & Wei, G. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00189 · Cited by 548
Conditional Positional Encodings for Vision Transformers
Chu, X., Tian, Z., Zhang, B., Wang, X., & Shen, C. (2021) · arXiv · doi:10.48550/arxiv.2102.10882 · Cited by 489
“However, the relative positional encoding cannot provide absolute position information , which is also important to the classification performance (Islam et al., 2020).”
BackgroundInfluentialSOLOv2: Dynamic and Fast Instance Segmentation
Wang, X., Zhang, R., Kong, T., Li, L., & Shen, C. (2020) · arXiv · doi:10.48550/arxiv.2003.10152 · Cited by 549
TransNeXt: Robust Foveal Visual Perception for Vision Transformers
Shi, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01683 · Cited by 474
TransPose: Keypoint Localization via Transformer
Yang, S., Quan, Z., Nie, M., & Yang, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01159 · Cited by 490
Medical Image Segmentation via Cascaded Attention Decoding
Rahman, M. M., & Mărculescu, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00616 · Cited by 454
StyTr 2 : Image Style Transfer with Transformers
Deng, Y., Tang, F., Dong, W., Ma, C., Pan, X., Wang, L., & Xu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01104 · Cited by 460
MPViT: Multi-Path Vision Transformer for Dense Prediction
Lee, Y., Kim, J., Willette, J., & Hwang, S. J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00714 · Cited by 401
StyleSwin: Transformer-based GAN for High-resolution Image Generation
Zhang, B., Gu, S., Zhang, B., Bao, J., Chen, D., Wen, F., Wang, Y., & Guo, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01102 · Cited by 288
A Graph-Transformer for Whole Slide Image Classification
Zheng, Y., Gindra, R. H., Green, E. J., Burks, E. J., Betke, M., Beane, J. E., & Kolachalama, V. B. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3176598 · Cited by 255
Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding
Dong, Q., Cao, C., & Fu, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01107 · Cited by 233
Medical Image Segmentation using Squeeze-and-Expansion Transformers
Li, S., Sui, X., Luo, X., Xu, X., Liu, Y., & Goh, R. S. M. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/112 · Cited by 230
On Translation Invariance in CNNs: Convolutional Layers Can Exploit Absolute Spatial Location
Kayhan, O. S., & van Gemert, J. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01428 · Cited by 228
ResT: An Efficient Transformer for Visual RecognitionPreprint
Zhang, Q., & Yang, Y.-B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13677 · Cited by 214
Defect transformer: An efficient hybrid transformer architecture for surface defect detection
Wang, J., Xu, G., Yan, F., Wang, J., & Wang, Z. (2023) · Measurement · doi:10.1016/j.measurement.2023.112614 · Cited by 151
SegFormer3D: an Efficient Transformer for 3D Medical Image Segmentation
Perera, S. R., Navard, P., & Yılmaz, A. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00503 · Cited by 147
SOLO: A Simple Framework for Instance Segmentation
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3111116 · Cited by 131
G-CASCADE: Efficient Cascaded Graph Convolutional Decoding for 2D Medical Image Segmentation
Rahman, M. M., & Mărculescu, R. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00755 · Cited by 132
ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks
Saini, R., Jha, N. K., Das, B. K., Mittal, S., & Mohan, C. K. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093341 · Cited by 140
MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection
Dai, R., Das, S., Kahatapitiya, K., Ryoo, M. S., & Brémond, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01941 · Cited by 113
NHBS-Net: A Feature Fusion Attention Network for Ultrasound Neonatal Hip Bone Segmentation
Liu, R., Liu, M., Sheng, B., Li, H., Li, P., Song, H., Zhang, P., Jiang, L., & Shen, D. G. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3087857 · Cited by 106
MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation
Sarandi, I., Linder, T., Arras, K. O., & Leibe, B. (2020) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2020.3037257 · Cited by 106
ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks
Saini, R., Jha, N. K., Das, B. K., Mittal, S., & Mohan, C. K. (2020) · Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) · Cited by 89
MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation
Sárándi, I., Linder, T., Arras, K. O., & Leibe, B. (2021) · RWTH Publications (RWTH Aachen) · Cited by 88
Super-Resolution Neural Operator
Wei, M., & Zhang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01750 · Cited by 93
SST: Spatial and Semantic Transformers for Multi-Label Image Recognition
Chen, Z.-M., Cui, Q., Zhao, B., Song, R., Zhang, X., & Yoshie, O. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3148867 · Cited by 88
Positional Encoding as Spatial Inductive Bias in GANs
Xu, R., Wang, X., Chen, K., Zhou, B., & Loy, C. C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01336 · Cited by 83
Transformer Fusion and Pixel-Level Contrastive Learning for RGB-D Salient Object Detection
Wu, J., Hao, F., Liang, W., & Xu, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3275308 · Cited by 80
ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors
Cao, C., Dong, Q., & Fu, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3280222 · Cited by 80
Tian, Y., Wang, J., Wang, Y., Zhao, C., Yao, F., & Wang, X. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3197815 · Cited by 72
Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model
Zheng, Z., Ermon, S., Kim, D., Zhang, L., & Zhong, Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3475824 · Cited by 80
PiSLTRc: Position-Informed Sign Language Transformer With Content-Aware Convolution
Xie, P., Zhao, M., & Hu, X. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3109665 · Cited by 63
Truly shift-invariant convolutional neural networks
Chaman, A., & Dokmanić, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00377 · Cited by 69
Mind the Pad -- CNNs can Develop Blind SpotsPreprint
Alsallakh, B., Kokhlikyan, N., Miglani, V., Yuan, J., & Reblitz-Richardson, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02178 · Cited by 55
Chen, Y., Yang, J., Chen, B., & Du, S. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3208714 · Cited by 54
Yi, D., Ahmedov, H. B., Jiang, S., Li, Y., Flinn, S. J., & Fernandes, P. G. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127488 · Cited by 53
Vision transformer: To discover the “four secrets” of image patches
Zhou, T., Niu, Y., Lu, H., Peng, C., Guo, Y., & Zhou, H. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102248 · Cited by 56
JIANG, P., Xu, X., Tao, H., Zhao, L., & Zou, C. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3123979 · Cited by 51
Wang, J., Tang, S., Heap, M. J., Tang, C., & Tang, L.-H. (2021) · International Journal of Rock Mechanics and Mining Sciences · doi:10.1016/j.ijrmms.2021.104685 · Cited by 47
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning
Li, L., Zhou, T., Wang, W., Yang, L., Li, J., & Yang, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00852 · Cited by 48
Zhou, H., Xu, Q., Nie, Z., & Li, N. (2021) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4051604 · Cited by 47
Chen, H., Lan, C., Song, J. H., Broni-Bediako, C., Xia, J., & Yokoya, N. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3410389 · Cited by 46
Viewpoint-Adaptive Representation Disentanglement Network for Change Captioning
Tu, Y., Li, L., Su, L., Du, J., Lü, K., & Huang, Q. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3268004 · Cited by 48
Learning Long-Range Relationships for Temporal Aircraft Anomaly Detection
Zhang, D., Gao, J., & Li, X. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3404360 · Cited by 46
Wang, L., Cao, M., & Yuan, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01772 · Cited by 44
Multi-scale local-temporal similarity fusion for continuous sign language recognition
Xie, P., Cui, Z. M., Du, Y., Zhao, M., Cui, J., Wang, B., & Hu, X. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109233 · Cited by 45
GreedyViG: Dynamic Axial Graph Construction for Efficient Vision GNNs
Munir, M., Avery, W., Rahman, M. M., & Mărculescu, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00585 · Cited by 47
Padding Module : Learning the Padding in Deep Neural Networks
Alrasheedi, F., Zhong, X. R., & Huang, P.-C. (2023) · IEEE Access · doi:10.1109/access.2023.3238315 · Cited by 44
Bello, J. L. G., & Kim, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00678 · Cited by 39
New Benchmark for Household Garbage Image Recognition
Wu, Z., Li, H., Wang, X., Wu, Z., Zou, L., Xu, L., & Tan, M. (2022) · Tsinghua Science & Technology · doi:10.26599/tst.2021.9010072 · Cited by 39
Exploring Geometric Consistency for Monocular 3D Object Detection
Lian, Q., Ye, B., Xu, R., Yao, W., & Zhang, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00173 · Cited by 48
Positional Attention Guided Transformer-Like Architecture for Visual Question Answering
Mao, A., Yang, Z. X., Lin, K., Xuan, J., & Liu, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3216770 · Cited by 37
PaCa-ViT: Learning Patch-to-Cluster Attention in Vision Transformers
Grainger, R., Paniagua, T., Song, X., Cuntoor, N. P., Lee, M. W., & Wu, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01781 · Cited by 39
Global Pooling, More than Meets the Eye: Position Information is Encoded Channel-Wise in CNNs
Islam, M. A., Kowal, M. D., Jia, S., Derpanis, K. G., & Bruce, N. D. B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00083 · Cited by 36
Self-citationAPT-Net: Adaptive encoding and parallel decoding transformer for medical image segmentation
Zhang, N., Yu, L., Zhang, D.-Z., Wu, W., Tian, S., & Kang, X. (2022) · Comput. Biol. Medicine · doi:10.1016/j.compbiomed.2022.106292 · Cited by 32
Multivariate time series classification with crucial timestamps guidance
Zhang, D., Gao, J., & Li, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124591 · Cited by 35
Zhu, S., Liao, B. Y., Hua, Y., Zhang, C., Wan, F., & Qing, X. (2022) · ISA Transactions · doi:10.1016/j.isatra.2022.07.016 · Cited by 33
(2021) · arXiv (Cornell University) · Cited by 31
OAFormer: Occlusion Aware Transformer for Camouflaged Object Detection
Yang, X., Zhu, H., Mao, G., & Xing, S. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00246 · Cited by 30
EAIS-Former: An efficient and accurate image segmentation method for fruit leaf diseases
Lu, J., Lu, B., Ma, W., & Sun, Y. S. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.108739 · Cited by 31
CSTA: CNN-based Spatiotemporal Attention for Video Summarization
Son, J., Park, J., & Kim, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01783 · Cited by 42
SOLO: Segmenting Objects by LocationsPreprint
Wang, X., Kong, T., Shen, C., Jiang, Y., & Li, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.04488 · Cited by 30
StegFormer: Rebuilding the Glory of Autoencoder-Based Steganography
Ke, X., Wu, H., & Guo, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.28051 · Cited by 31
Dynamically Pruning Segformer for Efficient Semantic Segmentation
Bai, H., Mao, H., & Nair, D. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747634 · Cited by 30
MXT: A New Variant of Pyramid Vision Transformer for Multi-label Chest X-ray Image Classification
Jiang, X., Zhu, Y. M., Cai, G., Zheng, B., & Yang, D. (2022) · Cognitive Computation · doi:10.1007/s12559-022-10032-4 · Cited by 29
Convolution Transformer Fusion Splicing Network for Hyperspectral Image Classification
Zhao, F., Li, S., Zhang, J., & Liu, H. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3231874 · Cited by 28
Distilling Inter-Class Distance for Semantic Segmentation
Zhang, Z., Zhou, C., & Tu, Z. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/235 · Cited by 33
Hybrid CNN-Transformer Architecture for Efficient Large-Scale Video Snapshot Compressive Imaging
Cao, M., Wang, L., Zhu, M., & Yuan, X. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02101-y · Cited by 29
Zheng, Z., Zhong, Y., Zhao, J. J., Ma, A., & Zhang, L. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.07.001 · Cited by 29
Global Transport for Fluid Reconstruction with Learned Self-Supervision
Franz, A., Solenthaler, B., & Thuerey, N. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00168 · Cited by 26
Wang, K., Xu, J., Zhang, S., Tan, J., & Qin, J. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.136168 · Cited by 26
Spatial–Temporal Enhanced Network for Continuous Sign Language Recognition
Yin, W., Hou, Y., Guo, Z., & Liu, K. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3296668 · Cited by 26
Convolution-Embedded Vision Transformer With Elastic Positional Encoding for Pansharpening
Wang, N., Meng, X., Meng, X., & Shao, F. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3227405 · Cited by 25
Deep-Learning-Based Morphological Feature Segmentation for Facial Skin Image Analysis
Yoon, H., Kim, S., Lee, J., & Yoo, S. (2023) · Diagnostics · doi:10.3390/diagnostics13111894 · Cited by 33
Zhao, R., Yu, J., Zhao, H., & Ngai, E. C. ‐. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610873 · Cited by 24
Zhuang, Y., Cheng, S. L., & Duraisamy, K. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.117623 · Cited by 27
Graph Neural Networks with Diverse Spectral Filtering
Guo, J., Huang, K., Yi, X., & Zhang, R. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583324 · Cited by 23
Luo, Z.-Q., Zhou, K., Tan, Y.-M., Wang, X.-L., Zhu, R., & Zhang, L.-Q. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3289583 · Cited by 24
Tiny Object Detection via Regional Cross Self-Attention Network
Cheng, K., Cui, H., Ghafoor, H. A., Wan, H., Mao, Q., & Zhan, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3232688 · Cited by 23
Automatic pixel-level detection of tire defects based on a lightweight Transformer architecture
Sun, Y., Liu, X., Zhai, X., Sun, K., Zhao, M., Chang, Y., & Zhang, Y. (2023) · Measurement Science and Technology · doi:10.1088/1361-6501/acd5f2 · Cited by 22
Air target intent recognition method combining graphing time series and diffusion models
Chenghai, L. I., Wang, K., Song, Y., Wang, P., & Li, L. (2024) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2024.08.008 · Cited by 21
DNA-T: Deformable Neighborhood Attention Transformer for Irregular Medical Time Series
Huang, J., Yang, B., Yin, K., & Xu, J. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3395446 · Cited by 23
GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation
He, X., Wandt, B., & Rhodin, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00129 · Cited by 24
Hierarchical ConViT with Attention-Based Relational Reasoner for Visual Analogical Reasoning
He, W., Zhang, J., Ren, J., Bai, R., & Jiang, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25072 · Cited by 19
WS-MTST: Weakly Supervised Multi-Label Brain Tumor Segmentation With Transformers
Chen, H., An, J., Jiang, B., Xia, L., Bai, Y., & Gao, Z. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3321602 · Cited by 21
Shift Equivariance in Object Detection
Manfredi, M., & Wang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65414-6_4 · Cited by 20
Transformer-Based High-Fidelity Facial Displacement Completion for Detailed 3D Face Reconstruction
Liu, R., Cheng, Y., Huang, S., Li, C., & Cheng, X. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3271816 · Cited by 18
Joint Learning of Token Context and Span Feature for Span-Based Nested NER
Sun, L. J., Sun, Y., Ji, F., & Wang, C. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3024944 · Cited by 18
Metadata
- Authors
- Islam, M. A., Jia, S., & Bruce, N. D. B.
- Affiliations
- Toronto Metropolitan University (CA)
- Vector Institute (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2001.08248
- OpenAlex
- W2995426144
- Cited by
- 253
- References
- 25
- Citations by year
- 2026: 3 · 2025: 18 · 2024: 61 · 2023: 62 · 2022: 52 · 2021: 37 · 2020: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- positional information, convolutional neural networks, spatial representation, local filters
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
