The DOI matches its DataCite record; 25 of the 25 references it cites were found in a registry or an index.
How Much Position Information Do Convolutional Neural Networks Encode?
Open accessAbstract
In contrast to fully connected networks, Convolutional Neural Networks (CNNs) achieve efficiency by learning weights associated with local filters with a finite spatial extent. An implication of this is that a filter may know what it is looking at, but not where it is positioned in the image. Information concerning absolute position is inherently useful, and it is reasonable to assume that deep CNNs may implicitly learn to encode this information if there is a means to do so. In this paper, we test this hypothesis revealing the surprising degree of absolute position information that is encoded in commonly used neural networks. A comprehensive set of experiments show the validity of this hypothesis and shed light on how and where this information is represented while offering clues to where positional information is derived from in deep CNNs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Last but not least, the relative positional encodings cannot work equally well as the absolute ones, because the image recognition task still requires absolute position information (Islam et al., 2020), which the relative positional encodings fail to provide.”
From Conditional Positional Encodings for Vision Transformers (2021) · cites this paper as Islam et al., 2020
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
(2010) · Cited by 14,134
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Flagged first, then by citations
Research works printed but not linked: 6
- Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla. Segnet: A deep convolutional encoderdecoder architecture for scene segmentation. TPAMI , 2017.
- Md Amirul Islam, Mrigank Rochan, Neil DB Bruce, and Yang Wang. Gated feedback refinement network for dense image labeling. In CVPR , 2017.
- Md Amirul Islam, Mahmoud Kalash, and Neil DB Bruce. Revisiting salient object detection: Simultaneous detection, ranking, and subitizing of multiple salient objects. In CVPR , 2018.
- Sen Jia and Neil DB Bruce. Richer and deeper supervision network for salient object detection. arXiv preprint arXiv:1901.02425 , 2019. · arXiv
- Nian Liu, Junwei Han, and Ming-Hsuan Yang. Picanet: Learning pixel-wise contextual attention for saliency detection. In CVPR , 2018.
- Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. Grad-cam: Visual explanations from deep networks via gradient-based localization. In ICCV , 2017.
Cited by
Sorted by citations
Items 201–255 of 255
Efficient Real-Time Tracking of Satellite Components Based on Frame Matching
Zhang, H., Zhang, Y., Gao, J., Yang, H., & Zhang, K. (2022) · IEEE Access · doi:10.1109/access.2022.3230826 · Cited by 2
Combining CNN and MLP for Plant Pathology Recognition in Natural Scenes
Wang, H., Pang, D., & Ma, J. (2022) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas48785.2022.9937822 · Cited by 2
Improving FHB Screening in Wheat Breeding Using an Efficient Transformer Model
Azad, B., Abdalla, A., Won, K., & Nafchi, A. M. (2023) · ASABE Annual International Meeting · doi:10.13031/aim.202300569 · Cited by 2
Improving Translation Invariance in Convolutional Neural Networks with Peripheral Prediction Padding
Mukai, K., & Yamanaka, T. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10223102 · Cited by 2
Att-FPA: Boosting Feature Perceive for Object Detection
Liu, J., Gu, Y., Han, S., Zhang, Z., Guo, J., & Cheng, X. (2021) · IEEE Access · doi:10.1109/access.2021.3068488 · Cited by 2
Tool as Embodiment for Recursive ManipulationPreprint
Noguchi, Y., Matsushima, T., Matsuo, Y., & Gu, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.00359 · Cited by 3
Hamila, O. (2022) · doi:10.36939/ir.202206021141 · Cited by 2
Lu, B. (2022) · Saint Petersburg International Conference on Integrated Navigation Systems · doi:10.23919/icins51784.2022.9815384 · Cited by 1
Shi, J., Xi, T., Fan, X., Tang, J., & Yu, H. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3479314 · Cited by 1
Channel Propagation Networks for Refreshable Vision Transformer
Go, J., & Ryu, J. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00139 · Cited by 1
HTMP: Triple-Scale Multilevel Network With Hessian Spatial Loss for Pansharpening
Zhang, B., Zhang, D., Shi, S., & Guo, Z. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3580088 · Cited by 1
Park, J.-H., & Sung, W. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-3163 · Cited by 1
Deep learning for weak signal acquisition: correlation peak pixel absolute position using deep CNNs
Lu, B., Chen, W., & Qu, C. (2021) · IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC) · doi:10.1109/icspcc52875.2021.9564619 · Cited by 1
Yu, J., Zheng, Y., Ruan, S., Liu, Q., Cheng, Z., & Wu, J. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/186 · Cited by 1
LA-layer: General local attention layer for full attention networks
Lu, H. J., Poppe, R. W., & Salah, A. A. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00352 · Cited by 1
Generation of High-Quality Realistic Faces with StyleGAN
Ashwini, K., Nagajyothi, D., Ramakrishna, C., & Jyothi, V. (2023) · IEEE Global Conference for Advancement in Technology (GCAT) · doi:10.1109/gcat59970.2023.10353468 · Cited by 1
SSN: Sequential Spatial Network for Trajectory Prediction in Bird's-Eye View
Li, H., Zhou, L., & Knoll, A. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10421881 · Cited by 1
Generative EO/IR multi-scale vision transformer for improved object detection
Christian, J., Bright, M. A., Summers, J. E., Olson, A., & Havens, T. C. (2024) · Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications · doi:10.1117/12.3023596 · Cited by 1
Spatial-Temporal Traffic Forecasting Based on Bottom-Up Representation Learning
Chi, P., & Ma, X. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831697 · Cited by 1
End-to-end Multi-Instance Robotic Reaching from Monocular Vision
Zhuang, Z., Yu, X., & Mahony, R. E. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561518 · Cited by 1
Review of Object Detection Techniques
Yu, B., Feng, J., Lei, D., Gao, M., & Jia, Y. (2022) · Chinese Control Conference (CCC) · doi:10.23919/ccc55666.2022.9902668 · Cited by 1
Do CNNs Encode Data Augmentations?Preprint
Yan, E., & Huang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08773 · Cited by 1
Neural Mesh Refiner for 6-DoF Pose EstimationPreprint
Wu, D., Chen, Y., Qi, X., Yu, Y., Chen, W., & Xiao, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07561 · Cited by 1
Isometric Graph Neural NetworksPreprint
Walker, M. J. P., Yan, B., Xiao, Y., Wang, Y., & Acharya, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09554 · Cited by 1
Global Transport for Fluid Reconstruction with Learned Self-Supervision
Franz, E. (n.d.) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 1
Ripple Attention for Visual Perception with Sub-quadratic ComplexityPreprint
Lin, Z., Pan, H., & Kong, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02453 · Cited by 2
An Empirical Method to Quantify the Peripheral Performance Degradation in Deep NetworksPreprint
Wloka, C., & Tsotsos, J. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.02749
Exploiting Image Resolution Holistically in Computer Vision Models
Yan, E. (2020) · ResearchWorks at the University of Washington (University of Washington)
Zhang, X., Han, L., Sobeih, T., Lappin, L., Lee, M. A., Howard, A., & Kisdi, Á. (2021) · arXiv (Cornell University)
Position information attention networks for explosive mobile phone classification
Zhou, Z., Li, X., Yu, S., Wang, Z., & Zhang, X. (2022) · Journal of Electronic Imaging · doi:10.1117/1.jei.31.4.043020
Brain tumor segmentation based on improved U-NetPreprint
zheng, P., Zhu, X., & Guo, W. (2022) · Research Square · doi:10.21203/rs.3.rs-1903672/v1
Flexformer: Flexible Transformer for Efficient Visual RecognitionPreprint
Fan, X., & Liu, H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4184550
Recognition of radar in-pulse modulation based on radar de-noising Linknet
Wang, C., & Kuang, L. (2022) · International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) · doi:10.1109/cei57409.2022.9950156
Methods for Estimating 3D Human Pose and Location
Véges, M. (2022) · Eötvös Loránd Tudományegyetem · doi:10.15476/elte.2022.046
Sumformer: recursive positional encoding for transformer in short text classification
Zhan, P., Lu, L., Huang, W., Zheng, M., Lin, Q., & Zuo, Y. (2023) · International Conference on Artificial Intelligence, Automation and High Performance Computing (AIAHPC) · doi:10.1117/12.2687014
Yang, X., & Ma, Y. (2024) · International Journal of Computers and Applications · doi:10.1080/1206212x.2023.2300221
Qiu, R., Lu, J., Feng, Y., Xie, S., & Hu, C. (2024) · Research Square · doi:10.21203/rs.3.rs-3669948/v1
TSM: Three-Stream Mix For Unsupervised Medical Image Registration
Gu, Z., Zhang, D., Chen, F., Wan, P., & Chen, L. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385804
Ding, Z., & Xiao, X. H. (2023) · International Symposium on Artificial Intelligence for Medicine Sciences (ISAIMS) · doi:10.1145/3644116.3644325
UTFormer: A UAV Sensing-based Triple Attention Transformer Network for Semantic SegmentationPreprint
Liu, D., Long, H., & Liu, Z. (2024) · Research Square · doi:10.21203/rs.3.rs-4501785/v1
Manikandan, T., & Ms, V. (2024) · Research Square · doi:10.21203/rs.3.rs-4586188/v1
CenterUNet: a Model Fused Semantic Segmentation for Flange Center Point Detection
Wang, H., Li, H., Wang, Z., He, M., & Ma, C. (2024) · International Conference on Intelligent Technology and Embedded Systems (ICITES) · doi:10.1109/icites62688.2024.10777457
Depth Completion using Galerkin Attention
Xu, Y., & Zhang, X. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802287
Auxiliary diagnosis and visualization of Alzheimer's disease based on multimodal medical images
Peng, H., & Pan, H. (2024) · International Conference on Virtual Reality, Image and Signal Processing (VRISP) · doi:10.1145/3700003.3700026
Channel-wise mask learning based mixing transformer for spectral compressive imaging
Xie, W., Xu, P., Zheng, H., & Liu, Y. (2025) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2025.107635
Two-dimensional spatial orientation relation recognition between image objects
Peiyong, G., Zheng, K., Jiang, Y. F., Huixuan, Z., Honghao, H., & Ruijie, G. (2025) · Engineering Science and Technology an International Journal · doi:10.1016/j.jestch.2025.102074
USDet:Unknown Ship Detection Based on Remote Sensing Optical Images
Cheng, W., Gong, T., Gong, D., & Xiong, S. (2024) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait63902.2024.11022251
Comply: Learning Sentences with Complex Weights inspired by Fruit Fly Olfaction
Figueroa, A., Westerhoff, J., Atefi, G., Fast, D., Winter, B., Gers, F. A., Löser, A., & Nejdl, W. (2025) · Neuro Inspired Computational Elements Conference (NICE) · doi:10.1109/nice65350.2025.11064982
Convolutional Spatio-Temporal Prediction Network with Trainable Positional Encoding
Xu, Y., Zhang, Y., Sun, D., Li, K., Zhu, Q., Ke, W., Zhang, Y., & Zhang, M. (2025) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc65474.2025.11090881
Rethinking translation robustness for reliable convolutional segmentation architecture
Zhang, Z., Wang, C., Xu, R., Xu, W., Xu, S., Xu, Y., & Guo, L. (2025) · Displays · doi:10.1016/j.displa.2025.103168
Deep learning-based McIntosh classification of sunspot groups
Deng, X., Yang, Y., Zhang, X., Feng, S., Dai, W., Liang, B., & Xiong, J.-P. (2025) · Astronomy and Computing · doi:10.1016/j.ascom.2025.100995
Wang, F., Zhang, M., Wang, Z., Dan, Y., & Zhang, Z. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3874
Metadata
- Authors
- Islam, M. A., Jia, S., & Bruce, N. D. B.
- Affiliations
- Toronto Metropolitan University (CA)
- Vector Institute (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2001.08248
- OpenAlex
- W2995426144
- Cited by
- 253
- References
- 25
- Citations by year
- 2026: 3 · 2025: 18 · 2024: 61 · 2023: 62 · 2022: 52 · 2021: 37 · 2020: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- positional information, convolutional neural networks, spatial representation, local filters
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
