The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Harmonic Networks: Deep Translation and Rotation Equivariance
Abstract
Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map translations. This is not the case for rotations. Global rotation equivariance is typically sought through data augmentation, but patch-wise equivariance is more difficult. We present Harmonic Networks or H-Nets, a CNN exhibiting equivariance to patch-wise translation and 360-rotation. We achieve this by replacing regular CNN filters with circular harmonics, returning a maximal response and orientation for every receptive field patch. H-Nets use a rich, parameter-efficient and fixed computational complexity representation, and we show that deep feature maps within the network encode complicated rotational invariants. We demonstrate that our layers are general enough to be used in conjunction with the latest architectures and techniques, such as deep supervision and batch normalization. We also achieve state-of-the-art classification on rotated-MNIST, and competitive results on other benchmark challenges.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
(1989) · neural information processing systems · Cited by 3,736
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,096
The design and use of steerable filters
Freeman, W. T., & Adelson, E. H. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.93808 · Cited by 2,942
Hinton, G. E., Krizhevsky, A., & Wang, S. D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_6 · Cited by 1,360
Research works printed but not linked: 3
- jacobsen, 2016, Structured receptive fields in cnns, abs 1605 2971
- kokkinos, 2015, Pushing the boundaries of boundary detection using deep learning
- cohen, 2016, Steerable cnns, abs 1612 8498
Cited by
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965
Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
Thomas, N., Smidt, T., Kearnes, S., Yang, L., Li, L., Kohlhoff, K., & Riley, P. (2018) · arXiv · doi:10.48550/arxiv.1802.08219 · Cited by 1,303
ReDet: A Rotation-equivariant Detector for Aerial Object Detection
Han, J., Ding, J., Xue, N., & Xia, G.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00281 · Cited by 939
Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., & Geiger, A. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00012 · Cited by 924
Alias-Free Generative Adversarial Networks
Karras, T., Aittala, M., Laine, S., Härkönen, E., Hellsten, J., Lehtinen, J., & Aila, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12423 · Cited by 840
von Rueden, L., Mayer, S., Beckh, K., Georgiev, B., Giesselbach, S., Heese, R., Kirsch, B., Walczak, M., Pfrommer, J., Pick, A., et al. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3079836 · Cited by 793
Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation
Li, X., Yu, L., Chen, H., Fu, C.-W., Xing, L., & Heng, P.-A. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2995319 · Cited by 543
Rotation Equivariant CNNs for Digital Pathology
Veeling, B. S., Linmans, J., Winkens, J., Cohen, T., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00934-2_24 · Cited by 476
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency
Golestaneh, S. A., Dadsetan, S., & Kitani, K. M. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00404 · Cited by 465
Interaction-And-Aggregation Network for Person Re-Identification
Hou, R., Ma, B., Chang, H., Gu, X., Shan, S., & Chen, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00954 · Cited by 419
Why do deep convolutional networks generalize so poorly to small image transformations?
Azulay, A., & Weiss, Y. (2018) · arXiv · doi:10.48550/arxiv.1805.12177 · Cited by 428
“Alternatively, one could use specially designed features such as SIFT in which invariance is hard coded [7, 29, 30, 31] or neural network architectures that explicitly enforce invariance [36, 19, 5, 6, 11, 12, 47, 46, 8].”
BackgroundMethodGeometric deep learning of RNA structure
Townshend, R. J. L., Eismann, S., Watkins, A. M., Rangan, R., Karelina, M., Das, R., & Dror, R. O. (2021) · Science · doi:10.1126/science.abe5650 · Cited by 414
Learning SO(3) Equivariant Representations with Spherical CNNs
Esteves, C., Allen-Blanchette, C., Makadia, A., & Daniilidis, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_4 · Cited by 373
Coors, B., Condurache, A. P., & Geiger, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_32 · Cited by 353
Capsule Networks for Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Fernandez-Beltran, R., Plaza, J., Plaza, A., Li, J., & Pla, F. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2871782 · Cited by 347
VV-Net: Voxel VAE Net With Group Convolutions for Point Cloud Segmentation
Meng, H.-Y., Gao, L., Lai, Y.-K., & Manocha, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00859 · Cited by 306
Retinal vessel segmentation based on Fully Convolutional Neural Networks
Oliveira, A., Pereira, S., & Silva, C. A. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.06.034 · Cited by 299
Learning Steerable Filters for Rotation Equivariant CNNs
Weiler, M., Hamprecht, F. A., & Storath, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00095 · Cited by 298
Marcos, D., Volpi, M., Kellenberger, B., & Tuia, D. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.021 · Cited by 282
WILDS: A Benchmark of in-the-Wild Distribution Shifts
Koh, P. W., Sagawa, S., Marklund, H., Xie, S. M., Zhang, M., Balsubramani, A., Hu, W., Yasunaga, M., Phillips, R. L., Gao, I., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07421 · Cited by 518
“C. Finn is a CIFAR Fellow in the Learning in Machines and Brains Program.”
InfluentialUnderstanding Physics-Informed Neural Networks: Techniques, Applications, Trends, and Challenges
Farea, A., Yli-Harja, O., & Emmert-Streib, F. (2024) · AI · doi:10.3390/ai5030074 · Cited by 259
Integrating Machine Learning with Human Knowledge
Deng, C., Ji, X., Rainey, C., Zhang, J., & Lu, W. (2020) · iScience · doi:10.1016/j.isci.2020.101656 · Cited by 243
3D-equivariant graph neural networks for protein model quality assessment
Chen, C., Chen, X., Morehead, A., Wu, T., & Cheng, J. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad030 · Cited by 33
Metadata
- Authors
- Worrall, D. E., Garbin, S. J., Turmukhambetov, D., & Brostow, G. J.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 7168-7177
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2576915720
- Cited by
- 563
- References
- 32
- FWCI
- 18.04
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.