The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Land cover mapping at very high resolution with rotation equivariant CNNs: Towards small yet accurate models
Open accessAbstract
In remote sensing images, the absolute orientation of objects is arbitrary. Depending on an object’s orientation and on a sensor’s flight path, objects of the same semantic class can be observed in different orientations in the same image. Equivariance to rotation, in this context understood as responding with a rotated semantic label map when subject to a rotation of the input image, is therefore a very desirable feature, in particular for high capacity models, such as Convolutional Neural Networks (CNNs). If rotation equivariance is encoded in the network, the model is confronted with a simpler task and does not need to learn specific (and redundant) weights to address rotated versions of the same object class. In this work we propose a CNN architecture called Rotation Equivariant Vector Field Network (RotEqNet) to encode rotation equivariance in the network itself. By using rotating convolutions as building blocks and passing only the values corresponding to the maximally activating orientation throughout the network in the form of orientation encoding vector fields, RotEqNet treats rotated versions of the same object with the same filter bank and therefore achieves state-of-the-art performances even when using very small architectures trained from scratch. We test RotEqNet in two challenging sub-decimeter resolution semantic labeling problems, and show that we can perform better than a standard CNN while requiring one order of magnitude less parameters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Cheng, G., Zhou, P., & Han, J. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2601622 · Cited by 1,771
Hypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
Advances in Spectral-Spatial Classification of Hyperspectral Images
Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197589 · Cited by 1,282
Convolutional neural networks for large-scale remote-sensing image classification
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2612821 · Cited by 1,114
Morphological Attribute Profiles for the Analysis of Very High Resolution Images
Dalla Mura, M., Benediktsson, J. A., Waske, B., & Bruzzone, L. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2048116 · Cited by 722
Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?
Penatti, O. A. B., Nogueira, K., & dos Santos, J. A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301382 · Cited by 705
Harmonic Networks: Deep Translation and Rotation Equivariance
Worrall, D. E., Garbin, S. J., Turmukhambetov, D., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.758 · Cited by 563
Land Use Classification in Remote Sensing Images by Convolutional Neural Networks
Castelluccio, M., Poggi, G., Sansone, C., & Verdoliva, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.00092 · Cited by 474
Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks
Volpi, M., & Tuia, D. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2616585 · Cited by 436
Self-citationSemantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks
Audebert, N., Le Saux, B., & Lefèvre, S. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54181-5_12 · Cited by 367
Understanding image representations by measuring their equivariance and equivalence
Lenc, K., & Vedaldi, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298701 · Cited by 366
Zhou, Y., Ye, Q., Qiu, Q., & Jiao, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.527 · Cited by 280
SEMANTIC SEGMENTATION OF AERIAL IMAGES WITH AN ENSEMBLE OF CNNS
Marmanis, D., Wegner, J. D., Galliani, S., Schindler, K., Datcu, M., & Stilla, U. (2016) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-annals-iii-3-473-2016 · Cited by 268
Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery
Sherrah, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02585 · Cited by 260
TI-POOLING: Transformation-Invariant Pooling for Feature Learning in Convolutional Neural Networks
Laptev, D., Savinov, N., Buhmann, J. M., & Pollefeys, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.38 · Cited by 255
Moser, G., Serpico, S. B., & Benediktsson, J. A. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2211551 · Cited by 243
Rotation Equivariant Vector Field Networks
Marcos, D., Volpi, M., Komodakis, N., & Tuia, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.540 · Cited by 231
Self-citationSemantic segmentation of urban scenes by learning local class interactions
Volpi, M., & Ferrari, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301377 · Cited by 152
Self-citationUse of the Stair Vision Library within the ISPRS 2D Semantic Labeling Benchmark (Vaihingen)
Gerke, M. (2015) · University of Twente Research Information · doi:10.13140/2.1.5015.9683 · Cited by 136
Efficient Framework for Palm Tree Detection in UAV Images
Malek, S., Bazi, Y., Alajlan, N., Alhichri, H. S., & Melgani, F. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2331425 · Cited by 130
Campos‐Taberner, M., Romero, A., Gatta, C., Camps‐Valls, G., Lagrange, A., Saux, B. L., Beaupère, A., Boulch, A., Chan-Hon-Tong, A., Herbin, S., et al. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2569162 · Cited by 129
Self-citationHarvey, N. R., Theiler, J. P., Brumby, S. P., et al. (2002) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.992801 · Cited by 107
Liu, Y., Piramanayagam, S., Monteiro, S. T., & Saber, E. S. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.200 · Cited by 103
Tuia, D., Flamary, R., & Courty, N. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.01.006 · Cited by 102
Self-citationLarge-scale damage detection using satellite imagery
Gueguen, L., & Hamid, R. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298737 · Cited by 102
Lagrange, A., Saux, B. L., Beaupère, A., Boulch, A., Chan-Hon-Tong, A., Herbin, S., Randrianarivo, H., & Ferecatu, M. (2015) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326745 · Cited by 80
Harmonic Networks: Deep Translation and Rotation EquivariancePreprint
Worrall, D. E., Garbin, S. J., Turmukhambetov, D., & Brostow, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04642 · Cited by 64
Lei, Z., Fang, T., Huo, H., & Li, D. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2166966 · Cited by 57
From Data Distributions to Regularization in Invariant Learning
Leen, T. K. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.974 · Cited by 51
High-resolution image classification with convolutional networks
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2017) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2017.8128163 · Cited by 38
Fusion of heterogeneous data in convolutional networks for urban semantic labeling
Audebert, N., Saux, B. L., & Lefevrey, S. (2017) · Joint Urban Remote Sensing Event (JURSE) · doi:10.1109/jurse.2017.7924566 · Cited by 33
Research works printed but not linked: 4
- Cohen, T.S., Welling, M., 2016. Group Equivariant Convolutional Networks. Available from: <arXiv:1602.07576>. · arXiv
- Glocer, K., Eads, D., Theiler, J., 2005. Online feature selection for pixel classification. In: Int. Conf. Machine Learning, Bonn, Germany. · doi:10.1145/1102351.1102383
- Jaderberg, M., Simonyan, K., Zisserman, A., et al., 2015. Spatial transformer networks. In: Advances in Neural Information Processing Systems, pp. 2017–2025.
- Regniers, 2016, Supervised classification of very high resolution optical images using wavelet-based textural features, IEEE Trans. Geosci. Rem. Sens., 54, 3722, 10.1109/TGRS.2016.2526078 · doi:10.1109/tgrs.2016.2526078
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Wang, L., Li, R., Zhang, C., Fang, S., Duan, C., Meng, X., & Atkinson, P. M. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.06.008 · Cited by 1,349
Deep learning based multi-temporal crop classification
Zhong, L., Hu, L., & Zhou, H. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.11.032 · Cited by 1,024
Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation
He, X., Zhou, Y., Zhao, J., Zhang, D., Yao, R., & Xue, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3144165 · Cited by 550
LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation
Wang, J., Zheng, Z., Ma, A., Lu, X., & Zhong, Y. (2021) · arXiv · doi:10.48550/arxiv.2110.08733 · Cited by 431
Metadata
- Authors
- Marcos, D., Volpi, M., Kellenberger, B., & Tuia, D.
- Venue
- ISPRS Journal of Photogrammetry and Remote Sensing
- Publisher
- Elsevier BV
- Published
- 2018-11
- Volume
- 145
- Pages
- 96-107
- ISSN
- 0924-2716 (ISSN-L)
- OpenAlex
- W2793461576
- Cited by
- 282
- References
- 34
- FWCI
- 24.22
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Funders
- Swiss National Science Foundation (PZ00P2-136827)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.