The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images
Open accessAbstract
Like computer vision before, remote sensing has been radically changed by the introduction of deep learning and, more notably, Convolution Neural Networks. Land cover classification, object detection and scene understanding in aerial images rely more and more on deep networks to achieve new state-of-the-art results. Recent architectures such as Fully Convolutional Networks can even produce pixel level annotations for semantic mapping. In this work, we present a deep-learning based segment-before-detect method for segmentation and subsequent detection and classification of several varieties of wheeled vehicles in high resolution remote sensing images. This allows us to investigate object detection and classification on a complex dataset made up of visually similar classes, and to demonstrate the relevance of such a subclass modeling approach. Especially, we want to show that deep learning is also suitable for object-oriented analysis of Earth Observation data as effective object detection can be obtained as a byproduct of accurate semantic segmentation. First, we train a deep fully convolutional network on the ISPRS Potsdam and the NZAM/ONERA Christchurch datasets and show how the learnt semantic maps can be used to extract precise segmentation of vehicles. Then, we show that those maps are accurate enough to perform vehicle detection by simple connected component extraction. This allows us to study the repartition of vehicles in the city. Finally, we train a Convolutional Neural Network to perform vehicle classification on the VEDAI dataset, and transfer its knowledge to classify the individual vehicle instances that we detected.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 1×
“Indeed, the FCN model has been improved to include multi-scale and spatial regularization, e.g., with Conditional Random Fields [15,16].”
MethodInstance-aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.04412 · Cited by 1,273
Instance-Aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.343 · Cited by 1,244
Optimal Transport for Domain Adaptation
Courty, N., Flamary, R., Tuia, D., & Rakotomamonjy, A. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2615921 · Cited by 989
Vehicle detection in aerial imagery : A small target detection benchmark
Razakarivony, S., & Jurie, F. (2016) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.11.002 · Cited by 916
Towards better exploiting convolutional neural networks for remote sensing scene classification
Nogueira, K., Penatti, O. A. B., & dos Santos, J. A. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.001 · Cited by 902
Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?
Penatti, O. A. B., Nogueira, K., & dos Santos, J. A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301382 · Cited by 705
Domain adaptation for the classification of remote sensing data: An overview of recent advances
Tuia, D., Persello, C., & Bruzzone, L. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2548504 · Cited by 675
Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks
Chen, X., Xiang, S., Liu, C.-L., & Pan, C.-H. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2309695 · Cited by 622
THE ISPRS BENCHMARK ON URBAN OBJECT CLASSIFICATION AND 3D BUILDING RECONSTRUCTION
Rottensteiner, F., Sohn, G., Jung, J., Gerke, M., Baillard, C., Benitez, S., & Breitkopf, U. (2012) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsannals-i-3-293-2012 · Cited by 525
The DGPF-Test on Digital Airborne Camera Evaluation Overview and Test Design
Cramer, M. (2010) · Photogrammetrie - Fernerkundung - Geoinformation · doi:10.1127/1432-8364/2010/0041 · Cited by 427
Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks
Audebert, N., Le Saux, B., & Lefèvre, S. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54181-5_12 · Cited by 367
Self-citationEnd-to-End Instance Segmentation with Recurrent Attention
Ren, M., & Zemel, R. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.39 · Cited by 309
SEMANTIC SEGMENTATION OF AERIAL IMAGES WITH AN ENSEMBLE OF CNNS
Marmanis, D., Wegner, J. D., Galliani, S., Schindler, K., Datcu, M., & Stilla, U. (2016) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-annals-iii-3-473-2016 · Cited by 268
Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery
Sherrah, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02585 · Cited by 260
Effective semantic pixel labelling with convolutional networks and Conditional Random Fields
Paisitkriangkrai, S., Sherrah, J., Janney, P., & Van-Den Hengel, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301381 · Cited by 238
Fully convolutional neural networks for remote sensing image classification
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2016) · 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2016.7730322 · Cited by 171
Vehicle detection from aerial imagery
Gleason, J., Nefian, A., Bouyssounouse, X., Fong, T. W., & Bebis, G. N. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979853 · Cited by 134
Classification-based vehicle detection in high-resolution satellite images
Eikvil, L., Aurdal, L., & Koren, H. (2008) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2008.09.005 · Cited by 130
Campos‐Taberner, M., Romero, A., Gatta, C., Camps‐Valls, G., Lagrange, A., Saux, B. L., Beaupère, A., Boulch, A., Chan-Hon-Tong, A., Herbin, S., et al. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2569162 · Cited by 129
Lagrange, A., Saux, B. L., Beaupère, A., Boulch, A., Chan-Hon-Tong, A., Herbin, S., Randrianarivo, H., & Ferecatu, M. (2015) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326745 · Cited by 80
End-to-End Instance Segmentation and Counting with Recurrent Attention.Preprint
Ren, M., & Zemel, R. S. (2016) · arXiv (Cornell University) · Cited by 50
Object-based Detection and Classification of Vehicles from High-resolution Aerial Photography
Holt, A. C., Seto, E., Rivard, T., & Gong, P. L. (2009) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.75.7.871 · Cited by 49
How useful is region-based classification of remote sensing images in a deep learning framework?
Audebert, N., Saux, B. L., & Lefèvre, S. (2016) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2016.7730327 · Cited by 37
Self-citationRepresentation Learning for Contextual Object and Region Detection in Remote Sensing
Fırat, O., Can, G., & Vural, F. T. Y. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.637 · Cited by 24
Deep feature representations for high-resolution remote sensing scene classification
Zhou, W., Shao, Z., & Cheng, Q. (2016) · International Workshop on Earth Observation and Remote Sensing Applications · doi:10.1109/eorsa.2016.7552825 · Cited by 22
Aerial Car Detection and Urban Understanding
Kamenetsky, D., & Sherrah, J. (2015) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2015.7371225 · Cited by 12
Pose-invariant vehicle identification in aerial electro-optical imagery
Janney, P., & Booth, D. (2015) · Machine Vision and Applications · doi:10.1007/s00138-015-0687-9 · Cited by 6
On the usability of deep networks for object-based image analysis
Audebert, N., Saux, B. L., & Lefèvre, S. (2016) · International Conference on Geographic Object-Based Image Analysis (GEOBIA) · doi:10.3990/2.399 · Cited by 6
Self-citationLocal feature based supervised object detection: Sampling, learning and detection strategies
Michel, J., Grizonnet, M., Inglada, J., et al. (2011) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2011.6049689 · Cited by 3
Cited by
ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
Diakogiannis, F. I., Waldner, F., Caccetta, P., & Wu, C. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.013 · Cited by 2,153
Fully Convolutional Siamese Networks for Change Detection
Caye Daudt, R., Le Saux, B., & Boulch, A. (2018) · 2018 25th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2018.8451652 · Cited by 1,743
Self-citationA Survey of Deep Learning-Based Object Detection
Jiao, L., Zhang, F., Liu, F., Yang, S., Li, L., Feng, Z., & Qu, R. (2019) · IEEE Access · doi:10.1109/access.2019.2939201 · Cited by 1,323
Sun, A. Y., & Scanlon, B. R. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab1b7d · Cited by 551
Clustered Object Detection in Aerial Images
Yang, F., Fan, H., Chu, P., Blasch, E., & Ling, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00840 · Cited by 506
“The method in [2] integrates detection in aerial images with semantic segmentation to improve performance.”
Method
Metadata
- Authors
- Audebert, N., Le Saux, B., & Lefèvre, S.
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2017-04-13
- Volume
- 9
- Issue
- 4
- Pages
- 368
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W2606788270
- Cited by
- 264
- References
- 43
- FWCI
- 13.14
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.