The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Learning Aerial Image Segmentation From Online Maps
Open accessAbstract
This paper deals with semantic segmentation of high-resolution (aerial) images where a semantic class label is assigned to each pixel via supervised classification as a basis for automatic map generation. Recently, deep convolutional neural networks (CNNs) have shown impressive performance and have quickly become the de-facto standard for semantic segmentation, with the added benefit that task-specific feature design is no longer necessary. However, a major downside of deep learning methods is that they are extremely data hungry, thus aggravating the perennial bottleneck of supervised classification, to obtain enough annotated training data. On the other hand, it has been observed that they are rather robust against noise in the training labels. This opens up the intriguing possibility to avoid annotating huge amounts of training data, and instead train the classifier from existing legacy data or crowd-sourced maps that can exhibit high levels of noise. The question addressed in this paper is: can training with large-scale publicly available labels replace a substantial part of the manual labeling effort and still achieve sufficient performance? Such data will inevitably contain a significant portion of errors, but in return virtually unlimited quantities of it are available in larger parts of the world. We adapt a state-of-the-art CNN architecture for semantic segmentation of buildings and roads in aerial images, and compare its performance when using different training data sets, ranging from manually labeled pixel-accurate ground truth of the same city to automatic training data derived from OpenStreetMap data from distant locations. We report our results that indicate that satisfying performance can be obtained with significantly less manual annotation effort, by exploiting noisy large-scale training data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
OpenStreetMap: User-Generated Street Maps
Haklay, M., & Weber, P. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.80 · Cited by 3,194
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Haklay, M. (2010) · Environment and Planning B: Planning and Design · doi:10.1068/b35097 · Cited by 1,632
Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons
Leung, T., & Malik, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011126920638 · Cited by 1,498 · cited 1×
“As local evidence, conventional classifiers are fed with raw pixel intensities, simple arithmetic combinations such as vegetation indices, and different statistics or filter responses that describe the local image texture [15]–[17].”
BackgroundDollar, P., Tu, Z., Perona, P., & Belongie, S. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.91 · Cited by 1,237
Convolutional neural networks for large-scale remote-sensing image classification
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2612821 · Cited by 1,114
Shotton, J., Winn, J., Rother, C., & Criminisi, A. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-007-0109-1 · Cited by 1,026
Morphological Attribute Profiles for the Analysis of Very High Resolution Images
Dalla Mura, M., Benediktsson, J. A., Waske, B., & Bruzzone, L. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2048116 · Cited by 722
Learning to Detect Roads in High-Resolution Aerial Images
Mnih, V., & Hinton, G. E. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15567-3_16 · Cited by 624
Quality Assessment of the French OpenStreetMap Dataset
Girres, J., & Touya, G. (2010) · Transactions in GIS · doi:10.1111/j.1467-9671.2010.01203.x · Cited by 531
Human detection using partial least squares analysis
Schwartz, W. R., Kembhavi, A., Harwood, D., & Davis, L. S. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459205 · Cited by 493
Spatial Metrics and Image Texture for Mapping Urban Land Use
Herold, M., Liu, X., & Clarke, K. C. (2003) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.69.9.991 · Cited by 438
Results of the ISPRS benchmark on urban object detection and 3D building reconstruction
Rottensteiner, F., Sohn, G., Gerke, M., Wegner, J. D., Breitkopf, U., & Jung, J. (2013) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2013.10.004 · Cited by 401
Self-citationMachine Learning for Aerial Image Labeling
Mnih, V. (2013) · TSpace (University of Toronto) · Cited by 376
Constructing models for content-based image retrieval
Schmid, C. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990922 · Cited by 367
Fischler, M. A., Tenenbaum, J. M., & Wolf, H. C. (1981) · Computer Graphics and Image Processing · doi:10.1016/0146-664x(81)90056-3 · Cited by 354
Using perceptual organization to extract 3D structures
Mohan, R., & Nevatia, R. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.42852 · Cited by 254
Effective semantic pixel labelling with convolutional networks and Conditional Random Fields
Paisitkriangkrai, S., Sherrah, J., Janney, P., & Van-Den Hengel, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301381 · Cited by 238
A Gibbs Point Process for Road Extraction from Remotely Sensed Images
Stoica, R. S., Descombes, X., & Zerubia, J. B. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013086.45688.5d · Cited by 197
A Higher-Order CRF Model for Road Network Extraction
Wegner, J. D., Montoya-Zegarra, J. A., & Schindler, K. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.222 · Cited by 197
Self-citationCataloging Public Objects Using Aerial and Street-Level Images — Urban Trees
Wegner, J. D., Branson, S., Hall, D., Schindler, K., & Perona, P. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.647 · Cited by 175
Self-citationExtracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D
Fischer, A., Kolbe, T. H., Lang, F., Cremers, A. B., Förstner, W., Plümer, L., & Steinhage, V. (1998) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0721 · Cited by 155
Enhancing Road Maps by Parsing Aerial Images Around the World
Máttyus, G., Wang, S., Fidler, S., & Urtasun, R. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.197 · Cited by 147
Building Outline Extraction from Digital Elevation Models Using Marked Point Processes
Ortner, M., Descombes, X., & Zerubia, J. B. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-005-5033-7 · Cited by 128
Tokarczyk, P., Wegner, J. D., Walk, S., & Schindler, K. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2321423 · Cited by 112
Self-citationRoad networks as collections of minimum cost paths
Wegner, J. D., Zegarra, J. A. M., & Konrad Schindler, B. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.07.002 · Cited by 97
Self-citationRecovering Line-Networks in Images by Junction-Point Processes
Chai, D., Förstner, W., & Lafarge, F. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.247 · Cited by 94
Feature Sets and Dimensionality Reduction for Visual Object Detection
Hussain, S. U., & Triggs, B. (2010) · British Machine Vision Conference (BMVC) · doi:10.5244/c.24.112 · Cited by 81
Lagrange, A., Saux, B. L., Beaupère, A., Boulch, A., Chan-Hon-Tong, A., Herbin, S., Randrianarivo, H., & Ferecatu, M. (2015) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326745 · Cited by 80
Mind the Gap: Modeling Local and Global Context in (Road) Networks
Zegarra, J. A. M., Wegner, J. D., Ladický, Ľ., & Konrad Schindler, B. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11752-2_17 · Cited by 57
Self-citationDetecting parametric objects in large scenes by Monte Carlo sampling
Verdié, Y., & Lafarge, F. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0641-0 · Cited by 28
Cited by
Using satellite imagery to understand and promote sustainable development
Burke, M., Driscoll, A., Lobell, D. B., & Ermon, S. (2021) · Science · doi:10.1126/science.abe8628 · Cited by 457
LANet: Local Attention Embedding to Improve the Semantic Segmentation of Remote Sensing Images
Ding, L., Tang, H., & Bruzzone, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2994150 · Cited by 415
Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery
Wang, S., Chen, W., Xie, S. M., Azzari, G., & Lobell, D. B. (2020) · Remote Sensing · doi:10.3390/rs12020207 · Cited by 265
On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances, and Million-AID
Long, Y., Xia, G.-S., Li, S., Yang, W., Yang, M. Y., Zhu, X. X., Zhang, L., & Li, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3070368 · Cited by 250
Neupane, B., Horanont, T., & Aryal, J. (2021) · Remote Sensing · doi:10.3390/rs13040808 · Cited by 247
Metadata
- Authors
- Kaiser, P., Wegner, J. D., Lucchi, A., Jaggi, M., Hofmann, T., & Schindler, K.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2017-11
- Volume
- 55
- Issue
- 11
- Pages
- 6054-6068
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2737129951
- Cited by
- 290
- References
- 37
- FWCI
- 19.32
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.