CoChat

ISDNet: AI-enabled Instance Segmentation of Aerial Scenes for Smart Cities

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.

Abstract

Aerial scenes captured by UAVs have immense potential in IoT applications related to urban surveillance, road and building segmentation, land cover classification, and so on, which are necessary for the evolution of smart cities. The advancements in deep learning have greatly enhanced visual understanding, but the domain of aerial vision remains largely unexplored. Aerial images pose many unique challenges for performing proper scene parsing such as high-resolution data, small-scaled objects, a large number of objects in the camera view, dense clustering of objects, background clutter, and so on, which greatly hinder the performance of the existing deep learning methods. In this work, we propose ISDNet (Instance Segmentation and Detection Network), a novel network to perform instance segmentation and object detection on visual data captured by UAVs. This work enables aerial image analytics for various needs in a smart city. In particular, we use dilated convolutions to generate improved spatial context, leading to better discrimination between foreground and background features. The proposed network efficiently reuses the segment-mask features by propagating them from early stages using residual connections. Furthermore, ISDNet makes use of effective anchors to accommodate varying object scales and sizes. The proposed method obtains state-of-the-art results in the aerial context.

Overview

Integrity signals

Registry

Crossref · 10.1145/3418205

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Research works printed but not linked: 8

  1. Jian Ding , Nan Xue , Yang Long , Gui-Song Xia , and Qikai Lu. 2018. Learning ROI transformer for detecting oriented objects in aerial images. arXiv preprint arXiv:1812.00155 ( 2018 ). Jian Ding, Nan Xue, Yang Long, Gui-Song Xia, and Qikai Lu. 2018. Learning ROI transformer for detecting oriented objects in aerial images. arXiv preprint arXiv:1812.00155 (2018). · arXiv
  2. Spyros Gidaris and Nikos Komodakis . 2016. Attend refine repeat: Active box proposal generation via in-out localization. arXiv preprint arXiv:1606.04446 ( 2016 ). Spyros Gidaris and Nikos Komodakis. 2016. Attend refine repeat: Active box proposal generation via in-out localization. arXiv preprint arXiv:1606.04446 (2016). · arXiv
  3. Kaiming He , Georgia Gkioxari , Piotr Dollár , and Ross Girshick . 2017 . Mask R-CNN. In Proceedings of the IEEE International Conference on Computer Vision. 2961–2969 . Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask R-CNN. In Proceedings of the IEEE International Conference on Computer Vision. 2961–2969.
  4. K. He , X. Zhang , S. Ren , and J. Sun . 2016. Deep residual learning for image recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16) . 770–778. K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16). 770–778.
  5. Tsung-Yi Lin , Michael Maire , Serge Belongie , James Hays , Pietro Perona , Deva Ramanan , Piotr Dollár , and C. Lawrence Zitnick . 2014. Microsoft COCO: Common objects in context . In Proceedings of the European Conference on Computer Vision. Springer, 740–755 . Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common objects in context. In Proceedings of the European Conference on Computer Vision. Springer, 740–755.
  6. Wei Liu , Dragomir Anguelov , Dumitru Erhan , Christian Szegedy , Scott Reed , Cheng-Yang Fu , and Alexander C . Berg . 2016 . SSD : Single shot multibox detector. In Proceedings of the European Conference on Computer Vision. Springer , 21–37. Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C. Berg. 2016. SSD: Single shot multibox detector. In Proceedings of the European Conference on Computer Vision. Springer, 21–37.
  7. 10.5555/2969442.2969462 · doi:10.5555/2969442.2969462
  8. 10.5555/2969239.2969250 · doi:10.5555/2969239.2969250

Cited by

See all 32

Metadata

Authors
Garg, P., Chakravarthy, A. S., Mandal, M., Narang, P., Chamola, V., & Guizani, M.
Affiliations
  • Birla Institute of Technology and Science, Pilani (IN)
  • Malaviya National Institute of Technology Jaipur (IN)
  • Qatar University (QA)
Venue
ACM Transactions on Internet Technology
Published
2021-08-10
Volume
21
Issue
3
Pages
1-18
ISSN
  • 1533-5399 (ISSN-L)
  • 1557-6051
OpenAlex
W3193164413
Cited by
32
References
60
Citations by year
2026: 3 · 2025: 8 · 2024: 7 · 2023: 4 · 2022: 4 · 2021: 6
FWCI
1.89
Type
journal article
Language
en
Open access
closed
Locations
  • ACM Transactions on Internet Technology (publishedVersion)
  • Qatar University QSpace (Qatar University) (submittedVersion)
Funders
BITS Additional Competitive Research (PLN/AD/2018-19/5)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Remote-Sensing Image Classification
  • Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
Keywords
instance segmentation, object detection, aerial images, UAV imagery, smart cities, urban surveillance, dilated convolution, skip connections, anchor-based detection, foreground-background discrimination, land cover classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.