The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
The Effects of Super-Resolution on Object Detection Performance in Satellite Imagery
Open accessAbstract
We explore the application of super-resolution techniques to satellite imagery, and the effects of these techniques on object detection algorithm performance. Specifically, we enhance satellite imagery beyond its native resolution, and test if we can identify various types of vehicles, planes, and boats with greater accuracy than native resolution. Using the Very Deep Super-Resolution (VDSR) framework and a custom Random Forest Super-Resolution (RFSR) framework we generate enhancement levels of 2×, 4×, and 8× over five distinct resolutions ranging from 30 cm to 4.8 meters. Using both native and super-resolved data, we then train several custom detection models using the SIMRDWN object detection framework. SIMRDWN combines a number of popular object detection algorithms (e.g. SSD, YOLO) into a unified framework that is designed to rapidly detect objects in large satellite images. This approach allows us to quantify the effects of super-resolution techniques on object detection performance across multiple classes and resolutions. We also quantify the performance of object detection as a function of native resolution and object pixel size. For our test set we note that performance degrades from mean average precision (mAP) = 0.53 at 30 cm resolution, down to mAP = 0.11 at 4.8 m resolution. Super-resolving native 30 cm imagery to 15 cm yields the greatest benefit; a 13-36% improvement in mAP. Super-resolution is less beneficial at coarser resolutions, though still provides a small improvement in performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2016) · Cited by 31,590
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., & Loy, C. C. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_5 · Cited by 4,731
Residual Dense Network for Image Super-Resolution
Zhang, Y., Tian, Y., Kong, Y., Zhong, B., & Fu, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00262 · Cited by 4,168
DOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00418 · Cited by 3,414
R-FCN: Object Detection via Region-based Fully Convolutional Networks
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 3,149
Deeply-Recursive Convolutional Network for Image Super-Resolution
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.181 · Cited by 3,025
Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution
Lai, W.-S., Huang, J.-B., Ahuja, N., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.618 · Cited by 2,976
Image Super-Resolution via Deep Recursive Residual Network
Tai, Y., Yang, J., & Liu, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.298 · Cited by 2,415
A survey on object detection in optical remote sensing images
Cheng, G., & Han, J. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.03.014 · Cited by 1,475
Fast and Accurate Single Image Super-Resolution via Information Distillation Network
Hui, Z., Wang, X., & Gao, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00082 · Cited by 955
Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks
Long, Y., Gong, Y., Xiao, Z., & Liu, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2645610 · Cited by 895
Fast and accurate image upscaling with super-resolution forests
Schulter, S., Leistner, C., & Bischof, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299003 · Cited by 618
xView: Objects in Context in Overhead ImageryPreprint
Lam, D., Kuzma, R. S., McGee, K., Dooley, S. W., Laielli, M. J., Klaric, M. N., Bulatov, Y., & McCord, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07856 · Cited by 437
A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learning
Mundhenk, T. N., Konjevod, G., Sakla, W. A., & Boakye, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_48 · Cited by 386
SpaceNet: A Remote Sensing Dataset and Challenge Series
Etten, A. V., Lindenbaum, D., & Bacastow, T. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01232 · Cited by 343
Simultaneous super-resolution and feature extraction for recognition of low-resolution faces
Hennings-Yeomans, P. H., Baker, S., & Kumar, B. V. K. V. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587810 · Cited by 230
You Only Look Twice: Rapid Multi-Scale Object Detection In Satellite Imagery
Etten, A. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09512 · Cited by 206
Task-Driven Super Resolution: Object Detection in Low-Resolution Images
Haris, M., Shakhnarovich, G., & Ukita, N. (2021) · Communications in Computer and Information Science · doi:10.1007/978-3-030-92307-5_45 · Cited by 200
Is image super-resolution helpful for other vision tasks?
Dai, D., Wang, Y., Chen, Y., & Gool, L. V. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477613 · Cited by 176
Liebel, L., & Körner, M. (2016) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-archives-xli-b3-883-2016 · Cited by 174
Video Satellite Imagery Super Resolution via Convolutional Neural Networks
Luo, Y., Zhou, L., Wang, S., & Wang, Z. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2766204 · Cited by 140
Landsat Super-Resolution Enhancement Using Convolution Neural Networks and Sentinel-2 for Training
Pouliot, D., Latifovic, R., Pasher, J., & Duffe, J. (2018) · Remote Sensing · doi:10.3390/rs10030394 · Cited by 105
Satellite Imagery Multiscale Rapid Detection with Windowed Networks
Etten, A. V. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00083 · Cited by 83
Single-frame super resolution of remote-sensing images by convolutional neural networks
Tuna, Ç., Ünal, G., & Sertel, E. (2018) · International Journal of Remote Sensing · doi:10.1080/01431161.2018.1425561 · Cited by 77
Super-Resolution for “Jilin-1” Satellite Video Imagery via a Convolutional Network
Xiao, A., Wang, Z., Wang, L., & Ren, Y. (2018) · Sensors · doi:10.3390/s18041194 · Cited by 74
Vehicle detection from highway satellite images via transfer learning
Cao, L., Wang, C., & Li, J. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.004 · Cited by 57
Marcum, R. A., Davis, C. H., Scott, G. J., et al. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.042614 · Cited by 52
Synthesis-based recognition of low resolution faces
Shekhar, S., Patel, V. M., & Chellappa, R. (2011) · doi:10.1109/ijcb.2011.6117545 · Cited by 48
Liu, H., Fu, Z., Han, J., Shao, L., & Liu, H. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.02.016 · Cited by 32
Robust low-resolution face identification and verification using high-resolution features
Hennings-Yeomans, P. H., Kumar, B. V. K. V., & Baker, S. (2009) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2009.5413920 · Cited by 31
Super-Resolution for Overhead Imagery Using DenseNets and Adversarial Learning
Bosch, M., Gifford, C. M., & Rodriguez, P. A. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00159 · Cited by 30
Practical application of random forests for super-resolution imaging
Huang, J., & Siu, W.-C. (2015) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2015.7169108 · Cited by 15
Sparse Representation-Based Super Resolution for Face Recognition At a Distance
Bilgazyev, E., Efraty, B., Shah, S. K., & Kakadiaris, I. A. (2011) · British Machine Vision Conference (BMVC) · doi:10.5244/c.25.52 · Cited by 14
Cited by
Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark
Xu, C., Wang, J., Yang, W., Yu, H., Yu, L., & Xia, G.-S. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.06.002 · Cited by 458
SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagery
Zhang, J., Lei, J., Xie, W., Fang, Z., Li, Y., & Du, Q. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3258666 · Cited by 388
Rabbi, J., Ray, N., Schubert, M., Chowdhury, S., & Chao, D. (2020) · Remote Sensing · doi:10.3390/rs12091432 · Cited by 359
SpaceNet MVOI: A Multi-View Overhead Imagery Dataset
Weir, N., Lindenbaum, D., Bastidas, A., Etten, A., Kumar, V., Mcpherson, S., Shermeyer, J., & Tang, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00108 · Cited by 95
Self-citation
Metadata
- Authors
- Shermeyer, J., & Van Etten, A.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1432-1441
- OpenAlex
- W2905345100
- Cited by
- 279
- References
- 40
- FWCI
- 10.54
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.