The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Augmentation for small object detection
Open accessAbstract
In the recent years, object detection has experienced impressive progress.Despite these improvements, there is still a significant gap in the performance between the detection of small and large objects.We analyze the current state-of-the-art model, Mask-RCNN, on a challenging dataset, MS COCO.We show that the overlap between small ground-truth objects and the predicted anchors is much lower than the expected IoU threshold.We conjecture this is due to two factors; (1) only a few images are containing small objects, and (2) small objects do not appear enough even within each image containing them.We thus propose to oversample those images with small objects and augment each of those images by copy-pasting small objects many times.It allows us to trade off the quality of the detector on large objects with that on small objects.We evaluate different pasting augmentation strategies, and ultimately, we achieve 9.7% relative improvement on the instance segmentation and 7.1% on the object detection of small objects, compared to the current state of the art method on MS COCO.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
(2016) · Cited by 31,590
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
A systematic study of the class imbalance problem in convolutional neural networks
Buda, M., Maki, A., & Mazurowski, M. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.011 · Cited by 3,088 · cited 1×
“Oversampling We address the issue of relatively fewer images containing small objects by oversampling those images during training [4].”
BackgroundSpeed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743
Self-citationInternational Journal of Computer Vision
(2013) · International Journal of Computer Vision · doi:10.1007/11263.1573-1405 · Cited by 2,340
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294
Proceedings of IEEE International Conference on Computer Vision
(1995) · doi:10.1109/iccv.1995 · Cited by 2,280
INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS
(2025) · doi:10.34218/ijca · Cited by 1,821
DSSD : Deconvolutional Single Shot Detector
Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., & Berg, A. C. (2017) · arXiv · doi:10.48550/arxiv.1701.06659 · Cited by 1,624
Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks
Bell, S., Zitnick, C. L., Bala, K., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.314 · Cited by 1,292
Instance-aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.04412 · Cited by 1,273
Instance-Aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.343 · Cited by 1,244
Fully Convolutional Instance-Aware Semantic Segmentation
Li, Y., Qi, H., Dai, J., Ji, X., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.472 · Cited by 1,116
Perceptual Generative Adversarial Networks for Small Object Detection
Li, J., Liang, X., Wei, Y., Xu, T., Feng, J., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.211 · Cited by 953 · cited 1×
“[22] instead uses a Generative Adversarial Network (GAN) to build features in a convolutional network that are indistinguishable between small and large objects in the context of a traffic sign and pedestrian detection.”
MethodTraffic sign recognition with multi-scale Convolutional Networks
Sermanet, P., & LeCun, Y. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033589 · Cited by 759
Joint Deep Learning for Pedestrian Detection
Ouyang, W., & Wang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.257 · Cited by 660
(2015) · Cited by 656
Yang, F., Choi, W., & Lin, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.234 · Cited by 608
Kampffmeyer, M., Salberg, A.-B., & Jenssen, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.90 · Cited by 605
Automatic thresholding for defect detection
Ng, H.-F. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.03.009 · Cited by 552
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
R-CNN for Small Object Detection
Chen, C., Liu, M.-Y., Tuzel, O., & Xiao, J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54193-8_14 · Cited by 392
Small Object Detection in Optical Remote Sensing Images via Modified Faster R-CNN
Ren, Y., Zhu, C., & Xiao, S. (2018) · Applied Sciences · doi:10.3390/app8050813 · Cited by 277
Semantic Instance Segmentation via Deep Metric Learning
Fathi, A., Wojna, Z., Rathod, V., Wang, P., Song, H. O., Guadarrama, S., & Murphy, K. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10277 · Cited by 182
Self-citationAutomated vision system for localizing structural defects in textile fabrics
Abouelela, A., Abbas, H. M., ElDeeb, H. E., et al. (2004) · Pattern Recognition Letters · doi:10.1016/j.patrec.2004.11.016 · Cited by 122
The Devil is in the Decoder: Classification, Regression and GANs
Wojna, Z., Ferrari, V., Guadarrama, S., Silberman, N., Chen, L.-C., Fathi, A., & Uijlings, J. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01170-8 · Cited by 86
Self-citationNagarajan, M., Huber, M., Schlossbauer, T., Leinsinger, G. L., Król, A., & Wismüller, A. (2012) · Machine Vision and Applications · doi:10.1007/s00138-012-0456-y · Cited by 70
CNN-based small object detection and visualization with feature activation mapping
Menikdiwela, M., Nguyen, C. V., Li, H., & Shaw, M. E. (2017) · International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz.2017.8402455 · Cited by 42
LOCO: Local Context Based Faster R-CNN for Small Traffic Sign Detection
Cheng, P., Liu, W., Zhang, Y., & Ma, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73603-7_27 · Cited by 34
Small-objectness sensitive detection based on shifted single shot detector
Fang, L., Zhao, X., & Zhang, S. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6227-7 · Cited by 27
Cited by
Towards Large-Scale Small Object Detection: Survey and Benchmarks
Cheng, G., Yuan, X., Yao, X., Yan, K., Zeng, Q., Xie, X., & Han, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3290594 · Cited by 683
Recent advances in small object detection based on deep learning: A review
Tong, K., Wu, Y., & Zhou, F. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.103910 · Cited by 592
A review of object detection based on deep learning
Xiao, Y., Tian, Z., Yu, J., Zhang, Y., Liu, S., Du, S., & Lan, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08976-6 · Cited by 584
QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection
Yang, C., Huang, Z., & Wang, N. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01330 · Cited by 634
Slicing Aided Hyper Inference and Fine-Tuning for Small Object Detection
Akyon, F. C., Onur Altinuc, S., & Temizel, A. (2022) · 2022 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip46576.2022.9897990 · Cited by 572
Metadata
- Authors
- Kisantal, M., Wojna, Z., Murawski, J., Naruniec, J., & Cho, K.
- Venue
- 9th International Conference on Advances in Computing and Information Technology (ACITY 2019)
- Publisher
- Aircc Publishing Corporation
- Published
- 2019-12-21
- Pages
- 119-133
- OpenAlex
- W2997408160
- Cited by
- 791
- References
- 36
- FWCI
- 23.95
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.