PreprintCited by 5Advanced Neural Network ApplicationsVisual Attention and Saliency DetectionAdvanced Image and Video Retrieval Techniques

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

Gaussian Bounding Boxes and Probabilistic Intersection-over-Union for Object Detection

Open access
Llerena, Jeffri M., Zeni, Luis Felipe, Kristen, Lucas N., Jung, Claudio·2021·arXiv

Abstract

Most object detection methods use bounding boxes to encode and represent the object shape and location. In this work, we explore a fuzzy representation of object regions using Gaussian distributions, which provides an implicit binary representation as (potentially rotated) ellipses. We also present a similarity measure for the Gaussian distributions based on the Hellinger Distance, which can be viewed as a Probabilistic Intersection-over-Union (ProbIoU). Our experimental results show that the proposed Gaussian representations are closer to annotated segmentation masks in publicly available datasets, and that loss functions based on ProbIoU can be successfully used to regress the parameters of the Gaussian representation. Furthermore, we present a simple mapping scheme from traditional (or rotated) bounding boxes to Gaussian representations, allowing the proposed ProbIoU-based losses to be seamlessly integrated into any object detector.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2106.06072

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 1 references

Research works printed but not linked: 38

  1. Bello, Irwan. 2021. LambdaNetworks: Modeling long-range Interactions without Attention. In: International Conference on Learning Representations .
  2. Carion, Nicolas, Massa, Francisco, Synnaeve, Gabriel, Usunier, Nicolas, Kirillov, Alexander, & Zagoruyko, Sergey. 2020. End-to-end object detection with transformers. Pages 213-229 of: European Conference on Computer Vision . Springer.
  3. Chen, B. X., & Tsotsos, J. 2019. Fast Visual Object Tracking using Ellipse Fitting for Rotated Bounding Boxes. Pages 2281-2289 of: 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) .
  4. Chen, Zhiming, Chen, Kean, Lin, Weiyao, See, John, Yu, Hui, Ke, Yan, & Yang, Cong. 2020. PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environments. Pages 195-211 of: Vedaldi, Andrea, Bischof, Horst, Brox, Thomas, & Frahm, Jan-Michael (eds), Computer Vision ECCV 2020 . Cham: Springer International Publishing.
  5. Everingham, Mark, Van Gool, Luc, Williams, Christopher KI, Winn, John, & Zisserman, Andrew. 2010a. The pascal visual object classes (VOC) challenge. International journal of computer vision , 88 (2), 303-338.
  6. Everingham, Mark, Van Gool, Luc, Williams, Christopher, Winn, John, & Zisserman, Andrew. 2010b. The Pascal Visual Object Classes (VOC) challenge. International Journal of Computer Vision , 88 (06), 303-338.
  7. Gilbert, George T. 1991. Positive definite matrices and Sylvester's criterion. The American Mathematical Monthly , 98 (1), 44-46.
  8. Girshick, R. 2015. Fast R-CNN. Pages 1440-1448 of: 2015 IEEE International Conference on Computer Vision (ICCV) .
  9. Girshick, R., Donahue, J., Darrell, T., & Malik, J. 2016. Region-Based Convolutional Networks for Accurate Object Detection and Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence , 38 (1), 142-158.
  10. Gupta, Agrim, Dollar, Piotr, & Girshick, Ross. 2019. LVIS: A dataset for large vocabulary instance segmentation. Pages 5356-5364 of: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition .
  11. He, S., & Lau, R. W. H. 2015. Oriented Object Proposals. Pages 280-288 of: 2015 IEEE International Conference on Computer Vision (ICCV) .
  12. Kailath, Thomas. 1967. The divergence and Bhattacharyya distance measures in signal selection. IEEE transactions on communication technology , 15 (1), 52-60.
  13. Kingma, Diederik, & Ba, Jimmy. 2014. Adam: A Method for Stochastic Optimization. International Conference on Learning Representations , 12.
  14. Kirillov, Alexander, He, Kaiming, Girshick, Ross, Rother, Carsten, & Dollár, Piotr. 2019. Panoptic segmentation. Pages 9404-9413 of: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition .
  15. Kullback, Solomon, & Leibler, Richard A. 1951. On information and sufficiency. The annals of mathematical statistics , 22 (1), 79-86.
  16. Lin, Tsung-Yi, Maire, Michael, Belongie, Serge, Hays, James, Perona, Pietro, Ramanan, Deva, Dollár, Piotr, & Zitnick, C Lawrence. 2014. Microsoft coco: Common objects in context. Pages 740-755 of: European conference on computer vision . Springer.
  17. Lin, Tsung-Yi, Dollár, Piotr, Girshick, Ross, He, Kaiming, Hariharan, Bharath, & Belongie, Serge. 2017a. Feature pyramid networks for object detection. Pages 2117-2125 of: Proceedings of the IEEE conference on computer vision and pattern recognition .
  18. Lin, Tsung-Yi, Goyal, Priya, Girshick, Ross, He, Kaiming, & Dollár, Piotr. 2017b. Focal loss for dense object detection. Pages 2980-2988 of: Proceedings of the IEEE international conference on computer vision .
  19. Liu, Li, Ouyang, Wanli, Wang, Xiaogang, Fieguth, Paul, Chen, Jie, Liu, Xinwang, & Pietikäinen, Matti. 2020. Deep learning for generic object detection: A survey. International Journal of Computer Vision , 128 (2), 261-318.
  20. Liu, Shu, Qi, Lu, Qin, Haifang, Shi, Jianping, & Jia, Jiaya. 2018. Path aggregation network for instance segmentation. Pages 8759-8768 of: Proceedings of the IEEE conference on computer vision and pattern recognition .
  21. Liu, Wei, Anguelov, Dragomir, Erhan, Dumitru, Szegedy, Christian, Reed, Scott, Fu, Cheng-Yang, & Berg, Alexander C. 2016. SSD: Single Shot MultiBox Detector. Pages 21-37 of: Leibe, Bastian, Matas, Jiri, Sebe, Nicu, & Welling, Max (eds), Computer Vision - ECCV 2016 . Cham: Springer International Publishing.
  22. Liu, Zikun, Yuan, Liu, Weng, Lubin, & Yang, Yiping. 2017 (January). A High Resolution Optical Satellite Image Dataset for Ship Recognition and Some New Baselines. In: Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods(ICPRAM) .
  23. Ma, Jinlei, Zhou, Zhiqiang, Wang, Bo, Zong, Hua, & Wu, Fei. 2019. Ship detection in optical satellite images via directional bounding boxes based on ship center and orientation prediction. Remote Sensing , 11 (18), 2173.
  24. Oksuz, Kemal, Cam, Baris Can, Kalkan, Sinan, & Akbas, Emre. 2020. Imbalance problems in object detection: A review. IEEE transactions on pattern analysis and machine intelligence .
  25. Rahman, Md, & Wang, Yang. 2016 (12). Optimizing Intersection-Over-Union in Deep Neural Networks for Image Segmentation. Pages 234-244 of: In International Symposium on Visual Computing , vol. 10072.
  26. Rezatofighi, Hamid, Tsoi, Nathan, Gwak, JunYoung, Sadeghian, Amir, Reid, Ian, & Savarese, Silvio. 2019. Generalized intersection over union: A metric and a loss for bounding box regression. Pages 658-666 of: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition .
  27. Silva, Sergio M., & Jung, Cláudio Rosito. 2021. A Flexible Approach for Automatic License Plate Recognition in Unconstrained Scenarios. IEEE Transactions on Intelligent Transportation Systems , 1-11.
  28. Sun, D., Yang, Y., Li, M., Yang, J., Meng, B., Bai, R., Li, L., & Ren, J. 2020. A Scale Balanced Loss for Bounding Box Regression. IEEE Access , 8 , 108438-108448.
  29. Tan, Mingxing, Pang, Ruoming, & Le, Quoc V. 2020. Efficientdet: Scalable and efficient object detection. Pages 10781-10790 of: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition .
  30. Tychsen-Smith, L., & Petersson, L. 2018. Improving Object Localization with Fitness NMS and Bounded IoU Loss. Pages 6877-6885 of: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition .
  31. Vegelius, Jan, Janson, Svante, & Johansson, Folke. 1986. Measures of similarity between distributions. Quality and Quantity , 20 (4), 437-441.
  32. Wang, Zining, Feng, Di, Zhou, Yiyang, Rosenbaum, Lars, Timm, Fabian, Dietmayer, Klaus, Tomizuka, Masayoshi, & Zhan, Wei. 2020. Inferring spatial uncertainty in object detection. Pages 5792-5799 of: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) . IEEE.
  33. Wu, Yue, Chen, Yinpeng, Yuan, Lu, Liu, Zicheng, Wang, Lijuan, Li, Hongzhi, & Fu, Yun. 2020. Rethinking classification and localization for object detection. Pages 10186-10195 of: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition .
  34. Xia, Gui-Song, Bai, Xiang, Ding, Jian, Zhu, Zhen, Belongie, Serge, Luo, Jiebo, Datcu, Mihai, Pelillo, Marcello, & Zhang, Liangpei. 2018 (June). DOTA: A Large-Scale Dataset for Object Detection in Aerial Images. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) .
  35. Yang, Xue, Yan, Junchi, Feng, Ziming, & He, Tao. 2021a. R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) .
  36. Yang, Xue, Yan, Junchi, Qi, Ming, Wang, Wentao, Xiaopeng, Zhang, & Qi, Tian. 2021b. Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss. In: International Conference on Machine Learning (ICML) .
  37. Yu, Jiahui, Jiang, Yuning, Wang, Zhangyang, Cao, Zhimin, & Huang, Thomas. 2016. UnitBox: An Advanced Object Detection Network. Page 516-520 of: Proceedings of the 24th ACM International Conference on Multimedia . MM'16. New York, NY, USA: Association for Computing Machinery.
  38. Zheng, Zhaohui, Wang, Ping, Liu, Wei, Li, Jinze, Ye, Rongguang, & Ren, Dongwei. 2020. DistanceIoU loss: Faster and better learning for bounding box regression. Pages 12993-13000 of: Proceedings of the AAAI Conference on Artificial Intelligence , vol. 34.

Cited by

Sorted by citations

Metadata

Authors
Llerena, J. M., Zeni, L. F., Kristen, L. N., & Jung, C.
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
OpenAlex
W3168480980
Cited by
5
References
1
Citations by year
2025: 2 · 2024: 1 · 2023: 2
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
object detection, Hellinger distance, bounding box regression

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review