CoChat
Sign Up
PreprintCited by 29Machine Learning and AlgorithmsAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

An Adaptive Supervision Framework for Active Learning in Object Detection

Open access
Desai, Sai Vikas, Chandra, Akshay L, Guo, Wei, Ninomiya, Seishi, Balasubramanian, Vineeth N·2019·arXiv
DOI 10.48550/arxiv.1908.02454arXiv 1908.02454
Open this paper in CoChat — free accountOpen PDF

Abstract

Active learning approaches in computer vision generally involve querying strong labels for data. However, previous works have shown that weak supervision can be effective in training models for vision tasks while greatly reducing annotation costs. Using this knowledge, we propose an adaptive supervision framework for active learning and demonstrate its effectiveness on the task of object detection. Instead of directly querying bounding box annotations (strong labels) for the most informative samples, we first query weak labels and optimize the model. Using a switching condition, the required supervision level can be increased. Our framework requires little to no change in model architecture. Our extensive experiments show that the proposed framework can be used to train good generalizable models with much lesser annotation costs than the state of the art active learning approaches for object detection.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1908.02454

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 27

  1. [1][1] H. Bilen, M. Pedersoli, and T. Tuytelaars. Weakly supervised object detection with convex clustering. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , pages 1081-1089, June 2015. doi: 10.1109/CVPR.2015.7298711. - · DOI
  2. [2][2] Hakan Bilen and Andrea Vedaldi. Weakly supervised deep detection networks. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , pages 28462854, 2016. -
  3. [4][4] Clemens-Alexander Brust, Christoph Käding, and Joachim Denzler. Active learning for deep object detection. CoRR , abs/1809.09875, 2018. URL http://arxiv. org/abs/1809.09875 . - · arXiv
  4. [5][5] Clemens-Alexander Brust, Christoph Käding, and Joachim Denzler. Active learning for deep object detection. CoRR , abs/1809.09875, 2018. URL http://arxiv. org/abs/1809.09875 . - · arXiv
  5. [6][6] Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence , 40(4):834-848, apr 2018. doi: 10.1109/tpami.2017.2699184. URL https://doi.org/10.1109%2Ftpami.2017.2699184 . - · DOI · Paper page
  6. [7][7] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. http://www.pascalnetwork.org/challenges/VOC/voc2007/workshop/index.html, . -
  7. [8][8] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. http://www.pascalnetwork.org/challenges/VOC/voc2012/workshop/index.html, . -
  8. [9][9] Yarin Gal, Riashat Islam, and Zoubin Ghahramani. Deep bayesian active learning with image data. In ICML , 2017. -
  9. [10][10] K. He, G. Gkioxari, P. Dollà ˛ ar, and R. Girshick. Mask r-cnn. In 2017 IEEE International Conference on Computer Vision (ICCV) , pages 2980-2988, Oct 2017. doi: 10.1109/ICCV.2017.322. - · DOI · Paper page
  10. [11][11] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. CoRR , abs/1512.03385, 2015. URL http://arxiv.org/ abs/1512.03385 . - · arXiv
  11. [13][13] Chieh-Chi Kao, Teng-Yok Lee, Pradeep Sen, and Ming-Yu Liu. Localization-aware active learning for object detection. CoRR , abs/1801.05124, 2018. - · arXiv
  12. [14][14] A. Kapoor, K. Grauman, R. Urtasun, and T. Darrell. Active learning with gaussian processes for object categorization. In 2007 IEEE 11th International Conference on Computer Vision , pages 1-8, Oct 2007. doi: 10.1109/ICCV.2007.4408844. - · DOI
  13. [15][15] Ksenia Konyushkova, Jasper Uijlings, Chris Lampert, and Vittorio Ferrari. Learning intelligent dialogs for bounding-box annotation. 2018. URL https://arxiv.org/ abs/1712.08087 . - · arXiv
  14. [16][16] X. Li and Y. Guo. Adaptive active learning for image classification. In 2013 IEEE Conference on Computer Vision and Pattern Recognition , pages 859-866, June 2013. doi: 10.1109/CVPR.2013.116. - · DOI
  15. [17][17] Simon Madec, Xiuliang Jin, Hao Lu, Benoit de Solan, Shouyang Liu, Florent Duyme, Emmanuelle Heritier, and Baret Frederic. Ear density estimation from high resolution rgb imagery using deep learning technique. Agricultural and Forest Meteorology , 264: 225-234, 01 2019. doi: 10.1016/j.agrformet.2018.10.013. - · DOI · Paper page
  16. [18][18] Dim Papadopoulos, Jasper Uijlings, Frank Keller, and Vittorio Ferrari. Training object class detectors with click supervision. In CVPR , 2017. URL https://arxiv. org/abs/1704.06189 . -
  17. [19][19] Dim Papadopoulos, Jasper Uijlings, Frank Keller, and Vittorio Ferrari. Extreme clicking for efficient object annotation. In ICCV , 2017. URL https://arxiv.org/ abs/1708.02750 . - · arXiv
  18. [20][20] Dim P. Papadopoulos, Jasper R. R. Uijlings, Frank Keller, and Vittorio Ferrari. We donâ ˘ A ´ Zt need no bounding-boxes: Training object class detectors using only human verification. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , pages 854-863, 2016. -
  19. [21][21] Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, editors, Advances in Neural Information Processing Systems 28 , pages 91-99. Curran Associates, Inc., 2015. URL http://papers.nips.cc/paper/ 5638-faster-r-cnn-towards-real-time-object-detection-with-reg pdf . -
  20. [22][22] Soumya Roy, Asim Unmesh, and Vinay P. Namboodiri. Deep active learning for object detection. In BMVC , 2018. -
  21. [23][23] Ozan Sener and Silvio Savarese. Active learning for convolutional neural networks: A core-set approach. In ICLR 2018 , 2018. -
  22. [25][25] Hyun Oh Song, Ross Girshick, Stefanie Jegelka, Julien Mairal, Zaid Harchaoui, and Trevor Darrell. On learning to localize objects with minimal supervision. In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32 , ICML'14, pages II-1611-II-1619. JMLR.org, 2014. URL http://dl.acm.org/citation.cfm?id=3044805.3045072 . -
  23. [26][26] Hao Su, Jia Deng, and Li Fei-Fei. Crowdsourcing annotations for visual object detection. In HCOMP@AAAI , 2012. -
  24. [27][27] Chong Wang, Weiqiang Ren, Kaiqi Huang, and Tieniu Tan. Weakly supervised object localization with latent category learning. In David Fleet, Tomas Pajdla, Bernt Schiele, and Tinne Tuytelaars, editors, Computer Vision - ECCV 2014 , pages 431-445, Cham, 2014. Springer International Publishing. ISBN 978-3-319-10599-4. -
  25. [28][28] Keze Wang, Dongyu Zhang, Ya Li, Ruimao Zhang, and Liang Lin. Cost-effective active learning for deep image classification. IEEE Trans. Cir. and Sys. for Video Technol. , 27(12):2591-2600, December 2017. ISSN 1051-8215. doi: 10.1109/TCSVT.2016. 2589879. URL https://doi.org/10.1109/TCSVT.2016.2589879 . - · DOI
  26. [30][30] D. Zhang, D. Meng, C. Li, L. Jiang, Q. Zhao, and J. Han. A self-paced multipleinstance learning framework for co-saliency detection. In 2015 IEEE International Conference on Computer Vision (ICCV) , pages 594-602, Dec 2015. doi: 10.1109/ ICCV.2015.75. -
  27. [31][31] Yi Zhu, Yanzhao Zhou, Qixiang Ye, Qiang Qiu, and Jianbin Jiao. Soft proposal networks for weakly supervised object localization. CoRR , abs/1709.01829, 2017. URL http://arxiv.org/abs/1709.01829 . · arXiv

Cited by

Sorted by citations

Authors
Desai, S. V., Chandra, A. L., Guo, W., Ninomiya, S., & Balasubramanian, V. N.
Affiliations
  • Indian Institute of Technology Hyderabad (IN)
  • The University of Tokyo (JP)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
Pages
230
DOI
10.48550/arxiv.1908.02454
arXiv
1908.02454
OpenAlex
W3023464334
Cited by
29
References
0
Citations by year
2024: 1 · 2023: 7 · 2022: 10 · 2021: 6 · 2020: 5
FWCI
2.42
Type
journal article
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
active learning (machine learning), object detection, weakly supervised learning, annotation cost reduction, query strategies, switching conditions, bounding box annotation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review