CoChat
Sign Up
PreprintCited by 922Machine Learning and AlgorithmsDomain Adaptation and Few-Shot LearningMachine Learning and Data Classification

Active Learning for Convolutional Neural Networks: A Core-Set Approach

Open access
Sener, Ozan, Savarese, Silvio·2017·arXiv
DOI 10.48550/arxiv.1708.00489arXiv 1708.00489
Open this paper in CoChat — free accountOpen PDF

Abstract

Convolutional neural networks (CNNs) have been successfully applied to many recognition and learning tasks using a universal recipe; training a deep model on a very large dataset of supervised examples. However, this approach is rather restrictive in practice since collecting a large set of labeled images is very expensive. One way to ease this problem is coming up with smart ways for choosing images to be labelled from a very large collection (ie. active learning). Our empirical study suggests that many of the active learning heuristics in the literature are not effective when applied to CNNs in batch setting. Inspired by these limitations, we define the problem of active learning as core-set selection, ie. choosing set of points such that a model learned over the selected subset is competitive for the remaining data points. We further present a theoretical result characterizing the performance of any selected subset using the geometry of the datapoints. As an active learning algorithm, we choose the subset which is expected to yield best result according to our characterization. Our experiments show that the proposed method significantly outperforms existing approaches in image classification experiments by a large margin.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1708.00489

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Compared to state-of-the-art methods, our approach yields up to 7.7% relative mAP improvement for PASCAL-VOC and up to 7% for MS-COCO.

    “Compared to state-of-the-art methods [4-8], our approach yields up to a 7 . 7% and 7% relative mAP improvement for PASCAL-VOC and MS-COCO, respectively.”

    From Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detection (2021) · cites this paper as [6]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Part of this paper’s reference list could not be split into single entries.

Flagged first, then by citations

Research works printed but not linked: 18

  1. [2]2. Klaus Brinker. Incorporating diversity in active learning with support vector machines. In ICML , volume 3, pp. 59-66, 2003.
  2. [3]3. William J Cook, William H Cunningham, William R Pulleyblank, and Alexander Schrijver. Combinatorial optimization , volume 605. Springer, 1998.
  3. [4]4. Sanjoy Dasgupta. Analysis of a greedy active learning strategy. In NIPS , 2004.
  4. [5]5. Sanjoy Dasgupta. Analysis of a greedy active learning strategy. In L. K. Saul, Y. Weiss, and L. Bottou (eds.), Advances in Neural Information Processing Systems 17 , pp. 337-344. MIT Press, 2005. URL http://papers.nips.cc/paper/ 2636-analysis-of-a-greedy-active-learning-strategy.pdf .
  5. [6]6. Beg¨ um Demir, Claudio Persello, and Lorenzo Bruzzone. Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Transactions on Geoscience and Remote Sensing , 49(3):1014-1031, 2011.
  6. [7]7. Jeff Donahue, Philipp Kr¨ ahenb¨ uhl, and Trevor Darrell. Adversarial feature learning. arXiv:1605.09782 , 2016. · arXiv
  7. [8]8. Vincent Dumoulin, Ishmael Belghazi, Ben Poole, Alex Lamb, Martin Arjovsky, Olivier Mastropietro, and Aaron Courville. Adversarially learned inference. arXiv:1606.00704 , 2016. · arXiv
  8. [9]9. Ehsan Elhamifar, Guillermo Sapiro, Allen Yang, and S Shankar Sasrty. A convex optimization framework for active learning. In ICCV , 2013.
  9. [10]10. Yoav Freund, H Sebastian Seung, Eli Shamir, and Naftali Tishby. Selective sampling using the query by committee algorithm. Machine learning , 28(2-3), 1997.
  10. [12]12. Yarin Gal, Riashat Islam, and Zoubin Ghahramani. Deep bayesian active learning with image data. arXiv preprint arXiv:1703.02910 , 2017. · arXiv
  11. [13]13. Ravi Ganti and Alexander Gray. Upal: Unbiased pool based active learning. In Artificial Intelligence and Statistics , pp. 422-431, 2012.
  12. [14]14. Daniel Golovin and Andreas Krause. Adaptive submodularity: Theory and applications in active learning and stochastic optimization. Journal of Artificial Intelligence Research , 42:427-486, 2011.
  13. [15]15. Alon Gonen, Sivan Sabato, and Shai Shalev-Shwartz. Efficient active learning of halfspaces: an aggressive approach. The Journal of Machine Learning Research , 14(1):2583-2615, 2013.
  14. [16]16. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In NIPS , 2014.
  15. [17]17. Andrew Guillory and Jeff Bilmes. Interactive submodular set cover. arXiv:1002.3345 , 2010. · arXiv
  16. [18]18. Yuhong Guo. Active instance sampling via matrix partition. In Advances in Neural Information Processing Systems , pp. 802-810, 2010.
  17. [19]19. Yuhong Guo and Dale Schuurmans. Discriminative batch mode active learning. In Advances in neural information processing systems , pp. 593-600, 2008.
  18. [20]20. Steve Hanneke. A bound on the label complexity of agnostic active learning. In Proceedings of the 24th international conference on Machine learning , pp. 353-360. ACM, 2007.

Cited by

Sorted by citations

Authors
Sener, O., & Savarese, S.
Venue
arXiv
Publisher
arXiv
Published
2017
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1708.00489
arXiv
1708.00489
OpenAlex
W2774918944
Cited by
922
References
3
Citations by year
2026: 12 · 2025: 111 · 2024: 196 · 2023: 227 · 2022: 153 · 2021: 130 · 2020: 52 · 2019: 30 · 2018: 10 · 2017: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
active learning (machine learning), convolutional neural networks, coreset selection, batch active learning, image classification, data labeling cost, data geometry, subset selection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review