Cited by 136Machine Learning and AlgorithmsAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Active Learning for Deep Object Detection via Probabilistic Modeling

Open access
Choi, Jiwoong, Elezi, Ismail, Lee, Hyuk-Jae, Farabet, Clement, Alvarez, Jose M.·2021·2021 IEEE/CVF International Conference on Computer Vision (ICCV)

Abstract

Active learning aims to reduce labeling costs by selecting only the most informative samples on a dataset. Few existing works have addressed active learning for object detection. Most of these methods are based on multiple models or are straightforward extensions of classification methods, hence estimate an image’s informativeness using only the classification head. In this paper, we propose a novel deep active learning approach for object detection. Our approach relies on mixture density networks that estimate a probabilistic distribution for each localization and classification head’s output. We explicitly estimate the aleatoric and epistemic uncertainty in a single forward pass of a single model. Our method uses a scoring function that aggregates these two types of uncertainties for both heads to obtain every image’s informativeness score. We demonstrate the efficacy of our approach in PASCAL VOC and MS-COCO datasets. Our approach outperforms single-model based methods and performs on par with multi-model based methods at a fraction of the computing cost. Code is available at https://github.com/NVlabs/AL-MDN.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/iccv48922.2021.01010

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In the last active learning cycle on VOC07+12 with 7,000 samples, 5,000 of which are actively labeled, our method outperforms the random baseline by 9.1% and the best existing active learning methods by more than 2.8%.

    “In the last one, where we use 7 , 000 samples, 5 , 000 of which are actively labeled, our method outperforms the random baseline by 9 . 1% and the best existing active learning methods by more than 2 . 8% [5].”

    From Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detection (2021) · cites this paper as [5]

    Section 4.2 says VOC07+12 starts with 1,000 labeled images and adds 1,000 per cycle, so a 7,000-image cycle would have 6,000—not 5,000—actively selected images. The VOC07+12 results table gives 0.7352 mAP for the authors’ method, 0.6927 for random sampling, and 0.7149 for LLAL at 7,000 images; those differences are 4.25 and 2.03 percentage points, not 9.1 and more than 2.8. The Comparison to SOTA section also identifies 10,000 images, rather than 7,000, as the last iteration. (LLM, conf=0.90)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • On MS-COCO first AL cycle, our method outperforms the random baseline by 5.8%, the best-performing AL method by 2.7%, the semi-supervised method by 5.4%, and the ensembles by 5%.

    “For MS-COCO, in Fig. 4a-b, we observe that in the first active learning cycle, our method outperforms the random baseline by 5 . 8% , the best-performing AL method by 2 . 7% [5], the semi-supervised method by 5 . 4% , and the ensembles by 5% .”

    From Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detection (2021) · cites this paper as [5]

    Table 5 (MS-COCO comparison; page unavailable) reports this paper’s active-learning benchmark, including 29.28% mAP for Oursgmm at 6,000 labeled images. The citation is attached to the comparison with that method, but this source does not report the citing authors’ result, so it cannot establish their claimed 2.7-point margin. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • On MS-COCO last active learning cycle, our method outperforms the semi-supervised method, multi-model methods, and the best AL method by 1.6%.

    “We observe that this difference is maintained in the other cycles, including the last active learning cycle where our method outperforms the semisupervised method, multi-model methods [9, 12] and the best AL method [5] by 1 . 6% .”

    From Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detection (2021) · cites this paper as [5]

  • On MS-COCO second cycle, our approach outperforms all other methods, including PM, by almost 4% or more.

    “In the second cycle, our approach outperforms all the other methods, including PM [5], by almost 4% or more.”

    From Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detection (2021) · cites this paper as [5]

  • Compared to state-of-the-art methods, our approach yields up to 7.7% relative mAP improvement for PASCAL-VOC and up to 7% for MS-COCO.

    “Compared to state-of-the-art methods [4-8], our approach yields up to a 7 . 7% and 7% relative mAP improvement for PASCAL-VOC and MS-COCO, respectively.”

    From Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detection (2021) · cites this paper as [5]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 49 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. Ross Girshick. Fast r-cnn. In International Conference on Computer Vision (ICCV), 2015.

Cited by

Sorted by citations

Authors
Choi, J., Elezi, I., Lee, H.-J., Farabet, C., & Alvarez, J. M.
Affiliations
  • Seoul National University (KR)
  • Ca' Foscari University of Venice (IT)
  • NVIDIA
Venue
2021 IEEE/CVF International Conference on Computer Vision (ICCV)
Publisher
IEEE
Published
2021-10
Pages
10244-10253
OpenAlex
W3145121851
Cited by
135
References
49
Citations by year
2026: 15 · 2025: 27 · 2024: 36 · 2023: 36 · 2022: 17 · 2021: 4
FWCI
10.74
Type
conference paper
Language
en
Open access
Locations
  • IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
active learning (machine learning), object detection, mixture density networks, uncertainty estimation, aleatoric uncertainty, epistemic uncertainty, annotation cost reduction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review