CoChat
Sign Up
PreprintCited by 284Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningAdvanced Image and Video Retrieval Techniques

LSDA: Large Scale Detection Through Adaptation

Open access
Hoffman, Judy, Guadarrama, Sergio, Tzeng, Eric, Hu, Ronghang, Donahue, Jeff, Girshick, Ross, Darrell, Trevor, Saenko, Kate·2014·arXiv
DOI 10.48550/arxiv.1407.5035arXiv 1407.5035
Open this paper in CoChat — free accountOpen PDF

Abstract

A major challenge in scaling object detection is the difficulty of obtaining labeled images for large numbers of categories. Recently, deep convolutional neural networks (CNNs) have emerged as clear winners on object classification benchmarks, in part due to training with 1.2M+ labeled classification images. Unfortunately, only a small fraction of those labels are available for the detection task. It is much cheaper and easier to collect large quantities of image-level labels from search engines than it is to collect detection data and label it with precise bounding boxes. In this paper, we propose Large Scale Detection through Adaptation (LSDA), an algorithm which learns the difference between the two tasks and transfers this knowledge to classifiers for categories without bounding box annotated data, turning them into detectors. Our method has the potential to enable detection for the tens of thousands of categories that lack bounding box annotations, yet have plenty of classification data. Evaluation on the ImageNet LSVRC-2013 detection challenge demonstrates the efficacy of our approach. This algorithm enables us to produce a >7.6K detector by using available classification data from leaf nodes in the ImageNet tree. We additionally demonstrate how to modify our architecture to produce a fast detector (running at 2fps for the 7.6K detector). Models and software are available at

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1407.5035

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • This paper provides the first demonstration that domain randomization can be useful for robotic tasks requiring precision.

    “Although previous work demonstrated the ability to perform robotic control using a neural network pretrained on ImageNet and fine-tuned on randomized rendered pixels [37], this paper provides the first demonstration that domain randomization can be useful for robotic tasks requiring precision.”

    From Domain randomization for transferring deep neural networks from simulation to the real world (2017) · cites this paper as [37]

    The citation [37] is attached to the preceding claim about prior work, not to the citing authors’ claim that their own paper is the first to demonstrate precision robotics. Section 3.1 (p. 4) says LSDA pretrains a CNN on ImageNet classification data and fine-tunes it, but for object detection. It does not report robotic control or fine-tuning on randomized rendered pixels. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Sadeghi and Levine's policy mapping images to controls learned in a simulator with varied 3D scenes and textures can be applied successfully to real-world quadrotor flight.

    “Sadeghi and Levine's work [37] is the most similar to our own. The authors demonstrate that a policy mapping images to controls learned in a simulator with varied 3D scenes and textures can be applied successfully to real-world quadrotor flight.”

    From Domain randomization for transferring deep neural networks from simulation to the real world (2017) · cites this paper as [37]

    The Experiments section (p. 5) describes object detection on ILSVRC2013, and the quantitative analysis (p. 6) concerns adapting classifiers into detectors. Searches for Sadeghi and Levine, simulated 3D scenes, image-to-control policies, and real-world quadrotor flight found no passage addressing the attributed claim. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

  • Sadeghi and Levine's experiments (collision avoidance in hallways and open spaces) do not demonstrate the ability to deal with high-precision tasks.

    “However, their experiments - collision avoidance in hallways and open spaces - do not demonstrate the ability to deal with high-precision tasks.”

    From Domain randomization for transferring deep neural networks from simulation to the real world (2017) · cites this paper as [37]

    The Experiments section (p. 5) evaluates LSDA on an object-detection dataset, not Sadeghi and Levine’s collision-avoidance experiments. Searches for Sadeghi and Levine, hallway or open-space collision avoidance, and high-precision tasks found no passage addressing the claim. (LLM, conf=0.76)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 22

  1. [1][1] R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In In Proc. CVPR , 2014. -
  2. [2][2] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. International Journal of Computer Vision , 88(2):303-338, June 2010. -
  3. [5][5] P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun. Overfeat: Integrated recognition, localization and detection using convolutional networks. CoRR , abs/1312.6229, 2013. - · arXiv
  4. [6][6] K. Ali and K. Saenko. Confidence-rated multiple instance boosting for object detection. In IEEE Conference on Computer Vision and Pattern Recognition , 2014. -
  5. [7][7] H. Song, R. Girshick, S. Jegelka, J. Mairal, Z. Harchaoui, and T. Darrell. On learning to localize objects with minimal supervision. In Proceedings of the International Conference on Machine Learning (ICML) , 2014. -
  6. [9][9] Philipp Fischer, Alexey Dosovitskiy, and Thomas Brox. Descriptor matching with convolutional neural networks: a comparison to sift. ArXiv e-prints , abs/1405.5769, 2014. - · arXiv
  7. [12][12] B. Kulis, K. Saenko, and T. Darrell. What you saw is not what you get: Domain adaptation using asymmetric kernel transforms. In Proc. CVPR , 2011. -
  8. [13][13] J. Yang, R. Yan, and A. Hauptmann. Adapting SVM classifiers to data with shifted distributions. In ICDM Workshops , 2007. -
  9. [14][14] Y. Aytar and A. Zisserman. Tabula rasa: Model transfer for object category detection. In Proc. ICCV , 2011. -
  10. [15][15] J. Hoffman, E. Rodner, J. Donahue, K. Saenko, and T. Darrell. Efficient learning of domain-invariant image representations. In Proc. ICLR , 2013. -
  11. [17][17] J. Yang, R. Yan, and A. G. Hauptmann. Cross-domain video concept detection using adaptive svms. ACM Multimedia , 2007. -
  12. [18][18] Y. Aytar and A. Zisserman. Tabula rasa: Model transfer for object category detection. In IEEE International Conference on Computer Vision , 2011. -
  13. [19][19] J. Donahue, J. Hoffman, E. Rodner, K. Saenko, and T. Darrell. Semi-supervised domain adaptation with instance constraints. In Computer Vision and Pattern Recognition (CVPR) , 2013. -
  14. [20][20] J. Xu, S. Ramos, D. V´ azquez, and A.M. L´ opez. Domain adaptation of deformable part-based models. IEEE Trans. on Pattern Analysis and Machine Intelligence , In Press, 2014. -
  15. [21][21] Y. Aytar and A. Zisserman. Enhancing exemplar svms using part level transfer regularization. In British Machine Vision Conference , 2012. -
  16. [22][22] D. Goehring, J. Hoffman, E. Rodner, K. Saenko, and T. Darrell. Interactive adaptation of real-time object detectors. In International Conference on Robotics and Automation (ICRA) , 2014. -
  17. [23][23] J.R.R. Uijlings, K.E.A. van de Sande, T. Gevers, and A.W.M. Smeulders. Selective search for object recognition. International Journal of Computer Vision , 104(2):154-171, 2013. -
  18. [24][24] Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093 , 2014. - · arXiv
  19. [25][25] M. D. Smucker, J. Allan, and B. Carterette. A comparison of statistical significance tests for information retrieval evaluation. In In Conference on Information and Knowledge Management , 2007. -
  20. [26][26] D. Hoeim, Y. Chodpathumwan, and Q. Dai. Diagnosing error in object detectors. In In Proc. ECCV , 2012. -
  21. [27][27] P. Kr¨ ahenb¨ uhl and V. Koltun. Geodesic object proposals. In In Proc. ECCV , 2014. -
  22. [28][28] K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In In Proc. ECCV , 2014.

Cited by

Sorted by citations

Authors
Hoffman, J., Guadarrama, S., Tzeng, E., Hu, R., Donahue, J., Girshick, R., Darrell, T., & Saenko, K.
Affiliations
  • University of California, Berkeley (US)
  • Tsinghua University (CN)
  • University of Massachusetts Lowell (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2014
Volume
27
Pages
3536-3544
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1407.5035
arXiv
1407.5035
OpenAlex
W2115699968
Cited by
284
References
5
Citations by year
2025: 1 · 2024: 7 · 2023: 15 · 2022: 13 · 2021: 30 · 2020: 42 · 2019: 50 · 2018: 33 · 2017: 31 · 2016: 32 · 2015: 27 · 2014: 3
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • neural information processing systems
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
object detection, transfer learning, ImageNet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review