Cited by 1,079Video Surveillance and Tracking MethodsAdvanced Neural Network ApplicationsAdvanced Vision and Imaging

VirtualWorlds as Proxy for Multi-object Tracking Analysis

Gaidon, Adrien, Wang, Qiao, Cabon, Yohann, Vig, Eleonora·2016·2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Abstract

Modern computer vision algorithms typically require expensive data acquisition and accurate manual labeling. In this work, we instead leverage the recent progress in computer graphics to generate fully labeled, dynamic, and photo-realistic proxy virtual worlds. We propose an efficient real-to-virtual world cloning method, and validate our approach by building and publicly releasing a new video dataset, called "Virtual KITTI", automatically labeled with accurate ground truth for object detection, tracking, scene and instance segmentation, depth, and optical flow. We provide quantitative experimental evidence suggesting that (i) modern deep learning algorithms pre-trained on real data behave similarly in real and virtual worlds, and (ii) pre-training on virtual data improves performance. As the gap between real and virtual worlds is small, virtual worlds enable measuring the impact of various weather and imaging conditions on recognition performance, all other things being equal. We show these factors may affect drastically otherwise high-performing deep models for tracking.

Integrity signals

Registry

Crossref · 10.1109/cvpr.2016.470

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

2 of the 41 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Gaidon, A., Wang, Q., Cabon, Y., & Vig, E.
Affiliations
  • Xerox (France) (FR)
  • Arizona State University (US)
  • Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE)
Venue
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher
IEEE
Published
2016-06
Pages
4340-4349
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2397830550
Cited by
1,079
References
41
Citations by year
2026: 47 · 2025: 94 · 2024: 123 · 2023: 128 · 2022: 106 · 2021: 171 · 2020: 131 · 2019: 149 · 2018: 76 · 2017: 50 · 2016: 4
FWCI
32.40
Type
conference paper
Language
en
Open access
closed
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • elib (German Aerospace Center) (acceptedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
Keywords
virtual worlds, multi-target tracking, synthetic data, object detection, instance segmentation, depth estimation, optical flow, computer graphics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review