Cited by 1,336Advanced Neural Network ApplicationsVideo Surveillance and Tracking MethodsVisual Attention and Saliency Detection

Detection and tracking meet drones challenge

Open access
Zhu, Pengfei, Wen, Longyin, Du, Dawei, Bian, Xiao, Fan, Heng, Hu, Qinghua, Ling, Haibin·2022·IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract

Drones, or general UAVs, equipped with cameras have been fast deployed with a wide range of applications, including agriculture, aerial photography, and surveillance. Consequently, automatic understanding of visual data collected from drones becomes highly demanding, bringing computer vision and drones more and more closely. To promote and track the developments of object detection and tracking algorithms, we have organized three challenge workshops in conjunction with ECCV 2018, ICCV 2019 and ECCV 2020, attracting more than 100 teams around the world. We provide a large-scale drone captured dataset, VisDrone, which includes four tracks, i.e., (1) image object detection, (2) video object detection, (3) single object tracking, and (4) multi-object tracking. In this paper, we first present a thorough review of object detection and tracking datasets and benchmarks, and discuss the challenges of collecting large-scale drone-based object detection and tracking datasets with fully manual annotations. After that, we describe our VisDrone dataset, which is captured over various urban/suburban areas of 14 different cities across China from North to South. Being the largest such dataset ever published, VisDrone enables extensive evaluation and investigation of visual analysis algorithms for the drone platform. We provide a detailed analysis of the current state of the field of large-scale object detection and tracking on drones, and conclude the challenge as well as propose future directions. We expect the benchmark largely boost the research and development in video analysis on drone platforms. All the datasets and experimental results can be downloaded from https://github.com/VisDrone/VisDrone-Dataset.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tpami.2021.3119563

Cites

165 of 165 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • VisDrone includes 263 video sequences and more than 10000 static images, collected using various drones in 14 different cities in diverse weather and lighting conditions and at various altitudes.

    “It includes 263 video sequences and more than 10000 static images, all of which were collected using various drones in 14 different cities in diverse weather and lighting conditions and at various altitudes.”

    From A Systematic Review of Drone Based Road Traffic Monitoring System (2022) · cites this paper as [40]

    The VisDrone Overview (p. 4) confirms 263 video clips, 10,209 static images, various drone platforms, 14 cities, and varied weather and lighting. The Introduction (p. 1) says drone cameras operate at different altitudes, but our copy does not specifically say the VisDrone images and clips were collected at various altitudes. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • VisDrone is the largest drone-based aerial dataset, containing four tasks: object detection in images, videos, SOT, and MOT.

    “Another relevant dataset is Visdrone [39], [40], the largest drone-based aerial dataset, which contains four tasks: object detection in images, videos, SOT, and MOT.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

4 of the 169 references couldn’t be matched to a known paper.

Research works printed but not linked: 9

  1. [17][17] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, 'The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results,' http://www.pascalnetwork.org/challenges/VOC/voc2012/workshop/index.html, 2012. -
  2. [57][57] K. He, G. Gkioxari, P. Doll´ ar, and R. B. Girshick, 'Mask R-CNN,' in ICCV , 2017, pp. 2980-2988. -
  3. [65][65] R. B. Girshick, 'Fast R-CNN,' in ICCV , 2015, pp. 1440-1448. -
  4. [88][88] B. Singh, M. Najibi, and L. S. Davis, 'SNIPER: efficient multiscale training,' in NeurIPS , 2018, pp. 9333-9343. -
  5. [92][92] M. Najibi, B. Singh, and L. Davis, 'Autofocus: Efficient multiscale inference,' in ICCV , 2019, pp. 9744-9754. -
  6. [106][106] Y. Chen, Y. Cao, H. Hu, and L. Wang, 'Memory enhanced globallocal aggregation for video object detection,' in CVPR , 2020, pp. 10 334-10 343. -
  7. [114][114] H. K. Galoogahi, A. Fagg, and S. Lucey, 'Learning backgroundaware correlation filters for visual tracking,' in ICCV , 2017, pp. 1144-1152. -
  8. [128][128] Z. Zhu, Q. Wang, B. Li, W. Wu, J. Yan, and W. Hu, 'Distractoraware siamese networks for visual object tracking,' in ECCV , 2018, pp. 103-119. -
  9. [130][130] Z. Kalal, K. Mikolajczyk, and J. Matas, 'Tracking-learningdetection,' TPAMI , vol. 34, no. 7, pp. 1409-1422, 2012. -

Cited by

Sorted by citations

Authors
Zhu, P., Wen, L., Du, D., Bian, X., Fan, H., Hu, Q., & Ling, H.
Affiliations
  • Tianjin University (CN)
  • JD Finance America Corporation, Mountain View, CA, USA
  • State University of New York (US)
  • GE Global Research (United States) (US)
  • University of North Texas (US)
  • Stony Brook University (US)
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2022-11-01
Volume
44
Issue
11
Pages
7380-7399
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
  • 1939-3539
OpenAlex
W3205100603
Cited by
1,336
References
169
Citations by year
2026: 422 · 2025: 409 · 2024: 257 · 2023: 173 · 2022: 73 · 2021: 2
FWCI
45.41
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Key Research and Development Program of China (2019YFB2101904)
  • National Natural Science Foundation of China (61732011, 61876127, 61925602)
  • Applied Basic Research Program of Qinghai (2019-ZJ-7017)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords
VisDrone dataset, multi-target tracking, single object tracking, video object detection, object detection, benchmark challenge
MeSH terms
Unmanned Aerial Devices, Algorithms, Photography

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review