CoChat
Sign Up
PreprintCited by 352Advanced Neural Network ApplicationsVideo Surveillance and Tracking MethodsVisual Attention and Saliency Detection

Vision meets drones: A challenge

Open access
Zhu, Pengfei, Wen, Longyin, Bian, Xiao, Ling, Haibin, Hu, Qinghua·2018·arXiv
DOI 10.48550/arxiv.1804.07437arXiv 1804.07437
Open this paper in CoChat — free accountOpen PDF

Abstract

In this paper we present a large-scale visual object detection and tracking benchmark, named VisDrone2018, aiming at advancing visual understanding tasks on the drone platform. The images and video sequences in the benchmark were captured over various urban/suburban areas of 14 different cities across China from north to south. Specifically, VisDrone2018 consists of 263 video clips and 10,209 images (no overlap with video clips) with rich annotations, including object bounding boxes, object categories, occlusion, truncation ratios, etc. With intensive amount of effort, our benchmark has more than 2.5 million annotated instances in 179,264 images/video frames. Being the largest such dataset ever published, the benchmark enables extensive evaluation and investigation of visual analysis algorithms on the drone platform. In particular, we design four popular tasks with the benchmark, including object detection in images, object detection in videos, single object tracking, and multi-object tracking. All these tasks are extremely challenging in the proposed dataset due to factors such as occlusion, large scale and pose variation, and fast motion. We hope the benchmark largely boost the research and development in visual analysis on drone platforms.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1804.07437

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • VisDrone includes 263 video sequences and more than 10000 static images, collected using various drones in 14 different cities in diverse weather and lighting conditions and at various altitudes.

    “It includes 263 video sequences and more than 10000 static images, all of which were collected using various drones in 14 different cities in diverse weather and lighting conditions and at various altitudes.”

    From A Systematic Review of Drone Based Road Traffic Monitoring System (2022) · cites this paper as [39]

    Dataset Collection (p. 3) reports 263 video clips, 10,209 static images, various drone platforms, 14 cities, and varied weather and lighting conditions. The paper does not state that the footage was collected at various altitudes; searches for altitude and flying height did not establish that detail. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • VisDrone is the largest drone-based aerial dataset, containing four tasks: object detection in images, videos, SOT, and MOT.

    “Another relevant dataset is Visdrone [39], [40], the largest drone-based aerial dataset, which contains four tasks: object detection in images, videos, SOT, and MOT.”

    From A Systematic Review of Drone Based Road Traffic Monitoring System (2022) · cites this paper as [39]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 49

  1. [1][1] P. Doll´ ar, C. Wojek, B. Schiele, and P. Perona, 'Pedestrian detection: An evaluation of the state of the art,' IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 34, no. 4, pp. 743-761, 2012. -
  2. [2][2] A. Geiger, P. Lenz, and R. Urtasun, 'Are we ready for autonomous driving? the KITTI vision benchmark suite,' in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2012, pp. 3354-3361. -
  3. [3][3] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. S. Bernstein, A. C. Berg, and F. Li, 'Imagenet large scale visual recognition challenge,' International Journal of Computer Vision , vol. 115, no. 3, pp. 211-252, 2015. Fig. 8: The number of objects per frame vs. percentage of frames in the training, validation and testing sets for ( Task 2 ) object detection in videos. <!-- image --> Fig. 9: The number of objects with different occlusion degrees of different object categories in the training, validation and testing sets for ( Task 2 ) object detection in videos. <!-- image --> -
  4. [4][4] T. Lin, M. Maire, S. J. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll´ ar, and C. L. Zitnick, 'Microsoft COCO: common objects in context,' in Proceedings of European Conference on Computer Vision , 2014, pp. 740-755. -
  5. [5][5] Y. Wu, J. Lim, and M. Yang, 'Object tracking benchmark,' IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 37, no. 9, pp. 1834-1848, 2015. -
  6. [6][6] L. Cehovin, A. Leonardis, and M. Kristan, 'Visual object tracking performance measures revisited,' IEEE Transactions on Image Processing , vol. 25, no. 3, pp. 1261-1274, 2016. -
  7. [7][7] L. Leal-Taix´ e, A. Milan, I. D. Reid, S. Roth, and K. Schindler, 'Motchallenge 2015: Towards a benchmark for multi-target tracking,' CoRR , vol. abs/1504.01942, 2015. - · arXiv
  8. [8][8] L. Wen, D. Du, Z. Cai, Z. Lei, M. Chang, H. Qi, J. Lim, M. Yang, and S. Lyu, 'UA-DETRAC: A new benchmark and protocol for multi-object detection and tracking,' CoRR , vol. abs/1511.04136, 2015. - · arXiv
  9. [9][9] M. Mueller, N. Smith, and B. Ghanem, 'A benchmark and simulator for UAV tracking,' in Proceedings of European Conference on Computer Vision , 2016, pp. 445-461. -
  10. [10][10] M. Hsieh, Y. Lin, and W. H. Hsu, 'Drone-based object counting by spatially regularized regional proposal network,' in Proceedings of the IEEE International Conference on Computer Vision , 2017. -
  11. [11][11] A. Robicquet, A. Sadeghian, A. Alahi, and S. Savarese, 'Learning social etiquette: Human trajectory understanding in crowded scenes,' in Proceedings of European Conference on Computer Vision , 2016, pp. 549-565. -
  12. [12][12] S. Agarwal, A. Awan, and D. Roth, 'Learning to detect objects in images via a sparse, part-based representation,' IEEE Transactions 10. on Pattern Analysis and Machine Intelligence , vol. 26, no. 11, pp. 1475-1490, 2004. -
  13. [13][13] N. Dalal and B. Triggs, 'Histograms of oriented gradients for human detection,' in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2005, pp. 886-893. -
  14. [14][14] A. Ess, B. Leibe, and L. J. V. Gool, 'Depth and appearance for mobile scene analysis,' in Proceedings of the IEEE International Conference on Computer Vision , 2007, pp. 1-8. -
  15. [15][15] M. Andriluka, S. Roth, and B. Schiele, 'People-tracking-bydetection and people-detection-by-tracking,' in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2008. -
  16. [16][16] M. ¨ Ozuysal, V. Lepetit, and P. Fua, 'Pose estimation for category specific multiview object localization,' in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2009, pp. 778785. -
  17. [17][17] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, 'The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results,' http://www.pascalnetwork.org/challenges/VOC/voc2012/workshop/index.html. -
  18. [18][18] S. Razakarivony and F. Jurie, 'Vehicle detection in aerial imagery : A small target detection benchmark,' Journal of Visual Communication and Image Representation , vol. 34, pp. 187-203, 2016. -
  19. [19][19] T. N. Mundhenk, G. Konjevod, W. A. Sakla, and K. Boakye, 'A large contextual dataset for classification, detection and counting of cars with deep learning,' in Proceedings of European Conference on Computer Vision , 2016, pp. 785-800. -
  20. [21][21] M. Barekatain, M. Mart´ ı, H. Shih, S. Murray, K. Nakayama, Y. Matsuo, and H. Prendinger, 'Okutama-action: An aerial view video Fig. 10: (a) The number of frames vs. the aspect ratio (height divided by width) change rate with respect to the first frame, (b) the number of frames vs. the area change rate with respect to the first frame, and (c) the distributions of the number of frames of video clips, in the training, validation and testing sets for ( Task 3 ) single object tracking. <!-- image --> Fig. 11: Some annotated example video frames of ( Task 4 ) multi-object tracking. The dashed bounding box indicates the object is occluded. Different bounding box colors indicate different classes of objects. The identities of the objects are shown at the left corner of the bounding boxes. For better visualization, we only display some identities of the targets and attributes. <!-- image --> dataset for concurrent human action detection,' in Workshops in Conjunction with the IEEE Conference on Computer Vision and Pattern Recognition , 2017, pp. 2153-2160. -
  21. [22][22] A. W. M. Smeulders, D. M. Chu, R. Cucchiara, S. Calderara, A. Dehghan, and M. Shah, 'Visual tracking: An experimental survey,' IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 36, no. 7, pp. 1442-1468, 2014. -
  22. [23][23] P. Liang, E. Blasch, and H. Ling, 'Encoding color information for visual tracking: Algorithms and benchmark,' IEEE Transactions on Image Processing , vol. 24, no. 12, pp. 5630-5644, 2015. -
  23. [24][24] M. K. etc., 'The visual object tracking VOT2016 challenge results,' in Workshops in Conjunction with the European Conference on Computer Vision , 2016, pp. 777-823. -
  24. [25][25] H. K. Galoogahi, A. Fagg, C. Huang, D. Ramanan, and S. Lucey, 'Need for speed: A benchmark for higher frame rate object tracking,' in Proceedings of the IEEE International Conference on Computer Vision , 2017, pp. 1134-1143. -
  25. [26][26] P. Liang, Y. Wu, H. Lu, L. Wang, C. Liao, and H. Ling, 'Planar object tracking in the wild: A benchmark,' in Proceedings of the IEEE Int'l Conference on Robotics and Automation (ICRA) , 2018. -
  26. [27][27] E. Ristani, F. Solera, R. S. Zou, R. Cucchiara, and C. Tomasi, 'Performance measures and a data set for multi-target, multicamera tracking,' in Workshops in Conjunction with the European Conference on Computer Vision , 2016, pp. 17-35. -
  27. [28][28] S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski, 'A comparison and evaluation of multi-view stereo reconstruction algorithms,' in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2006, pp. 519-528. -
  28. [29][29] S. Baker, D. Scharstein, J. P. Lewis, S. Roth, M. J. Black, and R. Szeliski, 'A database and evaluation methodology for optical flow,' International Journal of Computer Vision , vol. 92, no. 1, pp. 1-31, 2011. -
  29. [30][30] S. Li and D. Yeung, 'Visual object tracking for unmanned aerial vehicles: A benchmark and new motion models,' in Association for the Advancement of Artificial Intelligence , 2017, pp. 4140-4146. -
  30. [31][31] A. Rozantsev, V. Lepetit, and P. Fua, 'Detecting flying objects using a single moving camera,' IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 39, no. 5, pp. 879-892, 2017. -
  31. [32][32] M. Enzweiler and D. M. Gavrila, 'Monocular pedestrian detection: Survey and experiments,' IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 31, no. 12, pp. 2179-2195, 2009. -
  32. [33][33] S. Lyu, M. Chang, D. Du, L. Wen, H. Qi, Y. Li, Y. Wei, L. Ke, T. Hu, M. D. Coco, P. Carcagn` ı, and et al. , 'UA-DETRAC 2017: Report of AVSS2017 &amp; IWT4S challenge on advanced traffic monitoring,' in IEEE International Conference on Advanced Video and Signal Based Surveillance , 2017, pp. 1-7. -
  33. [34][34] M. Everingham, L. J. V. Gool, C. K. I. Williams, J. M. Winn, and A. Zisserman, 'The pascal visual object classes (VOC) challenge,' International Journal of Computer Vision , vol. 88, no. 2, pp. 303-338, 2010. -
  34. [35][35] M. Everingham, S. M. A. Eslami, L. J. V. Gool, C. K. I. Williams, J. M. Winn, and A. Zisserman, 'The pascal visual object classes challenge: A retrospective,' International Journal of Computer Vision , vol. 111, no. 1, pp. 98-136, 2015. -
  35. [36][36] J. Deng, W. Dong, R. Socher, L. Li, K. Li, and F. Li, 'Imagenet: A large-scale hierarchical image database,' in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2009, pp. 248-255. -
  36. [37][37] Y. Wu, J. Lim, and M. Yang, 'Online object tracking: A benchmark,' in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2013, pp. 2411-2418. -
  37. [38][38] M. K. et al. , 'The visual object tracking VOT2014 challenge results,' in Workshops in Conjunction with the European Conference on Computer Vision , 2014, pp. 191-217. -
  38. [39][39] M. Kristan, J. Matas, A. Leonardis, M. Felsberg, L. Cehovin, G. Fern´ andez, T. Voj´ ır, G. H¨ ager, G. Nebehay, and R. P. Pflugfelder, 'The visual object tracking VOT2015 challenge results,' in Workshops in Conjunction with the IEEE International Conference on Computer Vision , 2015, pp. 564-586. -
  39. [40][40] A. Li, M. Li, Y. Wu, M.-H. Yang, and S. Yan, 'NUS-PRO: A new visual tracking challenge,' in IEEE Transactions on Pattern Analysis and Machine Intelligence , 2015, pp. 1-15. -
  40. [41][41] D. Du, H. Qi, W. Li, L. Wen, Q. Huang, and S. Lyu, 'Online deformable object tracking based on structure-aware hyper-graph,' IEEE Transactions on Image Processing , vol. 25, no. 8, pp. 3572-3584, 2016. -
  41. [42][42] M. Felsberg, A. Berg, G. H¨ ager, J. Ahlberg, M. Kristan, J. Matas, A. Leonardis, L. Cehovin, G. Fern´ andez, T. Voj´ ır, G. Nebehay, and R. P. Pflugfelder, 'The thermal infrared visual object tracking VOTTIR2015 challenge results,' in Workshops in Conjunction with the IEEE International Conference on Computer Vision , 2015, pp. 639-651. -
  42. [43][43] M. F. et al. , 'The thermal infrared visual object tracking VOTTIR2016 challenge results,' in Workshops in Conjunction with the European Conference on Computer Vision , 2016, pp. 824-849. -
  43. [44][44] S. Song and J. Xiao, 'Tracking revisited using RGBD camera: Unified benchmark and baselines,' in Proceedings of the IEEE International Conference on Computer Vision , 2013, pp. 233-240. -
  44. [45][45] J. Ferryman and A. Shahrokni, 'Pets2009: Dataset and challenge,' in IEEE International Conference on Advanced Video and Signal-Based Surveillance , 2009, pp. 1-6. -
  45. [47][47] A. Milan, L. Leal-Taix´ e, I. D. Reid, S. Roth, and K. Schindler, 'Mot16: A benchmark for multi-object tracking,' arXiv preprint , vol. abs/1603.00831, 2016. - · arXiv
  46. [48][48] F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua, 'Multicamera people tracking with a probabilistic occupancy map,' IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 30, no. 2, pp. 267-282, 2008. -
  47. [49][49] W. Chen, L. Cao, X. Chen, and K. Huang, 'An equalized global graph model-based approach for multicamera object tracking,' IEEE Transactions on Circuits and Systems for Video Technology , vol. 27, no. 11, pp. 2367-2381, 2017. -
  48. [50][50] C. Kuo, C. Huang, and R. Nevatia, 'Inter-camera association of multi-target tracks by on-line learned appearance affinity models,' in Proceedings of European Conference on Computer Vision , 2010, pp. 383-396. -
  49. [51][51] S. Zhang, E. Staudt, T. Faltemier, and A. K. Roy-Chowdhury, 'A camera network tracking (camnet) dataset and performance baseline,' in IEEE Winter Conference on Applications of Computer Vision , 2015, pp. 365-372. -

Cited by

Sorted by citations

Authors
Zhu, P., Wen, L., Bian, X., Ling, H., & Hu, Q.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2018
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1804.07437
arXiv
1804.07437
OpenAlex
W2798799804
Cited by
352
References
0
Citations by year
2026: 5 · 2025: 15 · 2024: 55 · 2023: 57 · 2022: 44 · 2021: 53 · 2020: 70 · 2019: 48 · 2018: 5
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords
UAV imagery, object detection, object tracking, multi-target tracking, single object tracking, benchmark dataset, occlusion, video annotation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review