Cited by 50Video Surveillance and Tracking MethodsAutonomous Vehicle Technology and SafetyAdvanced Neural Network Applications

Orientation- and Scale-Invariant Multi-Vehicle Detection and Tracking from Unmanned Aerial Videos

Open access
Wang, Jie, Simeonova, Sandra, Shahbazi, Mozhdeh·2019·Remote Sensing

Abstract

Along with the advancement of light-weight sensing and processing technologies, unmanned aerial vehicles (UAVs) have recently become popular platforms for intelligent traffic monitoring and control. UAV-mounted cameras can capture traffic-flow videos from various perspectives providing a comprehensive insight into road conditions. To analyze the traffic flow from remotely captured videos, a reliable and accurate vehicle detection-and-tracking approach is required. In this paper, we propose a deep-learning framework for vehicle detection and tracking from UAV videos for monitoring traffic flow in complex road structures. This approach is designed to be invariant to significant orientation and scale variations in the videos. The detection procedure is performed by fine-tuning a state-of-the-art object detector, You Only Look Once (YOLOv3), using several custom-labeled traffic datasets. Vehicle tracking is conducted following a tracking-by-detection paradigm, where deep appearance features are used for vehicle re-identification, and Kalman filtering is used for motion estimation. The proposed methodology is tested on a variety of real videos collected by UAVs under various conditions, e.g., in late afternoons with long vehicle shadows, in dawn with vehicles lights being on, over roundabouts and interchange roads where vehicle directions change considerably, and from various viewpoints where vehicles’ appearance undergo substantial perspective distortions. The proposed tracking-by-detection approach performs efficiently at 11 frames per second on color videos of 2720p resolution. Experiments demonstrated that high detection accuracy could be achieved with an average F1-score of 92.1%. Besides, the tracking technique performs accurately, with an average multiple-object tracking accuracy (MOTA) of 81.3%. The proposed approach also addressed the shortcomings of the state-of-the-art in multi-object tracking regarding frequent identity switching, resulting in a total of only one identity switch over every 305 tracked vehicles.

Integrity signals

Registry

Crossref · 10.3390/rs11182155

Cites

80 of 80 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The Faster R-CNN with ResNet-50 achieves an F1 score of 99.10% on a custom dataset.

    “[93] Faster R-CNN | ResNet-50 | Custom | 4096 × 2160 | 50m | Static | One class (Vehicle) | -- | 99.10 | 98.30 | --”
  • The Faster R-CNN with ResNet-50 achieves an accuracy of 98.30% on a custom dataset.

    “[93] Faster R-CNN | ResNet-50 | Custom | 4096 × 2160 | 50m | Static | One class (Vehicle) | -- | 99.10 | 98.30 | --”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Wang, J., Simeonova, S., & Shahbazi, M.
Affiliations
University of Calgary (CA)
Corresponding author
Shahbazi, Mozhdeh
Venue
Remote Sensing
Publisher
MDPI AG
Published
2019-09-16
Volume
11
Issue
18
Pages
2155
ISSN
2072-4292 (ISSN-L)
OpenAlex
W2973851319
Cited by
50
References
80
Citations by year
2026: 4 · 2025: 5 · 2024: 14 · 2023: 10 · 2022: 8 · 2021: 7 · 2020: 2
FWCI
1.90
Type
journal article
Language
en
Open access
Locations
  • Remote Sensing (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Natural Sciences and Engineering Research Council of Canada (Discovery)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
vehicle detection, vehicle tracking, unmanned aerial vehicles, UAV video, traffic flow monitoring, orientation invariance, scale invariance, tracking-by-detection, vehicle re-identification, Kalman filter, multi-target tracking, identity switching, perspective distortion

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review