Cited by 64Anomaly Detection Techniques and ApplicationsVideo Surveillance and Tracking MethodsInfrastructure Maintenance and Monitoring

Transformer-Based Spatio-Temporal Unsupervised Traffic Anomaly Detection in Aerial Videos

Tran, Tung Minh, Bui, Doanh C., Nguyen, Tam V., Nguyen, Khang·2024·IEEE Transactions on Circuits and Systems for Video Technology

Abstract

Anomaly detection is an area of video analysis and plays an increasing role in ensuring safety, preventing risks, and guaranteeing quick response in intelligent surveillance systems. It has become a popular research topic and has piqued the interest of researchers in different communities, such as computer vision, machine learning, remote sensing, and data mining, in recent years. This promotes novel mobile systems where drones are equipped with cameras to help people find better and more efficient solutions to automatically detect anomalies (e.g., car accidents, traffic congestion, street fighting) in traffic surveillance videos. However, anomaly detection methods are still rarely studied and developed in the remote sensing community due to anomalous events rarely occurring in real life, along with the high similarities between the objects of interest with small sizes, multi-scale objects, complex backgrounds of great variations, and high overlap between objects. Therefore, in order to fully exploit the spatio-temporal information for anomaly detection in traffic surveillance circumstances, we propose a future frame prediction network based on transformer architectures to detect abnormal events from drone videography in an unsupervised way. Our model treats consecutive video frames from an input clip and feeds features to a transformer encoder to capture spatial and temporal representations from the sequence. Then, it leverages a decoder to predict the next frame. Furthermore, an event with high reconstruction error is identified as an anomaly in the test phase. Thoroughly empirical studies demonstrate that our method achieves superior performance on the UIT-ADrone dataset and largely outperforms the state-of-the-art anomaly methods on the Drone-Anomaly dataset in aerial surveillance. The source code is available online at https://github.com/Tungufm/ASTT.

Integrity signals

Registry

Crossref · 10.1109/tcsvt.2024.3376399

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

1 of the 76 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Tran, T. M., Bui, D. C., Nguyen, T. V., & Nguyen, K.
Affiliations
  • Vietnam National University Ho Chi Minh City (VN)
  • University of Dayton (US)
Venue
IEEE Transactions on Circuits and Systems for Video Technology
Published
2024-09
Volume
34
Issue
9
Pages
8292-8309
ISSN
  • 1051-8215 (ISSN-L)
  • 1558-2205
OpenAlex
W4392693771
Cited by
63
References
76
Citations by year
2026: 28 · 2025: 33 · 2024: 2
FWCI
9.30
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
Funders
Vietnam National University, Ho Chi Minh City (B2023-26-01)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
Keywords
traffic anomaly detection, unsupervised anomaly detection, aerial video surveillance, drone video, spatio-temporal representation, transformer encoder-decoder, future frame prediction, reconstruction error, traffic monitoring

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review