Cited by 30Video Surveillance and Tracking MethodsHuman Pose and Action RecognitionAnomaly Detection Techniques and Applications

The DOI matches its Crossref record; its reference list is not available.

Suspicious Behavior Detection with Temporal Feature Extraction and Time-Series Classification for Shoplifting Crime Prevention

Open access
Nazir, Amril, Mitra, Rohan, Sulieman, Hana, Kamalov, Firuz·2023·Sensors

Abstract

The rise in crime rates in many parts of the world, coupled with advancements in computer vision, has increased the need for automated crime detection services. To address this issue, we propose a new approach for detecting suspicious behavior as a means of preventing shoplifting. Existing methods are based on the use of convolutional neural networks that rely on extracting spatial features from pixel values. In contrast, our proposed method employs object detection based on YOLOv5 with Deep Sort to track people through a video, using the resulting bounding box coordinates as temporal features. The extracted temporal features are then modeled as a time-series classification problem. The proposed method was tested on the popular UCF Crime dataset, and benchmarked against the current state-of-the-art robust temporal feature magnitude (RTFM) method, which relies on the Inflated 3D ConvNet (I3D) preprocessing method. Our results demonstrate an impressive 8.45-fold increase in detection inference speed compared to the state-of-the-art RTFM, along with an F1 score of 92%,outperforming RTFM by 3%. Furthermore, our method achieved these results without requiring expensive data augmentation or image feature extraction.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s23135811

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • There is a real danger of AI becoming pervasive in every sense where those involved may be exposed to risks without being aware of them.

    “There is a real danger of AI becoming pervasive in every sense where those involved may be exposed to risks without being aware of them [32,90].”

    From New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution (2023) · cites this paper as [90]

    The Results and Discussion section (page unavailable) identifies a risk from the proposed detection system: false positives could lead to unnecessary interventions or the detainment of innocent people. It does not address AI becoming pervasive or people being unaware of the risks they face. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 30 · Cited by 30

Research works printed but not linked: 32

  1. Kirichenko, L., Radivilova, T., Sydorenko, B., and Yakovlev, S. (2022). Detection of Shoplifting on Video Using a Hybrid Network. Computation, 10. · DOI
  2. Gandapur, 2022, E2E-VSDL: End-to-end video surveillance-based deep learning model to detect and prevent criminal activities, Image Vis. Comput., 123, 104467, 10.1016/j.imavis.2022.104467 · DOI
  3. Qin, Z., Liu, H., Song, B., Alazab, M., and Kumar, P.M. (2021). Detecting and preventing criminal activities in shopping malls using massive video surveillance based on deep learning models. Ann. Oper. Res., 1–8. · DOI
  4. Wu, Y. (2021). The impact of criminal psychology trend prediction based on deep learning algorithm and three-dimensional convolutional neural network. J. Ambient. Intell. Humaniz. Comput., 1–2. · DOI
  5. Wu, P., Liu, J., Shi, Y., Sun, Y., Shao, F., Wu, Z., and Yang, Z. (2020, January 23–28). Not only look, but also listen: Learning multimodal violence detection under weak supervision. Proceedings of the European Conference on Computer Vision, Glasgow, UK. · DOI
  6. Ullah, 2021, CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks, Multimed. Tools Appl., 80, 16979, 10.1007/s11042-020-09406-3 · DOI
  7. Lin, W., Liu, H., Liu, S., Li, Y., Qian, R., Wang, T., Xu, N., Xiong, H., Qi, G.J., and Sebe, N. (2020). Human in events: A large-scale benchmark for human-centric video analysis in complex events. arXiv.
  8. Zhang, Y., Zhou, D., Chen, S., Gao, S., and Ma, Y. (2016, January 27–30). Single-image crowd counting via multi-column convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016, Las Vegas, NV, USA. · DOI
  9. Liu, W., Luo, W., Lian, D., and Gao, S. (2018, January 18–23). Future frame prediction for anomaly detection–A new baseline. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA. · DOI
  10. Chen, C., Xie, Y., Lin, S., Yao, A., Jiang, G., Zhang, W., Qu, Y., Qiao, R., Ren, B., and Ma, L. (2022, January 17–19). Comprehensive Regularization in a Bi-directional Predictive Network for Video Anomaly Detection. Proceedings of the American Association for Artificial Intelligence 2022, Osaka, Japan.
  11. Yu, 2021, Abnormal event detection and localization via adversarial event prediction, IEEE Trans. Neural Netw. Learn. Syst., 33, 3572, 10.1109/TNNLS.2021.3053563 · DOI
  12. Wang, 2021, Robust unsupervised video anomaly detection by multipath frame prediction, IEEE Trans. Neural Netw. Learn. Syst., 33, 2301, 10.1109/TNNLS.2021.3083152 · DOI
  13. Liu, Z., Nie, Y., Long, C., Zhang, Q., and Li, G. (2021, January 11–17). A hybrid video anomaly detection framework via memory-augmented flow reconstruction and flow-guided frame prediction. Proceedings of the IEEE/CVF International Conference on Computer Vision 2021, Montreal, BC, Canada. · DOI
  14. Georgescu, M.I., Barbalau, A., Ionescu, R.T., Khan, F.S., Popescu, M., and Shah, M. (2021, January 19–25). Anomaly detection in video via self-supervised and multi-task learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2021, Virtual. · DOI
  15. Cai, R., Zhang, H., Liu, W., Gao, S., and Hao, Z. (2021, January 2–9). Appearance-motion memory consistency network for video anomaly detection. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually. · DOI
  16. Liu, K., and Ma, H. (2019, January 21–25). Exploring background-bias for anomaly detection in surveillance videos. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France. · DOI
  17. Landi, F., Snoek, C.G.M., and Cucchiara, R. (2019). Anomaly locality in video surveillance. arXiv.
  18. Lu, Y., Yu, F., Reddy, M.K., and Wang, Y. (2020, January 23–28). Few-shot scene-adaptive anomaly detection. Proceedings of the European Conference on Computer Vision, Glasgow, UK. · DOI
  19. Tian, Y., Pang, G., Chen, Y., Singh, R., Verjans, J.W., and Carneiro, G. (2021). Weakly-supervised video anomaly detection with contrastive learning of long and short-range temporal features. arXiv. · DOI
  20. Li, S., Liu, F., and Jiao, L. (2022, January 6–10). Self-training multi-sequence learning with Transformer for weakly supervised video anomaly detection. Proceedings of the AAAI, Virtual. · DOI
  21. Feng, J.C., Hong, F.T., and Zheng, W.S. (2021, January 19–25). Mist: Multiple instance self-training framework for video anomaly detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2021, Virtual. · DOI
  22. Wu, J., Zhang, W., Li, G., Wu, W., Tan, X., Li, Y., Ding, E., and Lin, L. (2021). Weakly-supervised spatio-temporal anomaly detection in surveillance video. arXiv. · DOI
  23. Lv, 2021, Localizing anomalies from weakly-labeled videos, IEEE Trans. Image Process., 30, 4505, 10.1109/TIP.2021.3072863 · DOI
  24. Wu, 2021, Learning causal temporal relation and feature discrimination for anomaly detection, IEEE Trans. Image Process., 30, 3513, 10.1109/TIP.2021.3062192 · DOI
  25. Ansari, 2022, ESAR, An Expert Shoplifting Activity Recognition System, Cybern. Inf. Technol., 22, 190
  26. Wang, Y., and Yang, H. (2022, January 14–16). Multi-target Pedestrian Tracking Based on YOLOv5 and DeepSORT. Proceedings of the 2022 IEEE Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), Dalian, China. · DOI
  27. Sultani, W., Chen, C., and Shah, M. (2018, January 18–22). Real-world anomaly detection in surveillance videos. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA. · DOI
  28. Rahimian, E., Zabihi, S., Atashzar, S.F., Asif, A., and Mohammadi, A. (2020, January 4–8). XceptionTime: Independent Time-window Xceptiontime architecture for hand gesture classification. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain. · DOI
  29. Fauvel, K., Lin, T., Masson, V., Fromont, É., and Termier, A. (2021). XCM: An explainable convolutional neural network for multivariate time series classification. Mathematics, 9. · DOI
  30. Dempster, A., Schmidt, D.F., and Webb, G.I. (2021, January 14–18). MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classification. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Singapore. · DOI
  31. Selvaraju, 2019, Grad-cam: Visual explanations from deep networks via gradient-based localization, Int. J. Comput. Vis., 128, 336, 10.1007/s11263-019-01228-7 · DOI · Paper page
  32. Tian, Y., Pang, G., Chen, Y., Singh, R., Verjans, J.W., and Carneiro, G. (2021, January 11–17). Weakly-supervised video anomaly detection with robust temporal feature magnitude learning. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada. · DOI

Metadata

Authors
Nazir, A., Mitra, R., Sulieman, H., & Kamalov, F.
Affiliations
  • Zayed University (AE)
  • American University of Sharjah (AE)
  • Canadian University of Dubai (AE)
Corresponding author
  • Nazir, Amril
  • Kamalov, Firuz
Venue
Sensors
Publisher
MDPI AG
Published
2023-06-22
Volume
23
Issue
13
Pages
5811
ISSN
1424-8220 (ISSN-L)
OpenAlex
W4381802977
Cited by
30
References
30
Citations by year
2026: 4 · 2025: 16 · 2024: 9 · 2023: 1
FWCI
2.72
Type
journal article
Language
en
Open access
Locations
  • Sensors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • DSpace at AUS (American University of Sharjah) (submittedVersion)
Funders
American University of Sharjah and Zayed University
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
Keywords
suspicious activity detection, shoplifting prevention, temporal feature extraction, time series classification, YOLOv5, DeepSORT, human tracking, UCF-Crime dataset, inference speed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review