The DOI matches its Crossref record; its reference list is not available.
Suspicious Behavior Detection with Temporal Feature Extraction and Time-Series Classification for Shoplifting Crime Prevention
Open accessAbstract
The rise in crime rates in many parts of the world, coupled with advancements in computer vision, has increased the need for automated crime detection services. To address this issue, we propose a new approach for detecting suspicious behavior as a means of preventing shoplifting. Existing methods are based on the use of convolutional neural networks that rely on extracting spatial features from pixel values. In contrast, our proposed method employs object detection based on YOLOv5 with Deep Sort to track people through a video, using the resulting bounding box coordinates as temporal features. The extracted temporal features are then modeled as a time-series classification problem. The proposed method was tested on the popular UCF Crime dataset, and benchmarked against the current state-of-the-art robust temporal feature magnitude (RTFM) method, which relies on the Inflated 3D ConvNet (I3D) preprocessing method. Our results demonstrate an impressive 8.45-fold increase in detection inference speed compared to the state-of-the-art RTFM, along with an F1 score of 92%,outperforming RTFM by 3%. Furthermore, our method achieved these results without requiring expensive data augmentation or image feature extraction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is a real danger of AI becoming pervasive in every sense where those involved may be exposed to risks without being aware of them.
“There is a real danger of AI becoming pervasive in every sense where those involved may be exposed to risks without being aware of them [32,90].”
From New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution (2023) · cites this paper as [90]
The Results and Discussion section (page unavailable) identifies a risk from the proposed detection system: false positives could lead to unnecessary interventions or the detainment of innocent people. It does not address AI becoming pervasive or people being unaware of the risks they face. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 30 · Cited by 30
Research works printed but not linked: 32
- Kirichenko, L., Radivilova, T., Sydorenko, B., and Yakovlev, S. (2022). Detection of Shoplifting on Video Using a Hybrid Network. Computation, 10. · DOI
- Gandapur, 2022, E2E-VSDL: End-to-end video surveillance-based deep learning model to detect and prevent criminal activities, Image Vis. Comput., 123, 104467, 10.1016/j.imavis.2022.104467 · DOI
- Qin, Z., Liu, H., Song, B., Alazab, M., and Kumar, P.M. (2021). Detecting and preventing criminal activities in shopping malls using massive video surveillance based on deep learning models. Ann. Oper. Res., 1–8. · DOI
- Wu, Y. (2021). The impact of criminal psychology trend prediction based on deep learning algorithm and three-dimensional convolutional neural network. J. Ambient. Intell. Humaniz. Comput., 1–2. · DOI
- Wu, P., Liu, J., Shi, Y., Sun, Y., Shao, F., Wu, Z., and Yang, Z. (2020, January 23–28). Not only look, but also listen: Learning multimodal violence detection under weak supervision. Proceedings of the European Conference on Computer Vision, Glasgow, UK. · DOI
- Ullah, 2021, CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks, Multimed. Tools Appl., 80, 16979, 10.1007/s11042-020-09406-3 · DOI
- Lin, W., Liu, H., Liu, S., Li, Y., Qian, R., Wang, T., Xu, N., Xiong, H., Qi, G.J., and Sebe, N. (2020). Human in events: A large-scale benchmark for human-centric video analysis in complex events. arXiv.
- Zhang, Y., Zhou, D., Chen, S., Gao, S., and Ma, Y. (2016, January 27–30). Single-image crowd counting via multi-column convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016, Las Vegas, NV, USA. · DOI
- Liu, W., Luo, W., Lian, D., and Gao, S. (2018, January 18–23). Future frame prediction for anomaly detection–A new baseline. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA. · DOI
- Chen, C., Xie, Y., Lin, S., Yao, A., Jiang, G., Zhang, W., Qu, Y., Qiao, R., Ren, B., and Ma, L. (2022, January 17–19). Comprehensive Regularization in a Bi-directional Predictive Network for Video Anomaly Detection. Proceedings of the American Association for Artificial Intelligence 2022, Osaka, Japan.
- Yu, 2021, Abnormal event detection and localization via adversarial event prediction, IEEE Trans. Neural Netw. Learn. Syst., 33, 3572, 10.1109/TNNLS.2021.3053563 · DOI
- Wang, 2021, Robust unsupervised video anomaly detection by multipath frame prediction, IEEE Trans. Neural Netw. Learn. Syst., 33, 2301, 10.1109/TNNLS.2021.3083152 · DOI
- Liu, Z., Nie, Y., Long, C., Zhang, Q., and Li, G. (2021, January 11–17). A hybrid video anomaly detection framework via memory-augmented flow reconstruction and flow-guided frame prediction. Proceedings of the IEEE/CVF International Conference on Computer Vision 2021, Montreal, BC, Canada. · DOI
- Georgescu, M.I., Barbalau, A., Ionescu, R.T., Khan, F.S., Popescu, M., and Shah, M. (2021, January 19–25). Anomaly detection in video via self-supervised and multi-task learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2021, Virtual. · DOI
- Cai, R., Zhang, H., Liu, W., Gao, S., and Hao, Z. (2021, January 2–9). Appearance-motion memory consistency network for video anomaly detection. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually. · DOI
- Liu, K., and Ma, H. (2019, January 21–25). Exploring background-bias for anomaly detection in surveillance videos. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France. · DOI
- Landi, F., Snoek, C.G.M., and Cucchiara, R. (2019). Anomaly locality in video surveillance. arXiv.
- Lu, Y., Yu, F., Reddy, M.K., and Wang, Y. (2020, January 23–28). Few-shot scene-adaptive anomaly detection. Proceedings of the European Conference on Computer Vision, Glasgow, UK. · DOI
- Tian, Y., Pang, G., Chen, Y., Singh, R., Verjans, J.W., and Carneiro, G. (2021). Weakly-supervised video anomaly detection with contrastive learning of long and short-range temporal features. arXiv. · DOI
- Li, S., Liu, F., and Jiao, L. (2022, January 6–10). Self-training multi-sequence learning with Transformer for weakly supervised video anomaly detection. Proceedings of the AAAI, Virtual. · DOI
- Feng, J.C., Hong, F.T., and Zheng, W.S. (2021, January 19–25). Mist: Multiple instance self-training framework for video anomaly detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2021, Virtual. · DOI
- Wu, J., Zhang, W., Li, G., Wu, W., Tan, X., Li, Y., Ding, E., and Lin, L. (2021). Weakly-supervised spatio-temporal anomaly detection in surveillance video. arXiv. · DOI
- Lv, 2021, Localizing anomalies from weakly-labeled videos, IEEE Trans. Image Process., 30, 4505, 10.1109/TIP.2021.3072863 · DOI
- Wu, 2021, Learning causal temporal relation and feature discrimination for anomaly detection, IEEE Trans. Image Process., 30, 3513, 10.1109/TIP.2021.3062192 · DOI
- Ansari, 2022, ESAR, An Expert Shoplifting Activity Recognition System, Cybern. Inf. Technol., 22, 190
- Wang, Y., and Yang, H. (2022, January 14–16). Multi-target Pedestrian Tracking Based on YOLOv5 and DeepSORT. Proceedings of the 2022 IEEE Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), Dalian, China. · DOI
- Sultani, W., Chen, C., and Shah, M. (2018, January 18–22). Real-world anomaly detection in surveillance videos. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA. · DOI
- Rahimian, E., Zabihi, S., Atashzar, S.F., Asif, A., and Mohammadi, A. (2020, January 4–8). XceptionTime: Independent Time-window Xceptiontime architecture for hand gesture classification. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain. · DOI
- Fauvel, K., Lin, T., Masson, V., Fromont, É., and Termier, A. (2021). XCM: An explainable convolutional neural network for multivariate time series classification. Mathematics, 9. · DOI
- Dempster, A., Schmidt, D.F., and Webb, G.I. (2021, January 14–18). MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classification. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Singapore. · DOI
- Selvaraju, 2019, Grad-cam: Visual explanations from deep networks via gradient-based localization, Int. J. Comput. Vis., 128, 336, 10.1007/s11263-019-01228-7 · DOI · Paper page
- Tian, Y., Pang, G., Chen, Y., Singh, R., Verjans, J.W., and Carneiro, G. (2021, January 11–17). Weakly-supervised video anomaly detection with robust temporal feature magnitude learning. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada. · DOI
Metadata
- Authors
- Nazir, A., Mitra, R., Sulieman, H., & Kamalov, F.
- Affiliations
- Zayed University (AE)
- American University of Sharjah (AE)
- Canadian University of Dubai (AE)
- Corresponding author
- Nazir, Amril
- Kamalov, Firuz
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2023-06-22
- Volume
- 23
- Issue
- 13
- Pages
- 5811
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC10347130
- OpenAlex
- W4381802977
- Cited by
- 30
- References
- 30
- Citations by year
- 2026: 4 · 2025: 16 · 2024: 9 · 2023: 1
- FWCI
- 2.72
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- DSpace at AUS (American University of Sharjah) (submittedVersion)
- Funders
- American University of Sharjah and Zayed University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Keywords
- suspicious activity detection, shoplifting prevention, temporal feature extraction, time series classification, YOLOv5, DeepSORT, human tracking, UCF-Crime dataset, inference speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review