Video Stream Analysis in Clouds: An Object Detection and Classification Framework for High Performance Video Analytics
Open accessThe DOI matches its Crossref record.
Abstract
Object detection and classification are the basic tasks in video analytics and become the starting point for other complex applications. Traditional video analytics approaches are manual and time consuming. These are subjective due to the very involvement of human factor. We present a cloud based video analytics framework for scalable and robust analysis of video streams. The framework empowers an operator by automating the object detection and classification process from recorded video streams. An operator only specifies an analysis criteria and duration of video streams to analyse. The streams are then fetched from a cloud storage, decoded and analysed on the cloud. The framework executes compute intensive parts of the analysis to GPU powered servers in the cloud. Vehicle and face detection are presented as two case studies for evaluating the framework, with one month of data and a 15 node cloud. The framework reliably performed object detection and classification on the data, comprising of 21,600 video streams and 175 GB in size, in 6.52 hours. The GPU enabled deployment of the framework took 3 hours to perform analysis on the same number of video streams, thus making it at least twice as fast than the cloud deployment without GPUs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607
“If these processing tasks are handled in the central cloud, the video stream should be routed to the core network [236], which will consume a great amount of network bandwidth due to the nature of video stream.”
BackgroundEMM: Energy-Aware Mobility Management for Mobile Edge Computing in Ultra Dense Networks
Sun, Y., Zhou, S., & Xu, J. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2760160 · Cited by 420
A Comprehensive Survey of RAN Architectures Toward 5G Mobile Communication System
Habibi, M. A., Nasimi, M., Han, B., & Schotten, H. D. (2019) · IEEE Access · doi:10.1109/access.2019.2919657 · Cited by 312
A Survey on Task Offloading in Multi-access Edge Computing
Islam, A., Debnath, A., Ghose, M., & Chakraborty, S. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102225 · Cited by 271
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“This requires more advanced computational resources and efficient algorithms to analyse the information across an entire video quickly (Anjum et al. 2016).”
Edge Video Analytics for Public Safety: A Review
Zhang, Q., Sun, H., Wu, X., & Zhong, H. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2925910 · Cited by 156
“[131] proposed an object detection and classification platform in clouds for high-performance video analysis, which provides a scalable solution for video analysis with minimum latency and user intervention, while object detection and classification are the basic tasks Fig.”
MethodCloud-based scalable object detection and classification in video streams
Yaseen, M. U., Anjum, A., Rana, O., & Hill, R. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.02.003 · Cited by 55
Self-citationKunpeng, Y., Shan, H., Sun, T., Hu, R., Wu, Y., Yu, L., Zhang, Z., & Quek, T. Q. S. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3073744 · Cited by 39
Scalable Big Data Pipeline for Video Stream Analytics Over Commodity Hardware
(2022) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2022.04.004 · Cited by 3
Metadata
- Authors
- Anjum, A., Abdullah, T., Tariq, M. F., Baltaci, Y., & Antonopoulos, N.
- Venue
- IEEE Transactions on Cloud Computing
- Published
- 2019-10-01
- Volume
- 7
- Issue
- 4
- Pages
- 1152-1167
- ISSN
- 2168-7161 (ISSN-L)
- 2372-0018
- OpenAlex
- W2342657743
- Cited by
- 99
- References
- 0
- FWCI
- 23.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.