Application of region-based video surveillance in smart cities using deep learning
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Smart video surveillance helps to build more robust smart city environment. The varied angle cameras act as smart sensors and collect visual data from smart city environment and transmit it for further visual analysis. The transmitted visual data is required to be in high quality for efficient analysis which is a challenging task while transmitting videos on low capacity bandwidth communication channels. In latest smart surveillance cameras, high quality of video transmission is maintained through various video encoding techniques such as high efficiency video coding. However, these video coding techniques still provide limited capabilities and the demand of high-quality based encoding for salient regions such as pedestrians, vehicles, cyclist/motorcyclist and road in video surveillance systems is still not met. This work is a contribution towards building an efficient salient region-based surveillance framework for smart cities. The proposed framework integrates a deep learning-based video surveillance technique that extracts salient regions from a video frame without information loss, and then encodes it in reduced size. We have applied this approach in diverse case studies environments of smart city to test the applicability of the framework. The successful result in terms of bitrate 56.92%, peak signal to noise ratio 5.35 bd and SR based segmentation accuracy of 92% and 96% for two different benchmark datasets is the outcome of proposed work. Consequently, the generation of less computational region-based video data makes it adaptable to improve surveillance solution in Smart Cities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Video compression involves reducing the size of video data to make it easier to store and transmit without sacrificing too much quality, which optimizes the use of bandwidth and reduces the cost of data storage and the transmission time [29,33].”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [29]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Specifying an ROI retains the quality of the most pertinent information in a transmission and reduces the amount of data transmitted, which increases the efficiency and bandwidth of a network utility [28][29][30][31][32].”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“Content filtering [22], compression [29], caching [169], and dynamic content delivery [50] techniques may be used to ensure efficient bandwidth utilization.”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263 · cited 1×
“D transforms [44], scaling and quantization [46] module.”
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422 · cited 3×
“The state-of-the-art DL techniques for semantic segmentation include SegNet [3], U-Net [36], fully convolution network (FCN) [39] and deconvolution network [34].”
Distance transformations in digital images
Borgefors, G. (1986) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(86)80047-0 · Cited by 1,898 · cited 1×
“Next, a for each S-R is generated using distance transform [7].”
ViBe: A Universal Background Subtraction Algorithm for Video Sequences
Barnich, O., & Van Droogenbroeck, M. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2101613 · Cited by 1,885 · cited 1×
“A fast coding unit (CU) depth level selection method is proposed in [4] that can be enhanced along with rate-distortion by extracting regions of interest (RoIs) in smart city surveillance.”
Proceedings. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.3 · Cited by 1,083
Azimi, M., Eslamlou, A., & Pekcan, G. (2020) · Sensors · doi:10.3390/s20102778 · Cited by 769
Survey on semantic segmentation using deep learning techniques
Lateef, F., & Ruichek, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.003 · Cited by 559 · cited 1×
“Utilizing semantic segmentation for S-R extraction can be beneficial for multiple object identification that provides efficient video surveillance [29].”
Abnormal behavior recognition for intelligent video surveillance systems: A review
Ben Mabrouk, A., & Zagrouba, E. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.029 · Cited by 361
3D High-Efficiency Video Coding for Multi-View Video and Depth Data
Müller, K., Schwarz, H., Marpe, D., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Rhee, F. H., et al. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2264820 · Cited by 353 · cited 2×
“The comparison of different environments video sequences such ad Main-road [12], Cross-road [23], Bank [49], and Dash-cam [33] is presented in Fig.”
Smart cities survey: Technologies, application domains and challenges for the cities of the future
Sánchez-Corcuera, R., Nuñez-Marcos, A., Sesma-Solance, J., Bilbao-Jayo, A., Mulero, R., Zulaika, U., Azkune, G., & Almeida, A. (2019) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719853984 · Cited by 331 · cited 1×
“In [37] Ruben et al., carried out a survey on video surveillance systems current status and future trends.”
Chen, C. W., Luo, J., & Parker, K. J. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.730379 · Cited by 293 · cited 2×
“In [41], a FCN for semantic segmentation based on VGGNet [50], GoogleNet [19] and ResNet [10] is presented.”
MethodThe Sensable City: A Survey on the Deployment and Management for Smart City Monitoring
Du, R., Santi, P., Xiao, M., Vasilakos, A. V., & Fischione, C. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2881008 · Cited by 289 · cited 2×
“There are several applications which helps to structure basic services of smart city such as smart traffic management and enhanced public security [5, 14].”
Self-Supervised Video Hashing With Hierarchical Binary Auto-Encoder
Song, J., Zhang, H., Li, X., Gao, L., Wang, M., & Hong, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2814344 · Cited by 276 · cited 1×
“In literature, a number of video encoding mechanisms have already been developed, e.g., video hashing and video compression algorithms [42] etc. Modern smart city surveillance cameras are equipped with video coding techniques such as High-efficiency video coding (H.265/HEVC) [40] developed by the…”
Image compression techniques: A survey in lossless and lossy algorithms
Hussain, A. J., Al-Fayadh, A., & Radi, N. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.02.094 · Cited by 275 · cited 1×
“The HEVC video compression is beneficial for reducing bit-rate, but the quality of the video is also affected [21].”
BackgroundHigh Throughput CABAC Entropy Coding in HEVC
Sze, V., & Budagavi, M. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221526 · Cited by 208 · cited 2×
“We video encoding comparison we have compared ESSE framework with PICO [46] that applies deep learning by using two test video sequences “PeopleOnRoad” and “Traffic” from JCT-VC [6] in Fig.”
A Short Review on Different Clustering Techniques and Their Applications
Ghosal, A., Nandy, A., Das, A. K., Goswami, S., & Panday, M. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-7403-6_9 · Cited by 199 · cited 1×
“The conventional ML image segmentation techniques can be used for salient region extraction. i.e., K-means [10], Density-based spatial clustering of applications with noise (DBSCAN) [15], mean-shift and fuzzy c-means [17].”
MethodRCNet: road classification convolutional neural networks for intelligent vehicle system
Dewangan, D. K., & Sahu, S. P. (2021) · Intelligent Service Robotics · doi:10.1007/s11370-020-00343-6 · Cited by 123 · cited 2×
“Next, we compared with the state-of-the-art segmentation methods, including SegNet [43], U-Net [13], and deconvolution network (DN) [45] in Fig.”
MethodIntelligent Transportation System (ITS) for Smart-Cities using Mamdani Fuzzy Inference System
Iqbal, K., Khan, M. A., Abbas, S., Hasan, M. Z., & Fatima, A. (2018) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2018.090215 · Cited by 111 · cited 1×
“Kashif et al., in [24] presented video surveillance for transportation in smart city environment.”
Deep learning support for intelligent transportation systems
Guerrero‐Ibañez, J., Contreras-Castillo, J. J., & Zeadally, S. (2020) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4169 · Cited by 90 · cited 1×
“Deep-learning (DL) techniques performed tremendously well in smart city surveillance applications such as remote monitoring [2], transport management systems and road safety management systems [18].”
A Survey on Compressed Sensing in Vehicular Infotainment Systems
Guo, J., Song, B., He, Y., Yu, F. R., & Sookhak, M. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2705027 · Cited by 89
Shen, Y., Li, J., Zhu, Z., & Zhang, Y. (2014) · Chinese Journal of Computers · doi:10.3724/sp.j.1016.2013.02340 · Cited by 77
Intelligent traffic monitoring and guidance system for smart city
Latif, S., Afzaal, H., & Zafar, N. A. (2018) · 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET) · doi:10.1109/icomet.2018.8346327 · Cited by 74 · cited 1×
“In [30] Saba et al., also opposed vehicular guidance systems based on wireless visual networks for smart city.”
Weight-based R-λ rate control for perceptual HEVC coding on conversational videos
Li, S., Xu, M., Deng, X., & Wang, Z. (2015) · Signal Processing Image Communication · doi:10.1016/j.image.2015.04.011 · Cited by 55 · cited 2×
“In [31], HEVC based rate control technique is explored, which was related smart city visual surveillance and smart video conferencing for better quality RoI encoding by leaving the rest of the image in low quality.”
Song, H., Yang, W. T., Bai, Y., & Xu, X. (2015) · International Journal of Remote Sensing · doi:10.1080/01431161.2015.1043759 · Cited by 48 · cited 2×
“The researchers presented RoI selection based technique by using super-pixel in [41].”
MethodHwang, S., Kim, N., Choi, Y., Lee, S., & Kweon, I. S. (2016) · 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) · doi:10.1109/urai.2016.7625744 · Cited by 46 · cited 1×
“[22] proposed multi-object detection and tracking, which focuses on the segmentation of road objects such as vehicles and pedestrians.”
An intelligent decision computing paradigm for crowd monitoring in the smart city
Kumar, S., Datta, D., Singh, S. K., & Sangaiah, A. K. (2018) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2017.03.002 · Cited by 43 · cited 1×
“Another application of smart city surveillance is crowd monitoring presented in [28] where the authors proposed an intelligent computing based framework, the optimization algorithm is applied to compute the feature of crowd motion and measure the correlation between agents based motion model and…”
BackgroundHand2Face: Automatic synthesis and recognition of hand over face occlusions
Nojavanasghari, B., Hughes, C. E., Baltrušaitis, T., & Morency, L. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273602 · Cited by 19
Kim, B. (2016) · The Journal of Supercomputing · doi:10.1007/s11227-016-1730-y · Cited by 15 · cited 1×
“Kim et al., in [26], was proposed fast CU based HEVC compression for the internet-of-things environment and smart city surveillance.”
BackgroundXiao, J., Wang, Z., Chen, Y., Liao, L., Xiao, J., Zhan, G., & Hu, R. (2016) · Software Practice and Experience · doi:10.1002/spe.2430 · Cited by 14 · cited 2×
“The existing video encoding techniques reduces the resolution ratio of surveillance video, which also affects the performance of video analysis tasks, e.g., object/road localization, detection and recognition, vehicle tracking, and crowd monitoring [50].”
Perceptual-Based HEVC Intra Coding Optimization Using Deep Convolution Networks
Sun, X., Ma, H., Zuo, W., & Liu, M. (2019) · IEEE Access · doi:10.1109/access.2019.2910245 · Cited by 13
Varying face occlusion detection and iterative recovery for face recognition
Wang, M., Hu, Z., Sun, Z., Zhao, S., & Sun, M. (2017) · Journal of Electronic Imaging · doi:10.1117/1.jei.26.3.033009 · Cited by 12
Koziri, M. G., Papadopoulos, P. K., Tziritas, N., Dadaliaris, A. N., Loukopoulos, T., & Stamoulis, G. I. (2017) · Social Network Analysis and Mining · doi:10.1007/s13278-017-0450-5 · Cited by 7 · cited 2×
“Accordingly, these evaluation matrices use a confusion matrix C of pixel level, which sums inferences for all the images of dataset as given in (2) [27].”
MethodTraffic Surveillance for Smart City in Internet of Things Environment
Choksi, M., Zaveri, M. A., & Anand, S. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-01057-7_16 · Cited by 6 · cited 1×
“HEVC based video coding is used in surveillance for city areas, such as presented in [11].”
MethodSantos, C., Conceição, R., Agostini, L. V., Corrêa, G., Zatt, B., & Porto, M. (2017) · Brazilian Symposium on Multimedia and the Web · doi:10.1145/3126858.3131599 · Cited by 2 · cited 1×
“In [38] Cristiano et al., presented a region of interest (RoI) based video encoding for video conferencing application.”
BackgroundIntelligent Transportation System: A Survey
Morkh, D. S., & ikar, S. S. A. (2020) · doi:10.5373/jardcs/v12sp5/20201732 · Cited by 1 · cited 1×
“Traffic monitoring and guiding system presented in [32] where the authors did extensive study and presented survey for traffic management application in smart city environment.”
Research works printed but not linked: 1
- Ester M, Kriegel H-P, Sander J, Xu X (1996) Density-based spatial clustering of applications with noise. In: International conference knowledge discovery and data mining
Cited by
Anomaly detection using edge computing in video surveillance system: review
Patrikar, D. R., & Parate, M. R. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00227-8 · Cited by 177
“DNNs are a popular choice for smart city [160] including intelligent parking systems [49], vehicle classification and traffic flow prediction [11], to prevent vehicle accidents [36].”
BackgroundA Survey of Video Surveillance Systems in Smart City
Myagmar-Ochir, Y., & Kim, W. (2023) · Electronics · doi:10.3390/electronics12173567 · Cited by 134
“Zahra et al. [29] proposed the ESSE (efficient shallow segmentation-based encoding) framework for video surveillance to identify suspicious people or vehicles and to detect traffic patterns and road conditions.”
BackgroundMethodA Survey on Adaptive Smart Urban Systems
Bittencourt, J. C. N., Costa, D. G., Portugal, P., & Vasques, F. (2024) · IEEE Access · doi:10.1109/access.2024.3433381 · Cited by 68
“The study of [109] contributes to the field of crime prevention to predict crime locations and simulate suspect vehicle movements.”
BackgroundDeep BiLSTM Attention Model for Spatial and Temporal Anomaly Detection in Video Surveillance
Natha, S. A. S., Ahmed, F., Siraj, M., Leghari, M., Altamimi, M. L., & Chandio, A. A. (2025) · Sensors · doi:10.3390/s25010251 · Cited by 58
Video surveillance in smart cities: current status, challenges & future directions
Sharma, H., & Kanwal, N. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19696-6 · Cited by 50
Metadata
- Authors
- Zahra, A., Ghafoor, M., Munir, K., Ullah, A., & Ul Abideen, Z.
- Affiliations
- COMSATS University Islamabad (PK)
- University of Lincoln (GB)
- University of the West of England (GB)
- National University of Modern Languages (PK)
- Corresponding author
- Ghafoor, Mubeen
- Venue
- Multimedia Tools and Applications
- Published
- 2021-12-27
- Volume
- 83
- Issue
- 5
- Pages
- 15313-15338
- ISSN
- 1380-7501 (ISSN-L)
- 1573-7721
- PMC
- PMC8710820
- OpenAlex
- W4200558008
- Cited by
- 53
- References
- 39
- Citations by year
- 2026: 14 · 2025: 21 · 2024: 12 · 2023: 5 · 2022: 1
- FWCI
- 2.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Multimedia Tools and Applications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Lincoln Repository (University of Lincoln) (acceptedVersion)
- UWE Research Repository (UWE Bristol) (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- smart cities, salient region extraction, video compression, HEVC, low-bandwidth video transmission, deep learning, video segmentation, bit rate reduction, PSNR
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.