Deep-Learning-Enhanced Multitarget Detection for End–Edge–Cloud Surveillance in Smart IoT
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Along with the rapid development of cloud computing, IoT, and AI technologies, cloud video surveillance (CVS) has become a hotly discussed topic, especially when facing the requirement of real-time analysis in smart applications. Object detection usually plays an important role for environment monitoring and activity tracking in surveillance system. The emerging edge-cloud computing paradigm provides us an opportunity to deal with the continuously generated huge amount of surveillance data in an on-site manner across IoT systems. However, the detection performance is still far away from satisfactions due to the complex surveilling environment. In this study, we focus on the multitarget detection for real-time surveillance in smart IoT systems. A newly designed deep neural network model called A-YONet, which is constructed by combining the advantages of YOLO and MTCNN, is proposed to be deployed in an end-edge-cloud surveillance system, in order to realize the lightweight training and feature learning with limited computing sources. An intelligent detection algorithm is then developed based on a preadjusting scheme of anchor box and a multilevel feature fusion mechanism. Experiments and evaluations using two data sets, including one public data set and one homemade data set obtained in a real surveillance system, demonstrate the effectiveness of our proposed method in enhancing training efficiency and detection precision, especially for multitarget detection in smart IoT application developments.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
(2016) · Cited by 31,590
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 1×
“Liu et al. [22] constructed a single deep neural network, which could generate multiple feature maps to detect objects with various sizes.”
BackgroundSqueeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Face aging with conditional generative adversarial networks
Antipov, G., Baccouche, M., & Dugelay, J.-L. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296650 · Cited by 515
Real-Time Video Analytics: The Killer App for Edge Computing
Ananthanarayanan, G., Bahl, P., Bodik, P., Chintalapudi, K., Philipose, M., Ravindranath, L., & Sinha, S. (2017) · Computer · doi:10.1109/mc.2017.3641638 · Cited by 496 · cited 1×
“Ananthanarayanan et al. [13] discussed the application of edge computing to CVS.”
BackgroundA survey on face detection in the wild: Past, present and future
Zafeiriou, S., Zhang, C., & Zhang, Z. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.03.015 · Cited by 458
Fast Adaptive Task Offloading in Edge Computing Based on Meta Reinforcement Learning
Wang, J., Hu, J., Min, G., Zomaya, A. Y., & Georgalas, N. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3014896 · Cited by 414
Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.002 · Cited by 394
Chen, Z., Hu, J., Min, G., Zomaya, A. Y., & El-Ghazawi, T. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2953745 · Cited by 212
Edge Computing with Cloud for Voice Disorder Assessment and Treatment
Muhammad, G., Alhamid, M. F., Alsulaiman, M., & Gupta, B. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700790 · Cited by 137
Scalable Cloud–Sensor Architecture for the Internet of Things
Xu, Y., & Helal, S. (2015) · IEEE Internet of Things Journal · doi:10.1109/jiot.2015.2455555 · Cited by 121
Multiplex Labeling Graph for Near-Online Tracking in Crowded Scenes
Zhang, Y., Sheng, H., Wu, Y., Wang, S., Ke, W., & Xiong, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2996609 · Cited by 100
Wireless acoustic sensor networks and edge computing for rapid acoustic monitoring
Sheng, Z., Pfersich, S., Eldridge, A., Zhou, J., Tian, D., & Leung, V. C. M. (2019) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2019.1911324 · Cited by 79
Mobile Charging as a Service: A Reservation-Based Approach
Zhang, X., Cao, Y., Peng, L., Li, J., Ahmad, N., & Yu, S. (2020) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.2983819 · Cited by 79
Exploring Deep Learning Models for Overhead View Multiple Object Detection
Ahmed, I., Din, S., Jeon, G., & Piccialli, F. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2951365 · Cited by 73
Optimized 3D Lighting Environment Estimation for Image Forgery Detection
Peng, B., Wang, W., Dong, J., & Tan, T. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2623589 · Cited by 73
Elastic urban video surveillance system using edge computing
Wang, J., Pan, J., & Esposito, F. (2017) · Proceedings of the Workshop on Smart Internet of Things · doi:10.1145/3132479.3132490 · Cited by 62
Foreground Segmentation with Tree-Structured Sparse RPCA
Ebadi, S. E., & Ebroul Izquierdo, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2745573 · Cited by 52
Distributed and Efficient Object Detection via Interactions Among Devices, Edge, and Cloud
Guo, Y., Zou, B., Ren, J., Liu, Q., Zhang, D., & Zhang, Y. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2912703 · Cited by 52
Sun, H., Shi, W., Liang, X., & Yu, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2936504 · Cited by 45
Improved 3D lighting environment estimation for image forgery detection
Peng, B., Wang, W., Dong, J., & Tan, T. (2015) · 2015 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2015.7368587 · Cited by 40
Context-Aware Object Detection for Vehicular Networks Based on Edge-Cloud Cooperation
Guo, J., Song, B., Chen, S., Yu, F. R., Du, X., & Guizani, M. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2949633 · Cited by 36
MEC Intelligence Driven Electro-Mobility Management for Battery Switch Service
Cao, Y., Zhang, X., Zhou, B., Duan, X., Tian, D., & Dai, X. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3004117 · Cited by 29
Secure and distributed video surveillance via portable devices
Albano, P., Bruno, A., Carpentieri, B., Castiglione, A., Castiglione, A., Palmieri, F., Pizzolante, R., Yim, K., & You, I. (2013) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-013-0181-z · Cited by 28
Scalable Mobile Sensing for Smart Cities: The MUSANet Experience
Meslin, A. M., Rodriguez, N. D. L. R., & Endler, M. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2977298 · Cited by 20
KPNet: Towards Minimal Face Detector
Song, G., Liu, Y., Zang, Y., Wang, X., Leng, B., & Yuan, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6878 · Cited by 8
Research works printed but not linked: 1
- zhang, 2017, Advances and perspectives on applications of deep learning in visual object detection, ACTA Automatica Sinica, 43, 1289
Cited by
Zhou, X., Liang, W., Li, W., Yan, K., Shimizu, S., & Wang, K. I.-K. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3130434 · Cited by 325
Self-citationHighly accurate energy consumption forecasting model based on parallel LSTM neural networks
Jin, N., Yang, F., Mo, Y., Zeng, Y., Zhou, X., Yan, K., & Ma, X. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2021.101442 · Cited by 161
Self-citationQi, L., Yang, Y., Zhou, X., Rafique, W., & Ma, J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3139363 · Cited by 170
Self-citationReconstructed Graph Neural Network With Knowledge Distillation for Lightweight Anomaly Detection
Zhou, X., Wu, J., Liang, W., Wang, K. I.-K., Yan, Z., Yang, L. T., & Jin, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3389714 · Cited by 145
“Another limitation of GCN is that the model needs to be trained based on the fixed graph data, which makes it difficult to deploy the GCN model in smart IoT scenarios where the connection of nodes may change very frequently [15].”
MethodSelf-citationA Survey of Video Surveillance Systems in Smart City
Myagmar-Ochir, Y., & Kim, W. (2023) · Electronics · doi:10.3390/electronics12173567 · Cited by 134
“The processing is closer to the data source, which reduces latency and workload on the central cloud for faster response times [36,37].”
Background
Metadata
- Authors
- Zhou, X., Xu, X., Liang, W., Zeng, Z., & Yan, Z.
- Affiliations
- Shiga University (JP)
- Hunan University of Technology and Business (CN)
- Xidian University (CN)
- Venue
- IEEE Internet of Things Journal
- Published
- 2021-08-15
- Volume
- 8
- Issue
- 16
- Pages
- 12588-12596
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W3164675724
- Cited by
- 332
- References
- 27
- Citations by year
- 2026: 18 · 2025: 57 · 2024: 53 · 2023: 97 · 2022: 85 · 2021: 22
- FWCI
- 23.08
- Type
- journal article
- Language
- en
- Open access
- green
- research.aalto.fi
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Aaltodoc (Aalto University) (submittedVersion, other-oa)
- Funders
- National Key Research and Development Program of China (2017YFE0117500, 2019YFE0190500, 2020YFC0832700, 2019YFB1705200, 2019GK1010)
- National Natural Science Foundation of China (72088101, 91846301, 72091515, 71991463, 62072171)
- Natural Science Foundation of Hunan Province of China (2019JJ40150)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Keywords
- multi-target detection, YOLO, MTCNN, multi-level feature fusion, lightweight neural networks, real-time object detection, resource-constrained devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.