Edge Computing Framework for Cooperative Video Processing in Multimedia IoT Systems
Abstract
Multimedia Internet-of-Things (IoT) systems have been widely used in surveillance, automatic behavior analysis and event recognition, which integrate image processing, computer vision, and networking capabilities. In conventional multimedia IoT systems, videos captured by surveillance cameras are required to be delivered to remote IoT servers for video analysis. However, the long-distance transmission of a large volume of video chunks may cause congestions and delays due to limited network bandwidth. Nowadays, mobile devices, e.g., smart phones and tablets, are resource-abundant in computation and communication capabilities. Thus, these devices have the potential to extract features from videos for the remote IoT servers. By sending back only a few video features to the remote servers, the bandwidth starvation of delivering original video chunks can be avoided. In this paper, we propose an edge computing framework to enable cooperative processing on resource-abundant mobile devices for delay-sensitive multimedia IoT tasks. We identify that the key challenges in the proposed edge computing framework are to optimally form mobile devices into video processing groups and to dispatch video chunks to proper video processing groups. Based on the derived optimal matching theorem, we put forward a cooperative video processing scheme formed by two efficient algorithms to tackle above challenges, which achieves suboptimal performance on the human detection accuracy. The proposed scheme has been evaluated under diverse parameter settings. Extensive simulation confirms the superiority of the proposed scheme over other two baseline schemes.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
The Internet of Things: A survey
Atzori, L., Iera, A., & Morabito, G. (2010) · Computer Networks · doi:10.1016/j.comnet.2010.05.010 · Cited by 15,613 · see citing works
Edge-centric Computing: Vision and Challenges
Garcia Lopez, P., Montresor, A., Epema, D., Datta, A., Higashino, T., Iamnitchi, A., Barcellos, M., Felber, P., & Riviere, E. (2015) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2831347.2831354 · Cited by 934 · see citing works
Challenges and opportunities in edge computing
Varghese, B., Wang, N., Barbhuiya, S., Kilpatrick, P., & Nikolopoulos, D. S. (2016) · 2016 IEEE International Conference on Smart Cloud (SmartCloud) · doi:10.1109/smartcloud.2016.18 · Cited by 565 · see citing works
Combinatorial auctions with decreasing marginal utilities
Lehmann, B., Lehmann, D. J., & Nisan, N. (2005) · Games and Economic Behavior · doi:10.1016/j.geb.2005.02.006 · Cited by 472 · see citing works
Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems
Veeravalli, B., Ghose, D., & Robertazzi, T. G. (2003) · Cluster Computing · doi:10.1023/a:1020958815308 · Cited by 296 · see citing works
Energy Efficient Cooperative Computing in Mobile Wireless Sensor Networks
Sheng, Z., Mahapatra, C., Leung, V. C. M., et al. (2015) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2015.2458272 · Cited by 167 · see citing works
Halpern, M., Zhu, Y., & Reddi, V. J. (2016) · Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings · doi:10.1109/hpca.2016.7446054 · Cited by 148 · see citing works
Social-Aware Video Multicast Based on Device-to-Device Communications
Cao, Y., Jiang, T., Chen, X., & Zhang, J. (2015) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2015.2461214 · Cited by 99 · see citing works
Self-citationA Survey of Emerging M2M Systems: Context, Task, and Objective
Cao, Y., Jiang, T., & Han, Z. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2582540 · Cited by 80 · see citing works
Self-citationQuality of Experience in the Multimedia Internet of Things: Definition and practical use-cases
Floris, A., & Atzori, L. (2015) · 2015 IEEE International Conference on Communication Workshop (ICCW) · doi:10.1109/iccw.2015.7247433 · Cited by 62 · see citing works
Real-Time Divisible Load Scheduling for Cluster Computing
Lin, X., Lü, Y., Deogun, J. S., et al. (2007) · Proceedings - Real-Time Technology and Applications Symposium · doi:10.1109/rtas.2007.29 · Cited by 58 · see citing works
Chen, X., Hwang, J., Meng, D., Lee, K.-H., de Queiroz, R. L., & Yeh, F. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2539758 · Cited by 56 · see citing works
Share communication and computation resources on mobile devices: a social awareness perspective
Cao, Y., Long, C., Jiang, T., et al. (2016) · IEEE Wireless Communications · doi:10.1109/mwc.2016.7553026 · Cited by 51 · see citing works
Self-citationEnhancing Video Event Recognition Using Automatically Constructed Semantic-Visual Knowledge Base
Zhang, X., Yang, Y., Zhang, Y., Luan, H., Li, J., Zhang, H., & Chua, T. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2449660 · Cited by 38 · see citing works
A branch-and-cut algorithm for the Winner Determination Problem
Escudero, L. F., Landete, M., & Marı́n, A. (2008) · Decision Support Systems · doi:10.1016/j.dss.2008.10.009 · Cited by 34 · see citing works
Predictive Distributed Visual Analysis for Video in Wireless Sensor Networks
Eriksson, E., Dán, G., & Fodor, V. (2015) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2015.2465390 · Cited by 27 · see citing works
Foreword (Special Issue of Cluster Computing on Divisible Load Scheduling)
Ghose, D., & Robertazzi, T. G. (2003) · Cluster Computing · doi:10.1023/a:1020902731238 · Cited by 22 · see citing works
A visual sensor network for object recognition: Testbed realization
Redondi, A. E. C., Baroffio, L., Canclini, A., et al. (2013) · doi:10.1109/icdsp.2013.6622789 · Cited by 20 · see citing works
Greedy Signature Processing with Arbitrary Location Distributions: A Divisible Load Framework
Kyong, Y., & Robertazzi, T. G. (2012) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2012.6324675 · Cited by 11 · see citing works
PPDD: scheduling multi-site divisible loads in single-level tree networks
Li, X., & Veeravalli, B. (2009) · Cluster Computing · doi:10.1007/s10586-009-0103-1 · Cited by 9 · see citing works
An Efficient Algorithm for Real-Time Divisible Load Scheduling
Mamat, A., Lü, Y., Deogun, J. S., et al. (2010) · Proceedings - Real-Time Technology and Applications Symposium · doi:10.1109/rtas.2010.29 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey
Barakabitze, A. A., Barman, N., Ahmad, A., Zadtootaghaj, S., Sun, L., Martini, M. G., & Atzori, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2958784 · Cited by 239 · see citing works
Liu, M., Yu, F. R., Teng, Y., Leung, V. C. M., & Song, M. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2885266 · Cited by 233 · see citing works
IoT-based smart healthcare video surveillance system using edge computing
Rajavel, R., Ravichandran, S. K., Harimoorthy, K., Nagappan, P., & Gobichettipalayam, K. R. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03157-1 · Cited by 174 · see citing works
Communication Protocols of an Industrial Internet of Things Environment: A Comparative Study
Jaloudi, S. (2019) · Future Internet · doi:10.3390/fi11030066 · Cited by 131 · see citing works
- Authors
- Long, C., Cao, Y., Jiang, T., & Zhang, Q.
- Affiliations
- Huazhong University of Science and Technology (CN)
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Multimedia
- Published
- 2018-05
- Volume
- 20
- Issue
- 5
- Pages
- 1126-1139
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2766827306
- Cited by
- 222
- References
- 21
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 26 · 2023: 20 · 2022: 30 · 2021: 30 · 2020: 39 · 2019: 40 · 2018: 21 · 2017: 1
- FWCI
- 18.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Multimedia (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- National Natural Science Foundation of China (61601193, 61729101, 61631015, 61720106001)
- Major Program of National Natural Science Foundation of Hubei in China (2016CFA009)
- Independent Innovation Research Fund of Huazhong University of Science and Technology (2016YXMS305)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Keywords
- edge computing, mobile devices, optimal matching, human detection, surveillance video analysis, delay-sensitive tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
