Ultra Large-Scale Crowd Monitoring System Architecture and Design Issues
The DOI matches its Crossref record; 44 of the 47 references it cites were found in a registry or an index.
Abstract
This article proposes a novel ultralarge-scale crowd monitoring system, namely, the ULCM system. The ULCM system enables advanced sensing and networking technologies aimed at collecting and processing multimodal, multiperspective, and real-time crowding data relevant to crowd management. This data will be further analyzed to provide a global realization of evolving events over a large geographical area as they occur in real time. The ULCM is the infrastructure component of an intelligent platform that is being developed by our research group to provide crowd intelligence to decision makers through an interactive digitized visual environment. In order to achieve a full comprehensive scene overview, the ULCM deployment utilizes a multiplicity of unmanned aerial vehicle (UAV) agents in different operational scenarios. The aerial deployment and control are realized by custom multiple UAV networks and airborne LiDAR sensors. The deployment and control on the ground sensory agents are based on multiple subnetworks, including closed-circuit television (CCTV) and infrared gas and ultrasonic sensors networks. Eventually, ULCM employs the software-defined network (SDN) and edge cloud technologies to optimize the networking and data analytics performance from the perspective of infrastructure.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another option to detect and track persons is represented by light detection and ranging (LiDAR) sensors, especially in environments where there are several interacting people [120].”
From Sensing Technologies for Crowd Management, Adaptation, and Information Dissemination in Public Transportation Systems: A Review (2023) · cites this paper as [120]
Citations
Cites
Single-Image Crowd Counting via Multi-Column Convolutional Neural Network
Zhang, Y., Zhou, D., Chen, S., Gao, S., & Ma, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.70 · Cited by 2,241 · cited 1×
“However, the system was also oriented to normal and large-scale crowds. set [11], image (b) is from the ShanghaiTech part_B data set [12], images (c), (d), and (f) are from the UCF-QNRF data set [13], and image (e) is from the Shetu website [14].”
MethodPrivacy preserving crowd monitoring: Counting people without people models or tracking
Chan, A. B., Liang, Z.-S. J., & Vasconcelos, N. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587569 · Cited by 1,172 · cited 1×
“However, the system was also oriented to normal and large-scale crowds. set [11], image (b) is from the ShanghaiTech part_B data set [12], images (c), (d), and (f) are from the UCF-QNRF data set [13], and image (e) is from the Shetu website [14].”
MethodComposition Loss for Counting, Density Map Estimation and Localization in Dense Crowds
Idrees, H., Tayyab, M., Athrey, K., Zhang, D., Al-Maadeed, S., Rajpoot, N., & Shah, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_33 · Cited by 851
A survey on software-defined network and openflow: From concept to implementation
Hu, F., Hao, Q., & Bao, K. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2326417 · Cited by 752 · cited 1×
“3 protocol is used as the South ports protocol of the SDN controller with a sensor network and a UAV network [52].”
MethodBayesian Loss for Crowd Count Estimation With Point Supervision
Ma, Z., Wei, X., Hong, X., & Gong, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00624 · Cited by 617 · cited 1×
“9 is from [13] and the Bayesian loss model in [53].”
BackgroundOpenDaylight: Towards a Model-Driven SDN Controller architecture
Medved, J., Varga, R., Tkacik, A., & Gray, K. (2014) · Proceeding of IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks 2014 · doi:10.1109/wowmom.2014.6918985 · Cited by 561 · cited 1×
“ODL offers South ports for the plane communication with data and North ports for plane communication with application programs [51].”
BackgroundAbnormal event detection in videos using generative adversarial nets
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C., & Sebe, N. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296547 · Cited by 515 · cited 1×
“Ravanbakhsh et al. [9] proposed using the GAN network to recognize abnormal crowd behavior.”
MethodUAV assistance paradigm: State-of-the-art in applications and challenges
Alzahrani, B., Oubbati, O. S., Barnawi, A., Atiquzzaman, M., & Alghazzawi, D. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102706 · Cited by 437 · cited 1×
“UAV computer read data from the ZigBee module; then WiFi communication is used to transmit data to the ground station [44].”
MethodSelf-citationSecuring the Software Defined Network Control Layer
Porras, P., Cheung, S., Fong, M., Skinner, K., & Yegneswaran, V. (2015) · Proceedings 2015 Network and Distributed System Security Symposium · doi:10.14722/ndss.2015.23222 · Cited by 215 · cited 1×
“Ethernet is used to connect the router and it interconnects with the gateway and Web terminals [49], [50].”
From Open Set to Closed Set: Counting Objects by Spatial Divide-and-Conquer
Xiong, H., Lu, H., Liu, C., Liu, L., Cao, Z., & Shen, C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00845 · Cited by 197 · cited 1×
“Xiong et al. [7] proposed a spatial divide-and-conquer network to perform population statistics on large-scale population data sets, such as UCF and ShanghaiTech.”
BackgroundSurvey of Consistent Software-Defined Network Updates
Foerster, K.-T., Schmid, S., & Vissicchio, S. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2876749 · Cited by 192 · cited 1×
“SDN controller is deployed in the server of the control room and used as a logic center to complete task allocation and monitoring [47].”
MethodModelling and simulation of Opportunistic IoT Services with Aggregate Computing
Casadei, R., Fortino, G., Pianini, D., Russo, W., Savaglio, C., & Viroli, M. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2018.09.005 · Cited by 142 · cited 1×
“Due to the development and various services of the Internet of Things (IoT) [10], the gas sensor detected dangerous or poisonous gas in the super-large crowd in order to prevent a fire disaster.”
BackgroundRouting for Crowd Management in Smart Cities: A Deep Reinforcement Learning Perspective
Zhao, L., Wang, J., Liu, J., & Kato, N. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800603 · Cited by 126 · cited 1×
“Zhao et al. [24] proposed a routing algorithm based on deep reinforced learning that can be used in the crowd management system of a smart city.”
BackgroundLabel-less Learning for Emotion Cognition
Chen, M., & Hao, Y. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2929071 · Cited by 123 · cited 1×
“3 based on ZigBee communication has the characteristics of low cost, low power consumption, low delay, low complexity, and self-organization [35].”
BackgroundIntelligent Evacuation Management Systems: A Review
Ibrahim, A. M., Venkat, I., Subramanian, K. G., Khader, A. T., & Wilde, P. D. (2016) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2842630 · Cited by 111
Opportunistic Task Scheduling over Co-Located Clouds in Mobile Environment
Chen, M., Hao, Y., Lai, C.-F., Wu, D., Li, Y., & Hwang, K. (2018) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2016.2589247 · Cited by 108 · cited 1×
“It collects the sensor data and sends to the edge cloud [38].”
BackgroundA landscape of crowd-management support: An integrative approach
Wijermans, N., Conrado, C., van Steen, M. R., Martella, C., & Li, J. (2016) · Safety Science · doi:10.1016/j.ssci.2016.02.027 · Cited by 107 · cited 1×
“Wijermans et al. [5] proposed a comprehensive crowd management system that both perceived the state of the crowd through cameras and used microphones, smartphones, and social media to jointly monitor crowd activities.”
BackgroundScalable software defined network controllers
Voellmy, A., & Wang, J. (2012) · Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication · doi:10.1145/2342356.2342414 · Cited by 106 · cited 1×
“Ethernet is used to connect the router and it interconnects with the gateway and Web terminals [49], [50].”
MethodManaging Crowds with Wireless and Mobile Technologies
Yamin, M., Basahel, A. M., & Sen, A. A. A. (2018) · Wireless Communications and Mobile Computing · doi:10.1155/2018/7361597 · Cited by 101 · cited 1×
“Yamin et al. [23] proposed a framework of crowd control and health management based on RFID, wireless sensing, and mobile technology, which can be used to prevent stampede accidents.”
BackgroundPaDNet: Pan-Density Crowd Counting
Tian, Y., Lei, Y., Zhang, J., & Wang, J. Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2952083 · Cited by 97 · cited 1×
“Tian et al. [8] proposed a Pan-Density network to estimate the population density on data sets of different densities.”
BackgroundCognitive information measurements: A new perspective
Chen, M., Hao, Y., Gharavi, H., & Leung, V. C. M. (2019) · Information Sciences · doi:10.1016/j.ins.2019.07.046 · Cited by 86
A review on technological advancements in crowd management
Sharma, D., Bhondekar, A. P., Shukla, A. K., & Ghanshyam, C. (2016) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-016-0432-x · Cited by 83 · cited 1×
“Sharma et al. [15] summarized the technological progress of crowd planning and management systems and investigated the crowd data collection technology based on vision, wireless radio frequency, and social media.”
BackgroundA development approach for collective opportunistic Edge-of-Things services
Casadei, R., Fortino, G., Pianini, D., Russo, W., Savaglio, C., & Viroli, M. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.058 · Cited by 82 · cited 1×
“The sink node receives gas and ultrasonic data collected by sensor nodes and transmits the data to the edge cloud via Wi-Fi [40].”
MethodMitchell, R. O., Rashid, H. H. U., Dawood, F. I., & Al-Khalidi, A. M. M. (2013) · doi:10.1109/iccat.2013.6522008 · Cited by 76 · cited 1×
“Mitchell et al. [27] and Yamin and Albugami [28] integrated location-based services with RFID and mobile systems and proposed an integrated management architecture to improve the efficiency of positioning and navigation for pilgrims.”
BackgroundCrowd Monitoring and Classification: A Survey
Lamba, S., & Nain, N. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-3770-2_3 · Cited by 55
Savaglio, C., Gerace, P., Fatta, G. D., & Fortino, G. (2019) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn.2019.8846941 · Cited by 47 · cited 1×
“As data server and Web side, the edge cloud can receive data and allocate businesses [48].”
Mahmood, I., Haris, M., & Sarjoughian, H. S. (2017) · ACM/IEEE/SCS Workshop on Principles of Advanced and Distributed Simulation (PADS) · doi:10.1145/3064911.3064924 · Cited by 44 · cited 1×
“For the Hajj crowd evacuation plan, Mahmood et al. [33] and Namoun et al. [34] proposed an agent-based crowd simulation and analysis framework to predict the pilgrimage behavior pattern and provide emergency evacuation strategies based on crowd density, movement, and panic level.”
BackgroundAn intelligent decision computing paradigm for crowd monitoring in the smart city
Kumar, S., Datta, D., Singh, S. K., & Sangaiah, A. K. (2018) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2017.03.002 · Cited by 43 · cited 1×
“For the analysis of the crowd management system based on video data, Kumar et al. [21] suggested an intelligent urban crowd monitoring system based on intelligent decision computing that used the Kalman filter-ing and KL-divergency algorithm to compute sports features of the crowd and measured the…”
MethodKousiouris, G., Akbar, A., Sancho, J., Ta-Shma, P., Psychas, A., Kyriazis, D., & Varvarigou, T. A. (2017) · Future Generation Computer Systems · doi:10.1016/j.future.2017.07.026 · Cited by 40 · cited 1×
“Kousiouris et al. [20] also used social network data and integrated user data obtained from intelligent urban platforms to recognize the events of interest of the large-scale crowd.”
BackgroundTowards a Crowd Analytic Framework For Crowd Management in Majid-al-HaramPreprint
Khan, S. D., Tayyab, M. A., Amin, M. K., Nour, A., Basalamah, A. M., Basalamah, S. M., & Khan, S. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05952 · Cited by 37 · cited 1×
“For example, Khozium [25] and Khan et al. [26] used computer vision technology to analyze crowd flow and crowd density in real time based on video data, combine the width and length of the road to detect crowded locations, and formulate the priority of the road map.”
BackgroundDesign and implementation of ZigBee wireless sensor and control network system in greenhouse
Chen, F., Qin, L., Li, X., Wu, G., & Shi, C. (2017) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2017.8028786 · Cited by 31 · cited 1×
“In the network, the sensor node can not only communicate with its parent node but also transmit data to the other nodes or sink node based on the routing protocol designed by ZigBee module [36], [37].”
MethodAnalysis of Zigbee Data Transmission on Wireless Sensor Network Topology
Soijoyo, S., & Ashari, A. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080921 · Cited by 31 · cited 1×
“In the network, the sensor node can not only communicate with its parent node but also transmit data to the other nodes or sink node based on the routing protocol designed by ZigBee module [36], [37].”
MethodChen, M., Cao, Y., Wang, R., Li, Y., Wu, D., & Liu, Z. (2019) · IEEE Network · doi:10.1109/mnet.001.1900054 · Cited by 29 · cited 1×
“Since the current crowd monitoring system is mainly based on surveillance video data, the analysis of crowd activity status is also mainly based on video data and deep learning algorithms for crowd density, crowd counting, and abnormal behavior detection [6].”
BackgroundAn Architecture for Improving Hajj Management
Yamin, M., & Albugami, M. A. (2014) · IFIP advances in information and communication technology · doi:10.1007/978-3-642-55355-4_19 · Cited by 27 · cited 1×
“Mitchell et al. [27] and Yamin and Albugami [28] integrated location-based services with RFID and mobile systems and proposed an integrated management architecture to improve the efficiency of positioning and navigation for pilgrims.”
BackgroundA Simulation Study for UAV- Aided Wireless Sensor Network Utilizing ZigBee Protocol
Khalifeh, A. F., AlQudah, M., Tanash, R., & Darabkh, K. A. (2018) · IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob) · doi:10.1109/wimob.2018.8589109 · Cited by 22 · cited 3×
“There are two kinds of network communication protocols [39].”
BackgroundMethodInfluentialBio-inspired relevant interaction modelling in cognitive crowd management
Chiappino, S., Morerio, P., Marcenaro, L., & Regazzoni, C. S. (2014) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-014-0224-0 · Cited by 21 · cited 1×
“[22] proposed a bioinspired relevant interaction crowd management frame that can encode and synthesize signals, which can describe the behaviors of a single entity and simulate the causal relationship between user behaviors and change of environment as well.”
BackgroundAn expert crowd monitoring and management framework for Hajj
Nasser, N., Anan, M., Awad, M. F. C., Bin-Abbas, H., & Karim, L. (2017) · International Conference on Wireless Networks and Mobile Communications (WINCOM) · doi:10.1109/wincom.2017.8238202 · Cited by 21 · cited 1×
“Nasser et al. [30] proposed an expert crowd monitoring and management framework, which sets up monitoring units and a variety of sensor nodes on the way of pilgrimage to predict potential problems.”
BackgroundSecWIR: securing smart home IoT communications via wi-fi routers with embedded intelligence
Lei, X., Tu, G.-H., Li, C.-Y., Xie, T., & Zhang, M. (2020) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3386901.3388941 · Cited by 20 · cited 1×
“The CCTV and infrared thermal camera network based on Wi-Fi communication has the characteristics of flexibil-ity and scalability [41], [42].”
BackgroundCrowd Management Services in Hajj: A Mean-Field Game Theory Approach
Nasser, N., Ouadrhiri, A. E., Kamili, M. E., Ali, A., & Anan, M. (2019) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2019.8886019 · Cited by 19 · cited 1×
“[31] used the mean-field-game theory to provide a pilgrim crowd management service measure to guide”
MethodNgo, M. Q., Haghighi, P. D., & Burstein, F. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00751 · Cited by 18
Islam, S., Kafi, A., Islam, M. Z., Islam, N., & Ullah, M. N. (2019) · International Conference on Electrical Information and Communication Technology (EICT) · doi:10.1109/eict48899.2019.9068814 · Cited by 15 · cited 1×
“Islam et al. [32] used an e-twist belt to evaluate temperature, humidity, and attendance and analyzed the probability of stampede events, so as to avoid trampling and crowding events in advance.”
BackgroundA Hybrid Intelligent Information System for the Administration of Massive Mass of Hajjis
Khozium, M. O. (2012) · Cited by 12
An Improved Smartphone-Based Non-Participatory Crowd Monitoring System in Smart Environments
Kulshrestha, T., Saxena, D., Niyogi, R., Misra, M., & Patel, D. (2017) · IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC) · doi:10.1109/cse-euc.2017.209 · Cited by 8 · cited 1×
“Kulshrestha et al. [18] proposed a nonparticipatory crowd monitoring system based on smartphones.”
BackgroundCommunication network for remote monitoring of wind turbine based on infrared camera
Hussain, S., & Kim, Y.-C. (2017) · Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct.2017.8071296 · Cited by 3 · cited 1×
“The CCTV and infrared thermal camera network based on Wi-Fi communication has the characteristics of flexibil-ity and scalability [41], [42].”
Background
Research works printed but not linked: 10
- namoun, 2018, A multi-agent architecture for evacuating pilgrims in panic and emergency situations: The Hajj scenario, J Theor Appl Inf Technol, 96, 20
- yamin, 2016, Integrating social media and mobile apps into Hajj management, Proc IEEE 3rd Int Conf Comput Sustain Global Develop (INDIACom), 1368
- 2021, Taigusysy
- 2020, Cloudwalk
- 2021, Ultralytics
- 2021, 699pic
- 2020, Uniview
- 2021, HIKVISION
- 2020, Lidar
- 2020, AMOVLAB
Cited by
Labib, N. S., Brust, M. R., Danoy, G., & Bouvry, P. (2021) · IEEE Access · doi:10.1109/access.2021.3104963 · Cited by 162
“More recent studies propose novel large scale crowd monitoring systems [52] that take into consideration the privacy and security challenges of using UAVs for crowd monitoring [53].”
BackgroundTopology control algorithms in multi-unmanned aerial vehicle networks: An extensive survey
Alam, M. M., Arafat, M. Y., Moh, S., & Shen, J. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103495 · Cited by 129
Solving Hajj and Umrah Challenges Using Information and Communication Technology: A Survey
Showail, A. J. (2022) · IEEE Access · doi:10.1109/access.2022.3190853 · Cited by 78
Darsena, D., Gelli, G., Iudice, I., & Verde, F. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3223297 · Cited by 71
“environments where there are several interacting people [120].”
BackgroundReview of analyses on crowd-gathering risk and its evaluation methods
Weng, W., Wang, J., Shen, L., & Song, Y. (2022) · Journal of Safety Science and Resilience · doi:10.1016/j.jnlssr.2022.10.004 · Cited by 61
Metadata
- Authors
- Jiang, Y., Miao, Y., Alzahrani, B., Barnawi, A., Alotaibi, R., & Hu, L.
- Affiliations
- Huazhong University of Science and Technology (CN)
- King Abdulaziz University (SA)
- Venue
- IEEE Internet of Things Journal
- Published
- 2021-07-01
- Volume
- 8
- Issue
- 13
- Pages
- 10356-10366
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W3159020869
- Cited by
- 36
- References
- 47
- Citations by year
- 2026: 3 · 2025: 13 · 2024: 7 · 2023: 3 · 2022: 7 · 2021: 3
- FWCI
- 2.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Funders
- Deputyship for Research & Innovation, Ministry of Education in Saudi Arabia (227)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Engineering › Aerospace Engineering › UAV Applications and Optimization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Keywords
- crowd monitoring, crowd management, unmanned aerial vehicles, airborne laser scanning, infrared gas sensor, ultrasonic sensors, software-defined networking, edge-cloud computing, multimodal fusion, real-time analytics, crowd intelligence, intelligent decision support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.