Crowd Analysis in Video Surveillance: A Review
Abstract
Crowd behavior investigation in images/videos is an important task applied in areas such as people counting, density estimation, emotion recognition, motion detection, and flow analysis, etc. The researchers devoted an excellent quality of work to deal with public issues such as crowd control, traffic monitoring, urban planning, vehicle counting in real-time; however, humanity did not get much success in handling these issues due to the limited cost of energy and time. For evaluation metrics, we need a year-wise analysis of used datasets, publications methodologies, and their performance, which is expected to yield good predictions and conclusions. Therefore, in this work, we have systematically and comprehensively revisited five year studies that conducted crowd analysis in video using deep learning techniques to make more effective research development and progress. We have got some new future directions from some of the prestigious survey works, which is a novel aspect of this study, that would provide potential and reliable solutions for investigating crowd behaviour in videos.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Deep learning techniques provide increased flexibility and effectiveness in analyzing and understanding patterns of human motion for HAR.
“Deep learning techniques provide increased flexibility and effectiveness in analyzing and understanding the patterns of human motion [102].”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [102]
Cites
Single-Image Crowd Counting via Multi-Column Convolutional Neural Network
Zhang, Y., Zhou, D., Chen, S., Gao, S., & Ma, Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.70 · Cited by 2,356 · see citing works
Privacy preserving crowd monitoring: Counting people without people models or tracking
Chan, A. B., Liang, J., & Vasconcelos, N. M. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587569 · Cited by 1,198 · see citing works
Cross-scene crowd counting via deep convolutional neural networks
Zhang, C., Li, H., Wang, X., & Yang, X. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298684 · Cited by 1,155 · see citing works
Multi-source Multi-scale Counting in Extremely Dense Crowd Images
Idrees, H., Saleemi, I., Seibert, C., & Shah, M. A. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.329 · Cited by 1,065 · see citing works
Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowds
Idrees, H., Tayyab, M., Athrey, K., Zhang, D., Al-Maadeed, S. A., Rajpoot, N., & Shah, M. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_33 · Cited by 891 · see citing works
Learning From Synthetic Data for Crowd Counting in the Wild
Wang, Q., Gao, J., Lin, W., & Yuan, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00839 · Cited by 654 · see citing works
Towards Perspective-Free Object Counting with Deep Learning
Oñoro-Rubio, D., & López-Sastre, R. J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_38 · Cited by 650 · see citing works
A survey of recent advances in CNN-based single image crowd counting and density estimation
Sindagi, V. A., & Patel, V. M. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.07.007 · Cited by 634 · see citing works
Crowded Scene Analysis: A Survey
Li, T., Chang, H., Wang, M., Ni, B., Hong, R., & Yan, S. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2358029 · Cited by 479 · see citing works
Anomaly detection with density estimation
Nachman, B. P., & Shih, D. (2020) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.101.075042 · Cited by 296 · see citing works
Crowd Counting via Scale-Adaptive Convolutional Neural Network
Zhang, L., Shi, M., & Chen, Q. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00127 · Cited by 281 · see citing works
Albi, G., Bellomo, N., Fermo, L., et al. (2019) · Mathematical Models and Methods in Applied Sciences · doi:10.1142/s0218202519500374 · Cited by 248 · see citing works
Plug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection
Ravanbakhsh, M., Nabi, M., Mousavi, H., Sangineto, E., & Sebe, N. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00188 · Cited by 229 · see citing works
Density Map Regression Guided Detection Network for RGB-D Crowd Counting and Localization
Lian, D., Li, J., Zheng, J., Luo, W., & Gao, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00192 · Cited by 224 · see citing works
Recent survey on crowd density estimation and counting for visual surveillance
Saleh, S. A. M., Suandi, S., & Ibrahim, H. (2015) · Engineering applications of artificial intelligence · doi:10.1016/j.engappai.2015.01.007 · Cited by 209 · see citing works
Perspective-Guided Convolution Networks for Crowd Counting
Yan, Z., Yuan, Y., Zuo, W., et al. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00104 · Cited by 205 · see citing works
Wide-Area Crowd Counting via Ground-Plane Density Maps and Multi-View Fusion CNNs
Zhang, Q., & Chan, A. B. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00849 · Cited by 159 · see citing works
Convolutional neural networks for crowd behaviour analysis: a survey
Tripathi, G., Singh, K., & Vishwakarma, D. K. (2018) · The Visual Computer · doi:10.1007/s00371-018-1499-5 · Cited by 154 · see citing works
An evaluation of crowd counting methods, features and regression models
Ryan, D., Denman, S., Sridharan, S., & Fookes, C. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.07.008 · Cited by 142 · see citing works
Locality-Constrained Spatial Transformer Network for Video Crowd Counting
Fang, Y., Zhan, B., Cai, W., Gao, S., & Hu, B. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00145 · Cited by 130 · see citing works
Pushing the Frontiers of Unconstrained Crowd Counting: New Dataset and Benchmark Method
Sindagi, V. A., Yasarla, R., & Patel, V. M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00131 · Cited by 112 · see citing works
Sánchez, F. L., Hupont, I., Tabik, S., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.008 · Cited by 104 · see citing works
Uddin, M. Z., Hassan, M. M., Almogren, A., Zuair, M., Fortino, G., & Tørresen, J. (2017) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2017.04.019 · Cited by 103 · see citing works
Crowd Scene Understanding from Video
Grant, J. M., & Flynn, P. J. (2017) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3052930 · Cited by 99 · see citing works
Zitouni, M., Bhaskar, H., Dias, J., & Al-Mualla, M. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.12.070 · Cited by 98 · see citing works
Density-Aware Multi-Task Learning for Crowd Counting
Jiang, X., Zhang, L., Zhang, T., et al. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2980945 · Cited by 91 · see citing works
Digital Revolution for Hajj Crowd Management: A Technology Survey
Felemban, E. A., Rehman, F. U., Biabani, S. A. A., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3037396 · Cited by 90 · see citing works
Computer vision based crowd disaster avoidance system: A survey
Yogameena, B., & Nagananthini, C. (2017) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2017.02.021 · Cited by 86 · see citing works
Crowd counting with crowd attention convolutional neural network
Chen, J., Su, W., & Wang, Z. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.11.064 · Cited by 80 · see citing works
Crossing-Line Crowd Counting with Two-Phase Deep Neural Networks
Zhao, Z., Li, H., Zhao, R., & Wang, X. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_43 · Cited by 76 · see citing works
Emotion-relevant activity recognition based on smart cushion using multi-sensor fusion
Gravina, R., & Li, Q. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.08.001 · Cited by 67 · see citing works
ST-CNN: Spatial-Temporal Convolutional Neural Network for crowd counting in videos
Miao, Y., Han, J., Gao, Y., & Zhang, B. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.04.012 · Cited by 66 · see citing works
A Deeply-Recursive Convolutional Network For Crowd Counting
Ding, X., Lin, Z., He, F., et al. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461772 · Cited by 63 · see citing works
Indoor Crowd Counting by Mixture of Gaussians Label Distribution Learning
Ling, M., & Geng, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2922818 · Cited by 61 · see citing works
Ghosh, A. K., Subudhi, B. N., & Ghosh, S. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2190476 · Cited by 46 · see citing works
Estimation of the Number of Passengers in a Bus Using Deep Learning
Hsu, Y.-W., Chen, Y.-W., & Perng, J.-W. (2020) · Sensors · doi:10.3390/s20082178 · Cited by 41 · see citing works
Crowd density estimation based on classification activation map and patch density level
Zhu, L., Li, C., Yang, Z., et al. (2019) · Neural Computing and Applications · doi:10.1007/s00521-018-3954-7 · Cited by 40 · see citing works
Crowd Counting With Limited Labeling Through Submodular Frame Selection
Zhou, Q., Zhang, J., Che, L., et al. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2829987 · Cited by 37 · see citing works
Near Real-time Crowd Counting using Deep Learning Approach
Bhangale, U. M., Patil, S. S., Vishwanath, V., et al. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.04.084 · Cited by 37 · see citing works
Learning Multimodal Deep Representations for Crowd Anomaly Event Detection
Huang, S., Huang, D., & Zhou, X. (2018) · Mathematical Problems in Engineering · doi:10.1155/2018/6323942 · Cited by 33 · see citing works
Optical Flow Dataset and Benchmark for Visual Crowd Analysis
Schröder, G., Senst, T., Bochinski, E., & Sikora, T. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639113 · Cited by 33 · see citing works
NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting.Preprint
Wang, Q., Gao, J., Lin, W., et al. (2020) · arXiv (Cornell University) · Cited by 30 · see citing works
Real-time people counting for indoor scenes
Luo, J., Wang, J., Xu, H., et al. (2015) · Signal Processing · doi:10.1016/j.sigpro.2015.10.036 · Cited by 28 · see citing works
Group Activity Recognition with Differential Recurrent Convolutional Neural Networks
Zhuang, N., Yusufu, T., Ye, J., et al. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.70 · Cited by 26 · see citing works
Computational Study of Primitive Emotional Contagion in Dyadic Interactions
Varni, G., Hupont, I., Clavel, C., & Chetouani, M. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2778154 · Cited by 26 · see citing works
Wen, L., Du, D., Zhu, P., Hu, Q., Wang, Q., Bo, L., & Lyu, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01811 · Cited by 25 · see citing works
Emotion-Based Crowd Representation for Abnormality DetectionPreprint
Rabiee, H. R., Haddadnia, J., Mousavi, H., Nabi, M., Murino, V., & Sebe, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.07646 · Cited by 20 · see citing works
Vehicle theft recognition from surveillance video based on spatiotemporal attention
He, L., Wen, S., Wang, L., & Li, F. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01933-8 · Cited by 19 · see citing works
Region-based facial representation for real-time Action Units intensity detection across datasets
Hupont, I., & Chétouani, M. (2017) · Pattern Analysis and Applications · doi:10.1007/s10044-017-0645-4 · Cited by 17 · see citing works
Counting People Based on Linear, Weighted, and Local Random Forests
Farhood, H., He, X., Jia, W., et al. (2017) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2017.8227421 · Cited by 15 · see citing works
LRCN-RetailNet: A recurrent neural network architecture for accurate people counting
Massa, L., Barbosa, A., Oliveira, K., et al. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09971-7 · Cited by 13 · see citing works
Bilateral counting network for single-image object counting
Li, H., Zhang, S., & Kong, W. (2019) · The Visual Computer · doi:10.1007/s00371-019-01769-5 · Cited by 11 · see citing works
Posture and Gesture Analysis Supporting Emotional Activity Recognition
Li, Q., Gravina, R., & Fortino, G. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00468 · Cited by 8 · see citing works
Design and Analysis of a Lightweight Context Fusion CNN Scheme for Crowd Counting
Yu, Y., Huang, J., Du, W. L., et al. (2019) · Sensors · doi:10.3390/s19092013 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A Survey of Video Surveillance Systems in Smart City
Myagmar-Ochir, Y., & Kim, W. (2023) · Electronics · doi:10.3390/electronics12173567 · Cited by 134 · see citing works
“Deep learning techniques provide increased flexibility and effectiveness in analyzing and understanding the patterns of human motion [102].”
Background
- Authors
- Tomar, A., Kumar, S., & Pant, B.
- Affiliations
- Graphic Era University (IN)
- Venue
- 2022 International Conference on Decision Aid Sciences and Applications (DASA)
- Publisher
- IEEE
- Published
- 2022-03-23
- Pages
- 162-168
- OpenAlex
- W4225322470
- Cited by
- 29
- References
- 54
- Citations by year
- 2025: 5 · 2024: 10 · 2023: 12 · 2022: 2
- FWCI
- 2.63
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Decision Aid Sciences and Applications (DASA) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Ocean Engineering › Evacuation and Crowd Dynamics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- crowd analysis, video surveillance, crowd behavior, people counting, density estimation, emotion recognition, motion detection, flow analysis, crowd control, traffic monitoring, vehicle counting, deep learning, evaluation metrics, dataset analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review