The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abnormal crowd behavior detection using social force model
Abstract
In this paper we introduce a novel method to detect and localize abnormal behaviors in crowd videos using Social Force model. For this purpose, a grid of particles is placed over the image and it is advected with the space-time average of optical flow. By treating the moving particles as individuals, their interaction forces are estimated using social force model. The interaction force is then mapped into the image plane to obtain Force Flow for every pixel in every frame. Randomly selected spatio-temporal volumes of Force Flow are used to model the normal behavior of the crowd. We classify frames as normal and abnormal by using a bag of words approach. The regions of anomalies in the abnormal frames are localized using interaction forces. The experiments are conducted on a publicly available dataset from University of Minnesota for escape panic scenarios and a challenging dataset of crowd videos taken from the web. The experiments show that the proposed method captures the dynamics of the crowd behavior successfully. In addition, we have shown that the social force approach outperforms similar approaches based on pure optical flow.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Social force model for pedestrian dynamics
Helbing, D., & Molnár, P. (1995) · Physical Review E · doi:10.1103/physreve.51.4282 · Cited by 6,845
Simulating dynamical features of escape panic
Helbing, D., Farkas, I., & Vicsek, T. (2000) · Nature · doi:10.1038/35035023 · Cited by 4,916
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.993 · Cited by 3,024
Dynamics of crowd disasters: An empirical study
Helbing, D., Johansson, A., & Al-Abideen, H. Z. (2007) · Physical Review E · doi:10.1103/physreve.75.046109 · Cited by 1,174
Lerner, A., Chrysanthou, Y., & Lischinski, D. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01089.x · Cited by 1,171
A continuum theory for the flow of pedestrians
Hughes, R. L. (2002) · Transportation Research Part B: Methodological · doi:10.1016/s0191-2615(01)00015-7 · Cited by 1,100
Treuille, A., Cooper, S., & Popović, Z. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1142008 · Cited by 874
Self-Organizing Pedestrian Movement
Helbing, D., Molnár, P., Farkas, I. J., & Bolay, K. (2001) · Environment and Planning B: Planning and Design · doi:10.1068/b2697 · Cited by 751
A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis
Ali, S., & Shah, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.382977 · Cited by 590
Self-citation
Cited by
Social LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., & Alahi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00240 · Cited by 2,466
Real-World Anomaly Detection in Surveillance Videos
Sultani, W., Chen, C., & Shah, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00678 · Cited by 2,140
Self-citationYou'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints
Sadeghian, A., Kosaraju, V., Sadeghian, A., Hirose, N., Rezatofighi, H., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00144 · Cited by 1,065
Anomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,017
Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes
Robicquet, A., Sadeghian, A., Alahi, A., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_33 · Cited by 927
Sparse reconstruction cost for abnormal event detection
Cong, Y., Yuan, J., & Liu, J. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995434 · Cited by 801
Kitani, K. M., Ziebart, B. D., Bagnell, J. A., & Hebert, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_15 · Cited by 701
Social Attention: Modeling Attention in Human Crowds
Vemula, A., Muelling, K., & Oh, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460504 · Cited by 675
STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory Prediction
Huang, Y., Bi, H., Li, Z., Mao, T., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00637 · Cited by 658
Abnormal Event Detection in Videos Using Spatiotemporal Autoencoder
Chong, Y. S., & Tay, Y. H. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59081-3_23 · Cited by 596
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00133 · Cited by 588
Spatio-Temporal AutoEncoder for Video Anomaly Detection
Zhao, Y., Deng, B., Shen, C., Liu, Y., Lu, H., & Hua, X.-S. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123451 · Cited by 559
Learning Deep Representations of Appearance and Motion for Anomalous Event Detection
Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.8 · Cited by 550
SR-LSTM: State Refinement for LSTM Towards Pedestrian Trajectory Prediction
Zhang, P., Ouyang, W., Zhang, P., Xue, J., & Zheng, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01236 · Cited by 540
Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes
Wu, S., Moore, B. E., & Shah, M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539882 · Cited by 525
Self-citationAbnormal event detection in videos using generative adversarial nets
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C., & Sebe, N. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296547 · Cited by 515
It Is Not the Journey But the Destination: Endpoint Conditioned Trajectory Prediction
Mangalam, K., Girase, H., Agarwal, S., Lee, K.-H., Adeli, E., Malik, J., & Gaidon, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_45 · Cited by 512
Video-Based Abnormal Human Behavior Recognition—A Review
Popoola, O. P., & Wang, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2178594 · Cited by 505
Who are you with and where are you going?
Yamaguchi, K., Berg, A. C., Ortiz, L. E., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995468 · Cited by 484
Crowded Scene Analysis: A Survey
Li, T., Chang, H., Wang, M., Ni, B., Hong, R., & Yan, S. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2358029 · Cited by 479
Multi-Agent Tensor Fusion for Contextual Trajectory Prediction
Zhao, T., Xu, Y., Monfort, M., Choi, W., Baker, C., Zhao, Y., Wang, Y., & Wu, Y. N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01240 · Cited by 477
Detecting anomalous events in videos by learning deep representations of appearance and motion
Xu, D., Yan, Y., Ricci, E., & Sebe, N. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.10.010 · Cited by 474
Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes
Sabokrou, M., Fayyaz, M., Fathy, M., Moayed, Z., & Klette, R. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.006 · Cited by 470
A survey of video datasets for human action and activity recognition
Chaquet, J. M., Carmona, E. J., & Fernández-Caballero, A. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.01.013 · Cited by 455
A Review on Video-Based Human Activity Recognition
Ke, S.-R., Thuc, H., Lee, Y.-J., Hwang, J.-N., Yoo, J.-H., & Choi, K.-H. (2013) · Computers · doi:10.3390/computers2020088 · Cited by 439
Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video
Ionescu, R. T., Khan, F. S., Georgescu, M.-I., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00803 · Cited by 425
Sabokrou, M., Fayyaz, M., Fathy, M., & Klette, R. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2670780 · Cited by 386
Improving Data Association by Joint Modeling of Pedestrian Trajectories and Groupings
Pellegrini, S., Ess, A., & Van Gool, L. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_33 · Cited by 373
AnomalyNet: An Anomaly Detection Network for Video Surveillance
Zhou, J. T., Du, J., Zhu, H., Peng, X., Liu, Y., & Goh, R. S. M. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2900907 · Cited by 363
Abnormal behavior recognition for intelligent video surveillance systems: A review
Ben Mabrouk, A., & Zagrouba, E. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.029 · Cited by 361
Vision-Based Analysis of Small Groups in Pedestrian Crowds
Ge, W., Collins, R. T., & Ruback, R. B. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.176 · Cited by 358
A Unified Framework for Multi-target Tracking and Collective Activity Recognition
Choi, W., & Savarese, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_16 · Cited by 351
Anomaly Detection in Video via Self-Supervised and Multi-Task Learning
Georgescu, M.-I., Barbalau, A., Ionescu, R. T., Shahbaz Khan, F., Popescu, M., & Shah, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01255 · Cited by 350
Self-citationSGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Prediction
Shi, L., Wang, L., Long, C., Zhou, S., Zhou, M., Niu, Z., & Hua, G. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00888 · Cited by 345
Crowd Analysis Using Computer Vision Techniques
Silveira Jacques Junior, J., Musse, S., & Jung, C. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.937394 · Cited by 343
“Mehran and his group [42] developed an approach for abnormal crowd behavior detection exploring the social force model, which was originally introduced in [44] to model crowds based on socio-psychological studies.”
BackgroundInfluentialGraph Neural Networks for Anomaly Detection in Industrial Internet of Things
Wu, Y., Dai, H.-N., & Tang, H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3094295 · Cited by 338
Unmasking the Abnormal Events in Video
Ionescu, R. T., Smeureanu, S., Alexe, B., & Popescu, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.315 · Cited by 335
Video anomaly detection based on local statistical aggregates
Saligrama, V., & Chen, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247917 · Cited by 332
A comprehensive review on deep learning-based methods for video anomaly detection
Nayak, R., Pati, U. C., & Das, S. K. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104078 · Cited by 324
Spatiotemporal Anomaly Detection Using Deep Learning for Real-Time Video Surveillance
Nawaratne, R., Alahakoon, D., De Silva, D., & Yu, X. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2938527 · Cited by 318
Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents
Zhou, B., Wang, X., & Tang, X. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248013 · Cited by 313
Abnormal event detection in crowded scenes using sparse representation
Cong, Y., Yuan, J., & Liu, J. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.11.021 · Cited by 311
CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks
Ullah, W., Ullah, A., Haq, I. U., Muhammad, K., Sajjad, M., & Baik, S. W. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09406-3 · Cited by 310
A study of deep convolutional auto-encoders for anomaly detection in videos
Ribeiro, M., Lazzaretti, A. E., & Lopes, H. S. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.07.016 · Cited by 308
Detecting Coherent Groups in Crowd Scenes by Multiview Clustering
Wang, Q., Chen, M., Nie, F., & Li, X. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2875002 · Cited by 299
Discriminative Latent Models for Recognizing Contextual Group Activities
Lan, T., Wang, Y., Yang, W., Robinovitch, S. N., & Mori, G. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.228 · Cited by 297
Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
Ristea, N.-C., Madan, N., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01321 · Cited by 315
Self-citationDeeply learned attributes for crowded scene understanding
Shao, J., Kang, K., Loy, C. C., & Wang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299097 · Cited by 280
Learning an Image-Based Motion Context for Multiple People Tracking
Leal-Taixe, L., Fenzi, M., Kuznetsova, A., Rosenhahn, B., & Savarese, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.453 · Cited by 280
Encoding Crowd Interaction with Deep Neural Network for Pedestrian Trajectory Prediction
Xu, Y., Piao, Z., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00553 · Cited by 276
Fan, Y., Wen, G., Li, D., Qiu, S., Levine, M. D., & Xiao, F. (2020) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2020.102920 · Cited by 269
Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
Kothari, P., Kreiss, S., & Alahi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3069362 · Cited by 267
A review of state-of-the-art techniques for abnormal human activity recognition
Dhiman, C., & Vishwakarma, D. K. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.08.014 · Cited by 265
Self-Trained Deep Ordinal Regression for End-to-End Video Anomaly Detection
Pang, G., Yan, C., Shen, C., van den Hengel, A., & Bai, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01219 · Cited by 257
Human Activity Recognition Using Inertial Sensors in a Smartphone: An Overview
Sousa Lima, W., Souto, E., El-Khatib, K., Jalali, R., & Gama, J. (2019) · Sensors · doi:10.3390/s19143213 · Cited by 256
Zhou, S., Shen, W., Zeng, D., Fang, M., Wei, Y., & Zhang, Z. (2016) · Signal Processing: Image Communication · doi:10.1016/j.image.2016.06.007 · Cited by 255
Scene-Independent Group Profiling in Crowd
Shao, J., Loy, C. C., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.285 · Cited by 254
A Review of Anomaly Detection in Automated Surveillance
Sodemann, A. A., Ross, M. P., & Borghetti, B. J. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2215319 · Cited by 253
Deep Learning-Based Anomaly Detection in Video Surveillance: A Survey
Duong, H.-T., Le, V.-T., & Hoang, V. T. (2023) · Sensors · doi:10.3390/s23115024 · Cited by 178
“Sample images from the UMN database [39].”
Learning pedestrian dynamics from the real world
Scovanner, P., & Tappen, M. F. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459224 · Cited by 135
An explainable and efficient deep learning framework for video anomaly detection
Wu, C., Shao, S., Tunc, C., Satam, P., & Hariri, S. (2022) · Cluster Computing · doi:10.1007/s10586-021-03439-5 · Cited by 88
Physics Inspired Methods for Crowd Video Surveillance and Analysis: A Survey
Zhang, X., Yu, Q., & Yu, H. (2018) · IEEE Access · doi:10.1109/access.2018.2878733 · Cited by 70
Review on Deep Learning Approaches for Anomaly Event Detection in Video Surveillance
Jebur, S. A., Hussein, K. A., Hoomod, H. K., Alzubaidi, L., & Santamaría, J. (2022) · Electronics · doi:10.3390/electronics12010029 · Cited by 69
Li, N., Chang, F., & Liu, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.12.023 · Cited by 36
Visual-Based Human Crowds Behavior Analysis Based on Graph Modeling and Matching
Chen, D.-Y., & Huang, P.-C. (2013) · IEEE Sensors Journal · doi:10.1109/jsen.2013.2245889 · Cited by 31
Crowd Density Forecasting by Modeling Patch-Based Dynamics
Minoura, H., Yonetani, R., Nishimura, M., & Ushiku, Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3043169 · Cited by 16
Metadata
- Authors
- Mehran, R., Oyama, A., & Shah, M.
- Venue
- 2009 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2009-06
- Pages
- 935-942
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2164489414
- Cited by
- 1,672
- References
- 27
- FWCI
- 35.02
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.