The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Detecting anomalous events in videos by learning deep representations of appearance and motion
Open accessAbstract
Abstract Anomalous event detection is of utmost importance in intelligent video surveillance. Currently, most approaches for the automatic analysis of complex video scenes typically rely on hand-crafted appearance and motion features. However, adopting user defined representations is clearly suboptimal, as it is desirable to learn descriptors specific to the scene of interest. To cope with this need, in this paper we propose Appearance and Motion DeepNet (AMDN), a novel approach based on deep neural networks to automatically learn feature representations. To exploit the complementary information of both appearance and motion patterns, we introduce a novel double fusion framework, combining the benefits of traditional early fusion and late fusion strategies. Specifically, stacked denoising autoencoders are proposed to separately learn both appearance and motion features as well as a joint representation (early fusion). Then, based on the learned features, multiple one-class SVM models are used to predict the anomaly scores of each input. Finally, a novel late fusion strategy is proposed to combine the computed scores and detect abnormal events. The proposed ADMN is extensively evaluated on publicly available video surveillance datasets including UCSD pedestian, Subway, and Train, showing competitive performance with respect to state of the art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Learning patterns of activity using real-time tracking
Stauffer, C., & Grimson, W. E. L. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868677 · Cited by 3,248
(2011) · Cited by 2,752
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,178
ViBe: A Universal Background Subtraction Algorithm for Video Sequences
Barnich, O., & Van Droogenbroeck, M. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2101613 · Cited by 1,885
Abnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
Efficient Learning of Sparse Representations with an Energy-Based Model
Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0147 · Cited by 1,106
Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors
Adam, A., Rivlin, E., Shimshoni, I., & Reinitz, D. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70825 · Cited by 918
Learning a Deep Compact Image Representation for Visual Tracking
Wang, N., & Yeung, D. (2013) · neural information processing systems · Cited by 836
Beyond pixels: exploring new representations and applications for motion analysis
Freeman, W. T., Adelson, E. H., & Liu, C. (2009) · Cited by 805
Sparse reconstruction cost for abnormal event detection
Cong, Y., Yuan, J., & Liu, J. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995434 · Cited by 801
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
Kim, J., & Grauman, K. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206569 · Cited by 768
Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models
Kratz, L., & Nishino, K. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206771 · Cited by 644
Learning Deep Representations of Appearance and Motion for Anomalous Event Detection
Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.8 · Cited by 550
Self-citationA system for learning statistical motion patterns
Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., & Maybank, S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.176 · Cited by 544
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532
Trajectory-Based Anomalous Event Detection
Piciarelli, C., Micheloni, C., & Foresti, G. L. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005599 · Cited by 532
Video-Based Abnormal Human Behavior Recognition—A Review
Popoola, O. P., & Wang, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2178594 · Cited by 505
Learning the distribution of object trajectories for event recognition
Johnson, N., & Hogg, D. (1996) · Image and Vision Computing · doi:10.1016/0262-8856(96)01101-8 · Cited by 499
Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment
Zhang, J., Shan, S., Kan, M., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_1 · Cited by 468
Event detection and analysis from video streams
Medioni, G., Cohen, I., Bremond, F., Hongeng, S., & Nevatia, R. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.946990 · Cited by 405
Video anomaly detection based on local statistical aggregates
Saligrama, V., & Chen, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247917 · Cited by 332
Learning Semantic Scene Models From Observing Activity in Visual Surveillance
Makris, D., & Ellis, T. J. (2005) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2005.846652 · Cited by 274
Learning Semantic Scene Models by Trajectory Analysis
Wang, X., Tieu, K., & Grimson, E. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744078_9 · Cited by 271
Stacked Progressive Auto-Encoders (SPAE) for Face Recognition Across Poses
Kan, M., Shan, S., Chang, H., & Chen, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.243 · Cited by 243
On-line trajectory clustering for anomalous events detection
Piciarelli, C., & Foresti, G. L. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.02.004 · Cited by 242
Cheng, K.-W., Chen, Y.-T., & Fang, W.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298909 · Cited by 234
Reddy, V., Sanderson, C., & Lovell, B. C. (2011) · CVPR 2011 WORKSHOPS · doi:10.1109/cvprw.2011.5981799 · Cited by 194
Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video
Morris, B. T., & Trivedi, M. M. (2008) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2008.922970 · Cited by 192
Abnormal events detection based on spatio-temporal co-occurences
Benezeth, Y., Jodoin, P., Saligrama, V., & Rosenberger, C. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206686 · Cited by 146
Nie, F., Wang, H., Huang, H., & Ding, C. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0713-z · Cited by 124
Video Behaviour Mining Using a Dynamic Topic Model
Hospedales, T. M., Gong, S., & Xiang, T. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0510-7 · Cited by 104
Zaharescu, A., & Wildes, R. P. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_41 · Cited by 97
Double Fusion for Multimedia Event Detection
Lan, Z., Bao, L., Yu, S.-I., et al. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-27355-1_18 · Cited by 80
Histograms of Optical Flow Orientation for Visual Abnormal Events Detection
Wang, T., & Snoussi, H. (2012) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2012.39 · Cited by 69
Multi kernel learning with online-batch optimization
Orabona, F., Luo, J., & Barbara Caputo, B. (2012) · IRIS Research product catalog (Sapienza University of Rome) · doi:10.5555/2503308.2188393 · Cited by 49
A Prototype Learning Framework Using EMD: Application to Complex Scenes Analysis
Ricci, E., Zen, G., Sebe, N., & Messelodi, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.131 · Cited by 41
Self-citationAdvances in Multimedia Modeling
(2012) · Lecture notes in computer science · doi:10.1007/978-3-642-27355-1 · Cited by 13
Cited by
Learning Memory-Guided Normality for Anomaly Detection
Park, H., Noh, J., & Ham, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01438 · Cited by 929
Sensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00133 · Cited by 588
Abnormal event detection in videos using generative adversarial nets
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C., & Sebe, N. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296547 · Cited by 515
Self-citationIntelligent video surveillance: A review through deep learning techniques for crowd analysis
Sreenu, G., & Saleem Durai, M. A. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0212-5 · Cited by 460
Metadata
- Authors
- Xu, D., Yan, Y., Ricci, E., & Sebe, N.
- Venue
- Computer Vision and Image Understanding
- Publisher
- Elsevier BV
- Published
- 2017-03
- Volume
- 156
- Pages
- 117-127
- ISSN
- 1077-3142 (ISSN-L)
- OpenAlex
- W2540481276
- Cited by
- 474
- References
- 52
- FWCI
- 27.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.