The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive Approach
Abstract
Society is rapidly accepting the use of video cameras in many new and varied locations, but effective methods to utilize and manage the massive resulting amounts of visual data are only slowly developing. This paper presents a framework for live video analysis in which the behaviors of surveillance subjects are described using a vocabulary learned from recurrent motion patterns, for real-time characterization and prediction of future activities, as well as the detection of abnormalities. The repetitive nature of object trajectories is utilized to automatically build activity models in a 3-stage hierarchical learning process. Interesting nodes are learned through Gaussian mixture modeling, connecting routes formed through trajectory clustering, and spatio-temporal dynamics of activities probabilistically encoded using hidden Markov models. Activity models are adapted to small temporal variations in an online fashion using maximum likelihood regression and new behaviors are discovered from a periodic retraining for long-term monitoring. Extensive evaluation on various data sets, typically missing from other work, demonstrates the efficacy and generality of the proposed framework for surveillance-based activity analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
On Spectral Clustering: Analysis and an algorithm
Ng, A. Y., Jordan, M. I., & Weiss, Y. (2001) · Cited by 8,159
Fundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Unsupervised learning of finite mixture models
Figueiredo, M. A. T., & Jain, A. K. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990138 · Cited by 2,125
Mitra, S., & Acharya, T. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.893280 · Cited by 1,981
Discovering similar multidimensional trajectories
Vlachos, M., Kollios, G., & Gunopulos, D. (2003) · Proceedings 18th International Conference on Data Engineering · doi:10.1109/icde.2002.994784 · Cited by 1,468
Gorelick, L., Blank, M., Shechtman, E., Irani, M., & Basri, R. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70711 · Cited by 1,430
Human motion analysis: a review
Aggarwal, J. K., & Cai, Q. (2002) · Proceedings IEEE Nonrigid and Articulated Motion Workshop · doi:10.1109/namw.1997.609859 · Cited by 1,400
Human Motion Analysis: A Review
Aggarwal, J. K., & Cai, Q. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0744 · Cited by 1,156
A system for learning statistical motion patterns
Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., & Maybank, S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.176 · Cited by 544
Wang, X., Ma, X., & Grimson, W. E. L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.87 · Cited by 534
Learning the distribution of object trajectories for event recognition
Johnson, N., & Hogg, D. (1996) · Image and Vision Computing · doi:10.1016/0262-8856(96)01101-8 · Cited by 499
A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance
Morris, B. T., & Trivedi, M. M. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.927109 · Cited by 474
Self-citationUnsupervised Activity Perception by Hierarchical Bayesian Models
Wang, X., Ma, X., & Grimson, E. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383072 · Cited by 359
Video Behavior Profiling for Anomaly Detection
Xiang, T., & Gong, S. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70731 · Cited by 283
Learning Semantic Scene Models From Observing Activity in Visual Surveillance
Makris, D., & Ellis, T. J. (2005) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2005.846652 · Cited by 274
Object Trajectory-Based Activity Classification and Recognition Using Hidden Markov Models
Bashir, F. I., Khokhar, A. A., & Schonfeld, D. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.898960 · Cited by 257
Semantic-Based Surveillance Video Retrieval
Hu, W., Xie, D., Fu, Z., Zeng, W., & Maybank, S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.891352 · Cited by 254
On-line trajectory clustering for anomalous events detection
Piciarelli, C., & Foresti, G. L. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.02.004 · Cited by 242
Comparison of Similarity Measures for Trajectory Clustering in Outdoor Surveillance Scenes
Zhang, Z., Huang, K., & Tan, T. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.392 · Cited by 240
Learning trajectory patterns by clustering: Experimental studies and comparative evaluation
Morris, B., & Trivedi, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206559 · Cited by 228
Self-citationExplicit modelling of state occupancy in hidden Markov models for automatic speech recognition
Russell, M., & Moore, R. (1985) · ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1985.1168477 · Cited by 194
Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video
Morris, B. T., & Trivedi, M. M. (2008) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2008.922970 · Cited by 192
Self-citationTrajectory analysis and semantic region modeling using a nonparametric Bayesian model
Wang, X., Ma, K. T., Ng, G.-W., & Grimson, W. E. L. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587718 · Cited by 170
Messelodi, S., Modena, C. M., & Zanin, M. (2005) · Pattern Analysis and Applications · doi:10.1007/s10044-004-0239-9 · Cited by 158
Application of the self-organising map to trajectory classification
Owens, J. D., & Hunter, A. (2002) · doi:10.1109/vs.2000.856860 · Cited by 145
Learning Activity Patterns Using Fuzzy Self-Organizing Neural Network
Hu, W., Xie, D., Tan, T., & Maybank, S. J. (2004) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2004.826829 · Cited by 138
Naftel, A. J., & Khalid, S. (2006) · Multimedia Systems · doi:10.1007/s00530-006-0058-5 · Cited by 111
Learning spatio-temporal patterns for predicting object behaviour
Sumpter, N., & Bulpitt, A. J. (2000) · Image and Vision Computing · doi:10.1016/s0262-8856(99)00073-6 · Cited by 97
Learning the Distribution of Object Trajectories for Event Recognition.
Johnson, N. J., & Hogg, D. (1995) · British Machine Vision Conference (BMVC) · doi:10.5244/c.9.58 · Cited by 78
Distributed Interactive Video Arrays for Event Capture and Enhanced Situational Awareness
Trivedi, M. M., Gandhi, T., & Huang, K. S. (2005) · IEEE Intelligent Systems · doi:10.1109/mis.2005.86 · Cited by 67
Self-citationVariance compensation within the MLLR framework for robust speech recognition and speaker adaptation
Gales, M., Pye, D., & Woodland, P. C. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.1109/icslp.1996.607987 · Cited by 46
3D Shape Context Based Gesture Analysis Integrated with Tracking using Omni Video Array
Huang, K. S., & Trivedi, M. M. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.382 · Cited by 42
Self-citationUnsupervised learning of motion patterns of rear surrounding vehicles
Morris, B., & Trivedi, M. M. (2009) · IEEE International Conference on Vehicular Electronics and Safety (ICVES) · doi:10.1109/icves.2009.5400238 · Cited by 15
Self-citationUsing Inactivity to Detect Unusual behavior
Dickinson, P., & Hunter, A. (2008) · 2008 IEEE Workshop on Motion and video Computing · doi:10.1109/wmvc.2008.4544054 · Cited by 8
Cited by
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., & Alahi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00240 · Cited by 2,466
Adversarially Learned One-Class Classifier for Novelty Detection
Sabokrou, M., Khalooei, M., Fathy, M., & Adeli, E. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00356 · Cited by 765
Pallotta, G., Vespe, M., & Bryan, K. (2013) · Entropy · doi:10.3390/e15062218 · Cited by 695
A Review of Human Activity Recognition Methods
Vrigkas, M., Nikou, C., & Kakadiaris, I. A. (2015) · Frontiers in Robotics and AI · doi:10.3389/frobt.2015.00028 · Cited by 566
Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes
Sabokrou, M., Fayyaz, M., Fathy, M., Moayed, Z., & Klette, R. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.006 · Cited by 470
Metadata
- Authors
- Morris, B. T., & Trivedi, M. M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2011-11
- Volume
- 33
- Issue
- 11
- Pages
- 2287-2301
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2092272787
- Cited by
- 349
- References
- 35
- FWCI
- 16.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
