The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions
Abstract
System theoretic approaches to action recognition model the dynamics of a scene with linear dynamical systems (LDSs) and perform classification using metrics on the space of LDSs, e.g. Binet-Cauchy kernels. However, such approaches are only applicable to time series data living in a Euclidean space, e.g. joint trajectories extracted from motion capture data or feature point trajectories extracted from video. Much of the success of recent object recognition techniques relies on the use of more complex feature descriptors, such as SIFT descriptors or HOG descriptors, which are essentially histograms. Since histograms live in a non-Euclidean space, we can no longer model their temporal evolution with LDSs, nor can we classify them using a metric for LDSs. In this paper, we propose to represent each frame of a video using a histogram of oriented optical flow (HOOF) and to recognize human actions by classifying HOOF time-series. For this purpose, we propose a generalization of the Binet-Cauchy kernels to nonlinear dynamical systems (NLDS) whose output lives in a non-Euclidean space, e.g. the space of histograms. This can be achieved by using kernels defined on the original non-Euclidean space, leading to a well-defined metric for NLDSs. We use these kernels for the classification of actions in video sequences using (HOOF) as the output of the NLDS. We evaluate our approach to recognition of human actions in several scenarios and achieve encouraging results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Laptev, I. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1838-7 · Cited by 2,629
Subspace Identification for Linear Systems
Van Overschee, P., & De Moor, B. (1996) · Springer eBooks · doi:10.1007/978-1-4613-0465-4 · Cited by 2,586
A survey of advances in vision-based human motion capture and analysis
Moeslund, T. B., Hilton, A., & Krüger, V. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.002 · Cited by 2,541
Behavior Recognition via Sparse Spatio-Temporal Features
Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2006) · 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance · doi:10.1109/vspets.2005.1570899 · Cited by 2,460
Zhang, J., Marszałek, M., Lazebnik, S., & Schmid, C. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-9794-4 · Cited by 1,923
Information and the Accuracy Attainable in the Estimation of Statistical Parameters
Rao, C. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_16 · Cited by 1,808
The Visual Analysis of Human Movement: A Survey
Gavrila, D. M. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0716 · Cited by 1,782
A Survey of Computer Vision-Based Human Motion Capture
Moeslund, T. B., & Granum, E. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0897 · Cited by 1,768
A metric for distributions with applications to image databases
Rubner, Y., Tomasi, C., & Guibas, L. J. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710701 · Cited by 1,726
Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
Niebles, J. C., Wang, H., & Fei-Fei, L. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0122-4 · Cited by 1,475
AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM
Shumway, R. H., & Stoffer, D. S. (1982) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.1982.tb00349.x · Cited by 1,470
Gorelick, L., Blank, M., Shechtman, E., Irani, M., & Basri, R. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70711 · Cited by 1,430
Human motion analysis: a review
Aggarwal, J. K., & Cai, Q. (2002) · Proceedings IEEE Nonrigid and Articulated Motion Workshop · doi:10.1109/namw.1997.609859 · Cited by 1,400
Recognizing action at a distance
Efros, Berg, Mori, & Malik (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238420 · Cited by 1,241
Human Motion Analysis: A Review
Aggarwal, J. K., & Cai, Q. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0744 · Cited by 1,156
Doretto, G., Chiuso, A., Wu, Y. N., & Soatto, S. (2003) · International Journal of Computer Vision · doi:10.1023/a:1021669406132 · Cited by 885
An Efficient Dense and Scale-Invariant Spatio-Temporal Interest Point Detector
Willems, G., Tuytelaars, T., & Van Gool, L. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_48 · Cited by 869
Actions Sketch: A Novel Action Representation
Yilmaz, A., & Shah, M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.58 · Cited by 421
On measuring the distance between histograms
Cha, S.-H., & Srihari, S. N. (2002) · Pattern Recognition · doi:10.1016/s0031-3203(01)00118-2 · Cited by 387
Human Activity Recognition with Metric Learning
Tran, D., & Sorokin, A. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_42 · Cited by 332
Chaotic Invariants for Human Action Recognition
Ali, S., Basharat, A., & Shah, M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409046 · Cited by 252
Probabilistic Kernels for the Classification of Auto-Regressive Visual Processes
Chan, A. B., & Vasconcelos, N. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.279 · Cited by 211
Riemannian Analysis of Probability Density Functions with Applications in Vision
Srivastava, A., Jermyn, I. H., & Joshi, S. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383188 · Cited by 184
Classifying Video with Kernel Dynamic Textures
Chan, A. B., & Vasconcelos, N. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.382996 · Cited by 166
Bissacco, A., Chiuso, A., Ma, Y., & Soatto, S. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990924 · Cited by 149
Local Features and Kernels for Classification of Texture and Object Categories: An In-Depth Study
Zhang, J., Marszałek, M., Lazebnik, S., & Schmid, C. (2005) · HAL · Cited by 103
Searching for Complex Human Activities with No Visual Examples
İkizler-Cinbiş, N., & Forsyth, D. A. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0142-8 · Cited by 78
Cited by
Anticipating Human Activities Using Object Affordances for Reactive Robotic Response
Koppula, H. S., & Saxena, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2430335 · Cited by 596
Human activity recognition from 3D data: A review
Aggarwal, J. K., & Xia, L. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.04.011 · Cited by 576
A Review of Human Activity Recognition Methods
Vrigkas, M., Nikou, C., & Kakadiaris, I. A. (2015) · Frontiers in Robotics and AI · doi:10.3389/frobt.2015.00028 · Cited by 566
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
Liu, Y.-J., Zhang, J.-K., Yan, W.-J., Wang, S.-J., Zhao, G., & Fu, X. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2485205 · Cited by 520
HATS: Histograms of Averaged Time Surfaces for Robust Event-Based Object Classification
Sironi, A., Brambilla, M., Bourdis, N., Lagorce, X., & Benosman, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00186 · Cited by 486
Metadata
- Authors
- Chaudhry, R., Ravichandran, A., Hager, G., & Vidal, R.
- Venue
- 2009 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2009-06
- Pages
- 1932-1939
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2128730107
- Cited by
- 621
- References
- 30
- FWCI
- 20.17
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.