The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Canonical Correlation Analysis of Video Volume Tensors for Action Categorization and Detection
Abstract
This paper addresses a spatiotemporal pattern recognition problem. The main purpose of this study is to find a right representation and matching of action video volumes for categorization. A novel method is proposed to measure video-to-video volume similarity by extending Canonical Correlation Analysis (CCA), a principled tool to inspect linear relations between two sets of vectors, to that of two multiway data arrays (or tensors). The proposed method analyzes video volumes as inputs avoiding the difficult problem of explicit motion estimation required in traditional methods and provides a way of spatiotemporal pattern matching that is robust to intraclass variations of actions. The proposed matching is demonstrated for action classification by a simple Nearest Neighbor classifier. We, moreover, propose an automatic action detection method, which performs 3D window search over an input video with action exemplars. The search is speeded up by dynamic learning of subspaces in the proposed CCA. Experiments on a public action data set (KTH) and a self-recorded hand gesture data showed that the proposed method is significantly better than various state-of-the-art methods with respect to accuracy. Our method has low time complexity and does not require any major tuning parameters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
RELATIONS BETWEEN TWO SETS OF VARIATES
HOTELLING, H. (1936) · Biometrika · doi:10.1093/biomet/28.3-4.321 · Cited by 5,263
Canonical Correlation Analysis: An Overview with Application to Learning Methods
Hardoon, D. R., Szedmak, S., & Shawe-Taylor, J. (2004) · Neural Computation · doi:10.1162/0899766042321814 · Cited by 3,202
Recognizing human actions: a local SVM approach
Schuldt, C., Laptev, I., & Caputo, B. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1334462 · Cited by 3,010
Recognizing human actions: A local SVM approach
Schüldt, C., Laptev, I., & Barbara Caputo, B. (2004) · Cited by 2,908
The recognition of human movement using temporal templates
Bobick, A. F., & Davis, J. W. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.910878 · Cited by 2,811
Behavior Recognition via Sparse Spatio-Temporal Features
Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2006) · 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance · doi:10.1109/vspets.2005.1570899 · Cited by 2,460
A desicion-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59119-2_166 · Cited by 2,252
Blank, M., Gorelick, L., Shechtman, E., Irani, M., & Basri, R. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.28 · Cited by 1,733
Relations Between Two Sets of Variates
Hotelling, H. (1936) · Biometrika · doi:10.2307/2333955 · Cited by 1,645
Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
Niebles, J. C., Wang, H., & Fei-Fei, L. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0122-4 · Cited by 1,475
Laptev, & Lindeberg (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238378 · Cited by 1,300
Recognizing action at a distance
Efros, Berg, Mori, & Malik (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238420 · Cited by 1,241
Numerical methods for computing angles between linear subspaces
Björck, Ȧ., & Golub, G. H. (1973) · Mathematics of Computation · doi:10.1090/s0025-5718-1973-0348991-3 · Cited by 865
Multilinear Analysis of Image Ensembles: TensorFaces
Vasilescu, M. A. O., & Terzopoulos, D. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47969-4_30 · Cited by 836
Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations
Kim, T.-K., Kittler, J., & Cipolla, R. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1037 · Cited by 590
Self-citationEfficient visual event detection using volumetric features
Ke, Y., Sukthankar, R., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.85 · Cited by 531
Face recognition using temporal image sequence
Yamaguchi, O., Fukui, E., & Maeda, K. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670968 · Cited by 462
Hidden Conditional Random Fields for Gesture Recognition
Wang, S. B., Quattoni, A., Morency, L.-P., Demirdjian, D., & Darrell, T. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.132 · Cited by 451
View-Invariant Representation and Recognition of Actions
Rao, C., Yilmaz, A., & Shah, M. (2002) · International Journal of Computer Vision · doi:10.1023/a:1020350100748 · Cited by 433
A Probabilistic Interpretation of Canonical Correlation Analysis
Bach, F., & Jordan, M. I. (2005) · Cited by 421
A Hierarchical Model of Shape and Appearance for Human Action Classification
Niebles, J. C., & Fei-Fei, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383132 · Cited by 421
Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
Niebles, J. C., Wang, H., Wang, H., & Fei-Fei, L. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.127 · Cited by 385
Matching shape sequences in video with applications in human movement analysis
Veeraraghavan, A., Roy-Chowdhury, A. K., & Chellappa, R. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.246 · Cited by 333
Saisan, P., Doretto, G., Wu, Y. N., & Soatto, S. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990925 · Cited by 328
Tensor Canonical Correlation Analysis for Action Classification
Kim, T.-K., Wong, S.-F., & Cipolla, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383137 · Cited by 325
Self-citationSpace-Time Behavior Based Correlation
Shechtman, E., & Irani, M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.328 · Cited by 319
Learning Motion Categories using both Semantic and Structural Information
Wong, S.-F., Kim, T.-K., & Cipolla, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383332 · Cited by 194
Self-citationDiscriminant Analysis with Tensor Representation
Yan, S., Xu, D., Yang, Q., Zhang, L., Tang, X., & Zhang, H.-J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.131 · Cited by 183
The Function Space of an Activity
Veeraraghavan, A., & Roy-Chowdhury, A. K. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.304 · Cited by 167
Automatic Annotation of Everyday Movements
Ramanan, D., & Forsyth, D. A. (2003) · Cited by 165
Weighted and robust incremental method for subspace learning
Skocaj, & Leonardis (2003) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238667 · Cited by 156
Bissacco, A., Chiuso, A., Ma, Y., & Soatto, S. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990924 · Cited by 149
Vaswani, N., Roy–Chowdhury, A. K., & Chellappa, R. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.852197 · Cited by 148
Human motion signatures: analysis, synthesis, recognition
Vasilescu, M. A. O. (2003) · doi:10.1109/icpr.2002.1047975 · Cited by 134
Modeling Appearances with Low-Rank SVM
Wolf, L., Jhuang, H., & Hazan, T. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383099 · Cited by 78
Matching actions in presence of camera motion
Yılmaz, A., & Shah, M. A. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.07.012 · Cited by 36
Gesture Recognition Under Small Sample Size
Kim, T., & Cipolla, R. (2007) · Springer eBooks · doi:10.1007/978-3-540-76386-4_31 · Cited by 29
Self-citation
Cited by
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
Coupled information-theoretic encoding for face photo-sketch recognition
Zhang, W., Wang, X., & Tang, X. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995324 · Cited by 403
EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition
Zhang, Y., Cao, C., Cheng, J., & Lu, H. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2808769 · Cited by 372
A survey of multilinear subspace learning for tensor data
Lu, H., Plataniotis, K. N., & Venetsanopoulos, A. N. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.01.004 · Cited by 357
L1-Regularized Multiway Canonical Correlation Analysis for SSVEP-Based BCI
Zhang, Y., Zhou, G., Jin, J., Wang, M., Wang, X., & Cichocki, A. (2013) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2013.2279680 · Cited by 267
Metadata
- Authors
- Kim, T.-K., & Cipolla, R.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2009-08
- Volume
- 31
- Issue
- 8
- Pages
- 1415-1428
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2122319321
- Cited by
- 279
- References
- 39
- FWCI
- 17.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.