The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Learning a hierarchy of discriminative space-time neighborhood features for human action recognition
Abstract
Recent work shows how to use local spatio-temporal features to learn models of realistic human actions from video. However, existing methods typically rely on a predefined spatial binning of the local descriptors to impose spatial information beyond a pure “bag-of-words” model, and thus may fail to capture the most informative space-time relationships. We propose to learn the shapes of space-time feature neighborhoods that are most discriminative for a given action category. Given a set of training videos, our method first extracts local motion and appearance features, quantizes them to a visual vocabulary, and then forms candidate neighborhoods consisting of the words associated with nearby points and their orientation with respect to the central interest point. Rather than dictate a particular scaling of the spatial and temporal dimensions to determine which points are near, we show how to learn the class-specific distance functions that form the most informative configurations. Descriptors for these variable-sized neighborhoods are then recursively mapped to higher-level vocabularies, producing a hierarchy of space-time configurations at successively broader scales. Our approach yields state-of-the-art performance on the UCF Sports and KTH datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scalable Recognition with a Vocabulary Tree
Nister, D., & Stewenius, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.264 · Cited by 3,579
Learning realistic human actions from movies
Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587756 · Cited by 3,444
Recognizing human actions: a local SVM approach
Schuldt, C., Laptev, I., & Caputo, B. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1334462 · Cited by 3,010
Recognizing human actions: A local SVM approach
Schüldt, C., Laptev, I., & Barbara Caputo, B. (2004) · Cited by 2,906
Laptev, I. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1838-7 · Cited by 2,629
Behavior Recognition via Sparse Spatio-Temporal Features
Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2006) · 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance · doi:10.1109/vspets.2005.1570899 · Cited by 2,460
A Spatio-Temporal Descriptor Based on 3D-Gradients
Klaeser, A., Marszalek, M., & Schmid, C. (2008) · Procedings of the British Machine Vision Conference 2008 · doi:10.5244/c.22.99 · Cited by 1,846
Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
Niebles, J. C., Wang, H., & Fei-Fei, L. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0122-4 · Cited by 1,475
Gorelick, L., Blank, M., Shechtman, E., Irani, M., & Basri, R. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70711 · Cited by 1,430
Evaluation of local spatio-temporal features for action recognition
Wang, H., Ullah, M. M., Klaser, A., Laptev, I., & Schmid, C. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.124 · Cited by 1,296
Action MACH a spatio-temporal Maximum Average Correlation Height filter for action recognition
Rodriguez, M. D., Ahmed, J., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587727 · Cited by 1,223
Marszalek, M., Laptev, I., & Schmid, C. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206557 · Cited by 1,168
Recognizing realistic actions from videos “in the wild”
Liu, J., Luo, J., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206744 · Cited by 1,075
Efficient visual event detection using volumetric features
Ke, Y., Sukthankar, R., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.85 · Cited by 531
Action recognition by learning mid-level motion features
Fathi, A., & Mori, G. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587735 · Cited by 458
A Hierarchical Model of Shape and Appearance for Human Action Classification
Niebles, J. C., & Fei-Fei, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383132 · Cited by 421
Hierarchical spatio-temporal context modeling for action recognition
Sun, J., Wu, X., Yan, S., Cheong, L.-F., Chua, T.-S., & Li, J. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206721 · Cited by 358
Local Trinary Patterns for human action recognition
Yeffet, L., & Wolf, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459201 · Cited by 339
Recognising action as clouds of space-time interest points
Bregonzio, M., Gong, S., & Xiang, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206779 · Cited by 332
Elliott, D. (2010) · Cited by 312
Discovery of Collocation Patterns: from Visual Words to Visual Phrases
Yuan, J., Wu, Y. N., & Yang, M. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383222 · Cited by 260
Discriminative Subsequence Mining for Action Classification
Nowozin, S., Bakır, G., & Tsuda, K. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409049 · Cited by 179
Recognizing realistic actions from videos “in the wild”
Liu, J., Luo, J., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvprw.2009.5206744 · Cited by 179
Efficient Mining of Frequent and Distinctive Feature Configurations
Quack, T., Ferrari, V., Leibe, B., & Van Gool, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408906 · Cited by 167
Automatic Annotation of Everyday Movements
Ramanan, D., & Forsyth, D. A. (2003) · Cited by 165
Hyperfeatures – Multilevel Local Coding for Visual Recognition
Agarwal, A., & Triggs, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_3 · Cited by 163
Fast realistic multi-action recognition using mined dense spatio-temporal features
Gilbert, A., Illingworth, J., & Bowden, R. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459335 · Cited by 161
View-invariance in action recognition
Rao, C., & Shah, M. (2001) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990977 · Cited by 150
Hierarchical spatio-temporal context modeling for action recognition
Sun, J., Xiao, W., Yan, S., Cheong, L., Chua, T., & Li, J. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206721 · Cited by 140
Hierarchical Part-Based Visual Object Categorization
Bouchard, G., & Triggs, B. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.174 · Cited by 131
Foreground Focus: Unsupervised Learning from Partially Matching Images
Lee, Y. J., & Grauman, K. L. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0252-y · Cited by 131
Self-citationSelection and context for action recognition
Han, D.-S., Bo, L., & Sminchisescu, C. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459427 · Cited by 115
Proximity Distribution Kernels for Geometric Context in Category Recognition
Ling, H., & Soatto, S. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408859 · Cited by 99
Scale Invariant Action Recognition Using Compound Features Mined from Dense Spatio-temporal Corners
Gilbert, A., Illingworth, J., & Bowden, R. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88682-2_18 · Cited by 91
Spatio-temporal pyramid matching for sports videos
Choi, J., Jeon, W. J., & Lee, S. (2008) · Multimedia Information Retrieval · doi:10.1145/1460096.1460144 · Cited by 83
Action Recognition in Broadcast Tennis Video Using Optical Flow and Support Vector Machine
Zhu, G., Xu, C., Gao, W., & Huang, Q. (2006) · Lecture notes in computer science · doi:10.1007/11754336_9 · Cited by 43
Unsupervised learning of hierarchical spatial structures in images
Parikh, D., Zitnick, C. L., & Chen, T. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206549 · Cited by 32
Fast Kernel Learning using Sequential Minimal Optimization
Bach, F., Lanckriet, G. R. G., & Jordan, M. I. (2004) · Cited by 10
Cited by
Action recognition by dense trajectories
Wang, H., Klaser, A., Schmid, C., & Liu, C.-L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995407 · Cited by 2,154
Dense Trajectories and Motion Boundary Descriptors for Action Recognition
Wang, H., Kläser, A., Schmid, C., & Liu, C.-L. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0594-8 · Cited by 1,669
Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition
Jiang, Z., Lin, Z., & Davis, L. S. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.88 · Cited by 1,222
Action bank: A high-level representation of activity in video
Sadanand, S., & Corso, J. J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247806 · Cited by 691
Going deeper into action recognition: A survey
Herath, S., Harandi, M., & Porikli, F. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.01.010 · Cited by 634
Metadata
- Authors
- Kovashka, A., & Grauman, K.
- Venue
- 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2010-06
- Pages
- 2046-2053
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2003543060
- Cited by
- 495
- References
- 38
- FWCI
- 53.05
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.