The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Human Action Recognition in Videos Using Kinematic Features and Multiple Instance Learning
Open accessAbstract
We propose a set of kinematic features that are derived from the optical flow for human action recognition in videos. The set of kinematic features includes divergence, vorticity, symmetric and antisymmetric flow fields, second and third principal invariants of flow gradient and rate of strain tensor, and third principal invariant of rate of rotation tensor. Each kinematic feature, when computed from the optical flow of a sequence of images, gives rise to a spatiotemporal pattern. It is then assumed that the representative dynamics of the optical flow are captured by these spatiotemporal patterns in the form of dominant kinematic trends or kinematic modes. These kinematic modes are computed by performing Principal Component Analysis (PCA) on the spatiotemporal volumes of the kinematic features. For classification, we propose the use of multiple instance learning (MIL) in which each action video is represented by a bag of kinematic modes. Each video is then embedded into a kinematic-mode-based feature space and the coordinates of the video in that space are used for classification using the nearest neighbor algorithm. The qualitative and quantitative results are reported on the benchmark data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Turbulence and the dynamics of coherent structures. I. Coherent structures
Sirovich, L. (1987) · Quarterly of Applied Mathematics · doi:10.1090/qam/910462 · Cited by 6,224
Learning realistic human actions from movies
Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587756 · Cited by 3,444
Recognizing human actions: a local SVM approach
Schuldt, C., Laptev, I., & Caputo, B. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1334462 · Cited by 3,010
Recognizing human actions: A local SVM approach
Schüldt, C., Laptev, I., & Barbara Caputo, B. (2004) · Cited by 2,908
The recognition of human movement using temporal templates
Bobick, A. F., & Davis, J. W. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.910878 · Cited by 2,811
Behavior Recognition via Sparse Spatio-Temporal Features
Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2006) · 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance · doi:10.1109/vspets.2005.1570899 · Cited by 2,460
Blank, M., Gorelick, L., Shechtman, E., Irani, M., & Basri, R. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.28 · Cited by 1,733
A 3-dimensional sift descriptor and its application to action recognition
Scovanner, P., Ali, S., & Shah, M. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291311 · Cited by 1,596
Self-citationHuman motion analysis: a review
Aggarwal, J. K., & Cai, Q. (2002) · Proceedings IEEE Nonrigid and Articulated Motion Workshop · doi:10.1109/namw.1997.609859 · Cited by 1,400
Laptev, & Lindeberg (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238378 · Cited by 1,300
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273
Recognizing action at a distance
Efros, Berg, Mori, & Malik (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238420 · Cited by 1,241
Human Motion Analysis: A Review
Aggarwal, J. K., & Cai, Q. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0744 · Cited by 1,156
Free viewpoint action recognition using motion history volumes
Weinland, D., Ronfard, R., & Boyer, E. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.07.013 · Cited by 896
MILES: Multiple-Instance Learning via Embedded Instance Selection
Chen, Y., Bi, J., & Wang, J. Z. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.248 · Cited by 752
Efficient visual event detection using volumetric features
Ke, Y., Sukthankar, R., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.85 · Cited by 531
Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion
Black, M. J., & Yacoob, Y. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007977618277 · Cited by 514
Contour-based object tracking with occlusion handling in video acquired using mobile cameras
Yilmaz, A., Li, X., & Shah, M. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.96 · Cited by 493
Self-citationRecognizing People by Their Gait : The Shape of Motion
Little, J. J. (1998) · Cited by 455
Cardboard people: a parameterized model of articulated image motion
Ju, S. X., Black, M. J., & Yacoob, Y. (2002) · Proceedings of the Second International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1996.557241 · Cited by 436
Actions Sketch: A Novel Action Representation
Yilmaz, A., & Shah, M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.58 · Cited by 421
Self-citationMotion-based recognition a survey
Cédras, C., & Shah, M. (1995) · Image and Vision Computing · doi:10.1016/0262-8856(95)93154-k · Cited by 406
Self-citationUnsupervised Learning of Human Action Categories Using Spatial-Temporal Words
Niebles, J. C., Wang, H., Wang, H., & Fei-Fei, L. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.127 · Cited by 385
Cheung, K. M. G., Baker, S., & Kanade, T. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211340 · Cited by 326
Tensor Canonical Correlation Analysis for Action Classification
Kim, T.-K., Wong, S.-F., & Cipolla, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383137 · Cited by 325
Space-Time Behavior Based Correlation
Shechtman, E., & Irani, M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.328 · Cited by 319
Parameterized Modeling and Recognition of Activities
Yacoob, Y., & Black, M. J. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0726 · Cited by 310
Recognizing human actions using multiple features
Liu, J., Ali, S., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587527 · Cited by 265
Self-citationExtracting Spatiotemporal Interest Points using Global Information
Wong, S.-F., & Cipolla, R. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408923 · Cited by 224
An appearance-based representation of action
Bobick, A., & Davis, J. W. (1996) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1996.546039 · Cited by 150
Maron, O., & Lozano‐Pérez, T. (1998) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 121
Articulated and elastic non-rigid motion: a review
Aggarwal, J. K., Cai, Q., Liao, W., & Sabata, B. (2002) · IEEE Nonrigid and Articulated Motion Workshop · doi:10.1109/mnrao.1994.346261 · Cited by 104
Recognizing action events from multiple viewpoints
Syeda-Mahmood, T. F., Vasilescu, A., & Sethi, S. (2002) · doi:10.1109/event.2001.938868 · Cited by 94
Action recognition by shape matching to key frames
Carlsson, S., & Sullivan, J. (n.d.) · Cited by 85
Successive Convex Matching for Action Detection
Jiang, H., Drew, M. S., & Li, Z.-N. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.297 · Cited by 75
Describing motion for recognition
Little, J. J., & Boyd, J. E. (2002) · International Symposium on Computer Vision · doi:10.1109/iscv.1995.477007 · Cited by 66
Representation and recognition of complex human motion
Hoey, J., & Little, J. J. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.855896 · Cited by 48
Échelle auto-rapportée de psychopathie de Levenson : adaptation française et validation
Savard, C., Lussier, Y., & Sabourin, S. (2014) · Criminologie · doi:10.7202/1026736ar · Cited by 29
Spatiotemporal Saliency for Human Action Recognition
Oikonomopoulos, A., Patras, I., & Pantić, M. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521452 · Cited by 28
Kernel-based Recognition of Human Actions Using Spatiotemporal Salient Points
Oikonomopoulos, A., Patras, I., & Pantić, M. (2006) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2006.114 · Cited by 22
(1995) · DSpace@MIT (Massachusetts Institute of Technology)
Cited by
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
Violent flows: Real-time detection of violent crowd behavior
Hassner, T., Itcher, Y., & Kliper-Gross, O. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239348 · Cited by 587
Two-person interaction detection using body-pose features and multiple instance learning
Yun, K., Honorio, J., Chattopadhyay, D., Berg, T. L., & Samaras, D. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239234 · Cited by 523
Vision-based human activity recognition: a survey
Beddiar, D. R., Nini, B., Sabokrou, M., & Hadid, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09004-3 · Cited by 505
Zanfir, M., Leordeanu, M., & Sminchisescu, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.342 · Cited by 438
Metadata
- Authors
- Ali, S., & Shah, M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2010-02
- Volume
- 32
- Issue
- 2
- Pages
- 288-303
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2172207578
- Cited by
- 453
- References
- 42
- FWCI
- 28.16
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.