The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Spatio-temporal Depth Cuboid Similarity Feature for Activity Recognition Using Depth Camera
Abstract
Local spatio-temporal interest points (STIPs) and the resulting features from RGB videos have been proven successful at activity recognition that can handle cluttered backgrounds and partial occlusions. In this paper, we propose its counterpart in depth video and show its efficacy on activity recognition. We present a filtering method to extract STIPs from depth videos (called DSTIP) that effectively suppress the noisy measurements. Further, we build a novel depth cuboid similarity feature (DCSF) to describe the local 3D depth cuboid around the DSTIPs with an adaptable supporting size. We test this feature on activity recognition application using the public MSRAction3D, MSRDailyActivity3D datasets and our own dataset. Experimental evaluation shows that the proposed approach outperforms state-of-the-art activity recognition algorithms on depth videos, and the framework is more widely applicable than existing approaches. We also give detailed comparisons with other features and analysis of choice of parameters as a guidance for applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Fast Point Feature Histograms (FPFH) for 3D registration
Rusu, R. B., Blodow, N., & Beetz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152473 · Cited by 3,878
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Learning realistic human actions from movies
Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587756 · Cited by 3,444
Laptev, I. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1838-7 · Cited by 2,629
Behavior Recognition via Sparse Spatio-Temporal Features
Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2006) · 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance · doi:10.1109/vspets.2005.1570899 · Cited by 2,460
Human activity analysis: A review
Aggarwal, J. K., & Ryoo, M. S. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922653 · Cited by 2,056
Self-citationReal-time human pose recognition in parts from single depth images
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., & Moore, R. (2013) · Communications of the ACM · doi:10.1145/2398356.2398381 · Cited by 2,044
A Spatio-Temporal Descriptor Based on 3D-Gradients
Klaeser, A., Marszalek, M., & Schmid, C. (2008) · Procedings of the British Machine Vision Conference 2008 · doi:10.5244/c.22.99 · Cited by 1,846
Mining actionlet ensemble for action recognition with depth cameras
Wang, J., Liu, Z., Wu, Y., & Yuan, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247813 · Cited by 1,512
Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
Niebles, J. C., Wang, H., & Fei-Fei, L. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0122-4 · Cited by 1,475
View invariant human action recognition using histograms of 3D joints
Xia, L., Chen, C.-C., & Aggarwal, J. K. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239233 · Cited by 1,452
Self-citationAction recognition based on a bag of 3D points
Li, W., Zhang, Z., & Liu, Z. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543273 · Cited by 1,428
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
An Efficient Dense and Scale-Invariant Spatio-Temporal Interest Point Detector
Willems, G., Tuytelaars, T., & Van Gool, L. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_48 · Cited by 869
Fast 3D recognition and pose using the Viewpoint Feature Histogram
Rusu, R. B., Bradski, G., Thibaux, R., & Hsu, J. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5651280 · Cited by 847
Integral histogram: a fast way to extract histograms in Cartesian spaces
Porikli, F. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.188 · Cited by 701
Multi‐scale Feature Extraction on Point‐Sampled Surfaces
Pauly, M., Keiser, R., & Gross, M. (2003) · Computer Graphics Forum · doi:10.1111/1467-8659.00675 · Cited by 560
Robust 3D Action Recognition with Random Occupancy Patterns
Wang, J., Liu, Z., Chorowski, J., Chen, Z., & Wu, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_62 · Cited by 471
EigenJoints-based action recognition using Naïve-Bayes-Nearest-Neighbor
Yang, X., & Tian, Y. L. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239232 · Cited by 439
RGBD-HuDaAct: A color-depth video database for human daily activity recognition
Ni, B., Wang, G., & Moulin, P. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130379 · Cited by 304
STOP: Space-Time Occupancy Patterns for 3D Action Recognition from Depth Map Sequences
Vieira, A. W., Nascimento, E. R., Oliveira, G. L., Liu, Z., & Campos, M. F. M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33275-3_31 · Cited by 280
Human Daily Action Analysis with Multi-view and Color-Depth Data
Cheng, Z., Qin, L., Ye, Y., Huang, Q., & Tian, Q. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33868-7_6 · Cited by 126
4-dimensional local spatio-temporal features for human activity recognition
Zhang, H., & Parker, L. E. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6048130 · Cited by 111
4-dimensional local spatio-temporal features for human activity recognition
Zhang, H., & Parker, L. E. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094489 · Cited by 102
Combing RGB and Depth Map Features for human activity recognition
Zhao, Y., Liu, Z., Yang, L., & Cheng, H. (2012) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · Cited by 89
Real-Time Human Detection Using Relational Depth Similarity Features
Ikemura, S., & Fujiyoshi, H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19282-1_3 · Cited by 88
Interest point detection in depth images through scale-space surface analysis
Stückler, J., & Behnke, S. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980474 · Cited by 10
Vaughan, J. (2001) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195382 · Cited by 7
Cited by
Human Action Recognition and Prediction: A Survey
Kong, Y., & Fu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01594-9 · Cited by 780
Human activity recognition from 3D data: A review
Aggarwal, J. K., & Xia, L. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.04.011 · Cited by 576
Self-citationDifferential Recurrent Neural Networks for Action Recognition
Veeriah, V., Zhuang, N., & Qi, G.-J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.460 · Cited by 516
Ohn-Bar, E., & Trivedi, M. M. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2337331 · Cited by 455
Are They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior
Rasouli, A., Kotseruba, I., & Tsotsos, J. K. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.33 · Cited by 425
Metadata
- Authors
- Xia, L., & Aggarwal, J. K.
- Venue
- 2013 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2013-06
- Pages
- 2834-2841
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2162415752
- Cited by
- 433
- References
- 29
- FWCI
- 41.17
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.