The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Unstructured human activity detection from RGBD images
Open accessAbstract
Being able to detect and recognize human activities is essential for several applications, including personal assistive robotics. In this paper, we perform detection and recognition of unstructured human activity in unstructured environments. We use a RGBD sensor (Microsoft Kinect) as the input sensor, and compute a set of features based on human pose and motion, as well as based on image and point-cloud information. Our algorithm is based on a hierarchical maximum entropy Markov model (MEMM), which considers a person's activity as composed of a set of sub-activities. We infer the two-layered graph structure using a dynamic programming approach. We test our algorithm on detecting and recognizing twelve different activities performed by four people in different environments, such as a kitchen, a living room, an office, etc., and achieve good performance even when the person was not seen before in the training set.1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Laptev, I. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1838-7 · Cited by 2,629
Behavior Recognition via Sparse Spatio-Temporal Features
Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2006) · 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance · doi:10.1109/vspets.2005.1570899 · Cited by 2,460
Maximum Entropy Markov Models for Information Extraction and Segmentation
McCallum, A., Freitag, D., & Pereira, F. C. N. (2000) · Cited by 1,315
Action MACH a spatio-temporal Maximum Average Correlation Height filter for action recognition
Rodriguez, M. D., Ahmed, J., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587727 · Cited by 1,223
Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition
Ranzato, M., Huang, F. J., Boureau, Y.-L., & LeCun, Y. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383157 · Cited by 1,086
Coupled hidden Markov models for complex action recognition
Brand, M., Oliver, N., & Pentland, A. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609450 · Cited by 1,052
A review of smart homes—Present state and future challenges
Chan, M., Estève, D., Escriba, C., & Campo, E. (2008) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2008.02.001 · Cited by 1,007
Neural mechanisms for the recognition of biological movements
Giese, M. A., & Poggio, T. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1057 · Cited by 955
Robotic Grasping of Novel Objects using Vision
Saxena, A., Driemeyer, J., & Ng, A. Y. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364907087172 · Cited by 923
Self-citationInferring Activities from Interactions with Objects
Philipose, M., Fishkin, K. P., Perkowitz, M., Patterson, D. J., Fox, D., Kautz, H., & Hahnel, D. (2004) · IEEE Pervasive Computing · doi:10.1109/mprv.2004.7 · Cited by 875
Object Recognition with Features Inspired by Visual Cortex
Serre, T., Wolf, L., & Poggio, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.254 · Cited by 821
A Biologically Inspired System for Action Recognition
Jhuang, H., Serre, T., Wolf, L., & Poggio, T. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408988 · Cited by 723
Modeling Temporal Structure of Decomposable Motion Segments for Activity Classification
Niebles, J. C., Chen, C.-W., & Fei-Fei, L. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15552-9_29 · Cited by 700
Parametric hidden Markov models for gesture recognition
Wilson, A. D., & Bobick, A. F. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.790429 · Cited by 574
Wang, X., Ma, X., & Grimson, W. E. L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.87 · Cited by 534
Multiclass Object Recognition with Sparse, Localized Features
Mutch, J., & Lowe, D. G. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.200 · Cited by 453
Fine-Grained Activity Recognition by Aggregating Abstract Object Usage
Patterson, D. J., Fox, D., Kautz, H., & Philipose, M. (2005) · Ninth IEEE International Symposium on Wearable Computers (ISWC'05) · doi:10.1109/iswc.2005.22 · Cited by 452
Action Recognition from Arbitrary Views using 3D Exemplars
Weinland, D., Boyer, E., & Ronfard, R. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408849 · Cited by 448
Detecting Irregularities in Images and in Video
Boiman, O., & Irani, M. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0009-9 · Cited by 439
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields
Liao, L., Fox, D., & Kautz, H. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907073775 · Cited by 412
Tapus, A., Ţăpuş, C., & Matarić, M. J. (2008) · Intelligent Service Robotics · doi:10.1007/s11370-008-0017-4 · Cited by 402
Semantic Labeling of 3D Point Clouds for Indoor Scenes
Koppula, H. S., Anand, A., Joachims, T., & Saxena, A. (2011) · neural information processing systems · Cited by 385
Self-citationA Scalable Approach to Activity Recognition based on Object Use
Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., & Rehg, J. M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408865 · Cited by 324
Conditional models for contextual human motion recognition
Sminchisescu, C., Kanaujia, A., Li, Z., & Metaxas, D. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.59 · Cited by 282
Recognizing human actions using multiple features
Liu, J., Ali, S., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587527 · Cited by 265
Detecting irregularities in images and in video
Boiman, O., & Irani, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.70 · Cited by 237
Gupta, A., Srinivasan, P., Shi, J., & Davis, L. S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206492 · Cited by 231
Object Recognition with Features Inspired by Visual Cortex
Serre, T., Wolf, L., & Poggio, T. (2006) · doi:10.21236/ada454604 · Cited by 197
Learning Motion Categories using both Semantic and Structural Information
Wong, S.-F., Kim, T.-K., & Cipolla, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383332 · Cited by 194
Parsing human motion with stretchable models
Sapp, B., Weiss, D. A., & Taskar, B. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995607 · Cited by 143
Beyond Actions: Discriminative Models for Contextual Group Activities
Lan, T., Wang, Y., Yang, W., & Mori, G. (2010) · Summit (Simon Fraser University) · Cited by 141
Learning to place new objects in a scene
Jiang, Y. P., Lim, M., Zheng, C., & Saxena, A. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364912438781 · Cited by 139
Self-citationAffordance-based imitation learning in robots
Lopes, M. C., Melo, F. S., & Montesano, L. (2007) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2007.4399517 · Cited by 115
Learning 3-D object orientation from images
Saxena, A., Driemeyer, J., & Ng, A. (2009) · IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152855 · Cited by 102
Self-citation(2004) · Deakin Research Online (Deakin University) · Cited by 82
The robot in the crib: a developmental analysis of imitation skills in infants and robots
Demiris, Y., & Meltzoff, A. N. (2008) · Infant and Child Development · doi:10.1002/icd.543 · Cited by 70
Jiang, Y. P., Zheng, C., Lim, M., & Saxena, A. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224581 · Cited by 53
Self-citationHierarchical Space-Time Model Enabling Efficient Search for Human Actions
Ning, H., Han, T. X., Walther, D. B., Liu, M., & Huang, T. S. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2017399 · Cited by 51
Recognizing Human Actions Using Silhouette-based HMM
Martínez-Contreras, F., Orrite-Uruñuela, C., Herrero, E., Ragheb, H., & Velastín, S. A. (2009) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2009.46 · Cited by 47
Gupta, A., Srinivasan, P., Shi, J., & Davis, L. S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206492 · Cited by 32
Ubiquitous robotics in physical human action recognition: A comparison between dynamic ANNs and GP
Theodoridis, T., Agapitos, A., Hu, H., & Lucas, S. M. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543676 · Cited by 25
Hierarchical Semi-Markov Conditional Random Fields for Recursive Sequential DataPreprint
Tran, T., Phung, D. Q., Bui, H., & Venkatesh, S. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1009.2009 · Cited by 24
Cited by
Enhanced Computer Vision With Microsoft Kinect Sensor: A Review
Han, J., Shao, L., Xu, D., & Shotton, J. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2265378 · Cited by 1,367
Zhu, W., Lan, C., Xing, J., Zeng, W., Li, Y., Shen, L., & Xie, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10451 · Cited by 915
Human Action Recognition and Prediction: A Survey
Kong, Y., & Fu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01594-9 · Cited by 780
Learning human activities and object affordances from RGB-D videos
Koppula, H. S., Gupta, R., & Saxena, A. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913478446 · Cited by 683
Self-citationAnticipating Human Activities Using Object Affordances for Reactive Robotic Response
Koppula, H. S., & Saxena, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2430335 · Cited by 596
Self-citation
Metadata
- Authors
- Sung, J., Ponce, C., Selman, B., & Saxena, A.
- Venue
- 2012 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2012-05
- Pages
- 842-849
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2017695267
- Cited by
- 511
- References
- 43
- FWCI
- 38.97
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.