The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
A Scalable Approach to Activity Recognition based on Object Use
Abstract
We propose an approach to activity recognition based on detecting and analyzing the sequence of objects that are being manipulated by the user. In domains such as cooking, where many activities involve similar actions, object-use information can be a valuable cue. In order for this approach to scale to many activities and objects, however, it is necessary to minimize the amount of human-labeled data that is required for modeling. We describe a method for automatically acquiring object models from video without any explicit human supervision. Our approach leverages sparse and noisy readings from RFID tagged objects, along with common-sense knowledge about which objects are likely to be used during a given activity, to bootstrap the learning process. We present a dynamic Bayesian network model which combines RFID and video data to jointly infer the most likely activity and object labels. We demonstrate that our approach can achieve activity recognition rates of more than 80% on a real-world dataset consisting of 16 household activities involving 33 objects with significant background clutter. We show that the combination of visual object recognition with RFID data is significantly more effective than the RFID sensor alone. Our work demonstrates that it is possible to automatically learn object models from video of household activities and employ these models for activity recognition, without requiring any explicit human labeling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955 · cited 1×
“SURF features [2]) could be used to replace SIFT features.”
MethodActivity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
The recognition of human movement using temporal templates
Bobick, A. F., & Davis, J. W. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.910878 · Cited by 2,811
W/sup 4/: real-time surveillance of people and their activities
Haritaoglu, I., Harwood, D., & Davis, L. S. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868683 · Cited by 2,523
Activity recognition from accelerometer data
Ravi, N., Dandekar, N., Mysore, P., & Littman, M. L. (2005) · Innovative Applications of Artificial Intelligence · Cited by 1,775
Statistical Color Models with Application to Skin Detection
Jones, M. J., & Rehg, J. M. (2002) · International Journal of Computer Vision · doi:10.1023/a:1013200319198 · Cited by 1,542
Self-citationRecognizing action at a distance
Efros, Berg, Mori, & Malik (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238420 · Cited by 1,241
Discovering objects and their location in images
Sivic, J., Russell, B. C., Efros, A. A., Zisserman, A., & Freeman, W. T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.77 · Cited by 975
Inferring Activities from Interactions with Objects
Philipose, M., Fishkin, K. P., Perkowitz, M., Patterson, D. J., Fox, D., Kautz, H., & Hahnel, D. (2004) · IEEE Pervasive Computing · doi:10.1109/mprv.2004.7 · Cited by 875
Self-citationRecognition of visual activities and interactions by stochastic parsing
Ivanov, Y. A., & Bobick, A. F. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868686 · Cited by 659
Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model
Duong, T. V., Bui, H. H., Phung, D. Q., & Venkatesh, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.61 · Cited by 535 · cited 1×
“Temporal constraints on actions are addressed either through the use of probabilistic models such as HMM’s [4, 16] or SCFG’s [9], or through explicit temporal correlation methods [21, 26].”
MethodEfficient visual event detection using volumetric features
Ke, Y., Sukthankar, R., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.85 · Cited by 531
Space-Time Behavior Based Correlation
Shechtman, E., & Irani, M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.328 · Cited by 319
Layered representations for learning and inferring office activity from multiple sensory channels
Oliver, N., Garg, A., & Horvitz, E. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.02.004 · Cited by 316
Video-based event recognition: activity representation and probabilistic recognition methods
Hongeng, S., Nevatia, R., & Bremond, F. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.02.005 · Cited by 287
Exploiting human actions and object context for recognition tasks
Moore, D. J., Essa, I. A., & Hayes, M. H. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791201 · Cited by 281
Unsupervised activity recognition using automatically mined common sense
Wyatt, D., Philipose, M., & Choudhury, T. (2005) · National Conference on Artificial Intelligence · Cited by 241
Self-citationRFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors
Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D., & Willwacher, T. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015738 · Cited by 171
The Function Space of an Activity
Veeraraghavan, A., & Roy-Chowdhury, A. K. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.304 · Cited by 167
Video surveillance of interactions
Ivanov, Y. A., Stauffer, C., Bobick, A., & Grimson, W. E. L. (2003) · IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS) · doi:10.1109/vs.1999.780272 · Cited by 97
Peursum, P., WEST, G. A. W., & Venkatesh, S. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.57 · Cited by 60
Protocols from perceptual observations
Needham, C. J., Santos, P. E., Magee, D., Devin, V., Hogg, D., & Cohn, A. G. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.04.006 · Cited by 54
Learning Temporal Sequence Model from Partially Labeled Data
Shi, Y., Bobick, A., & Essa, I. A. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.174 · Cited by 53
Activity Recognition using Visual Tracking and RFID
Krahnstoever, N. O., Rittscher, J., Tu, P., Chean, K. L., & Tomlinson, T. (2005) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/acvmot.2005.17 · Cited by 41
Research works printed but not linked: 2
- 10.1109/CVPR.2004.1315265 · doi:10.1109/cvpr.2004.1315265
- sullivan, 2006, Tracking and labelling of interacting multiple targets, ECCV, 619
Cited by
Marszalek, M., Laptev, I., & Schmid, C. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206557 · Cited by 1,168
Sensor-Based Activity Recognition
Chen, L., Hoey, J., Nugent, C. D., Cook, D. J., & Yu, Z. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2198883 · Cited by 1,074
Detecting activities of daily living in first-person camera views
Pirsiavash, H., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248010 · Cited by 649
Learning to recognize objects in egocentric activities
Fathi, A., Ren, X., & Rehg, J. M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995444 · Cited by 557
Self-citationUnstructured human activity detection from RGBD images
Sung, J., Ponce, C., Selman, B., & Saxena, A. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224591 · Cited by 511
Metadata
- Authors
- Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., & Rehg, J. M.
- Venue
- 2007 IEEE 11th International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2007
- Pages
- 1-8
- OpenAlex
- W2155983176
- Cited by
- 324
- References
- 25
- FWCI
- 16.97
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.