Layered representations for human activity recognition
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
We present the use of layered probabilistic representations using hidden Markov models for performing sensing, learning, and inference at multiple levels of temporal granularity We describe the use of representation in a system that diagnoses states of a user's activity based on real-time streams of evidence from video, acoustic, and computer interactions. We review the representation, present an implementation, and report on experiments with the layered representation in an office-awareness application.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The S-HSMM thus can be viewed as a member of the exponential family [5] with parameter θ.”
From Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model (2005) · cites this paper as [5]
Citations
Cites
Fundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Event structure in perception and conception.
Zacks, J. M., & Tversky, B. (2001) · Psychological Bulletin · doi:10.1037//0033-2909.127.1.3 · Cited by 1,198 · cited 1×
“Psychologists have, in fact, found that many human behaviors are hierarchically structured [ 20 ].”
BackgroundCoupled hidden Markov models for complex action recognition
Brand, M., Oliver, N., & Pentland, A. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609450 · Cited by 1,052 · cited 2×
“More complex models, such as Parameterized-HMM (PHMM) [19], Entropic-HMM [1], Variable-length HMM (VHMM) [8] and Coupled-HMM (CHMM) [2], have been used to recognize more complex activities such as the interaction between two people.”
MethodSelf-citationReal-time American Sign Language recognition from video using hidden Markov models
Starner, T., & Pentland, A. (2002) · Proceedings of International Symposium on Computer Vision - ISCV · doi:10.1109/iscv.1995.477012 · Cited by 773 · cited 1×
“Starner and Pentland in [18] use an HMM for recognizing hand movements used to relay symbols in American Sign Language.”
MethodRecognition of visual activities and interactions by stochastic parsing
Ivanov, Y. A., & Bobick, A. F. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868686 · Cited by 659 · cited 3×
“[12] Y. Ivanov and A. Bobick.”
BackgroundInfluentialModels of attention in computing and communication: from principles to applications
Horvitz, E., Kadie, C., Paek, T., & Hovel, D. (2003) · Communications of the ACM · doi:10.1145/636772.636798 · Cited by 313
Self-citationHorvitz, E., Jacobs, A., & Hovel, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6707 · Cited by 311 · cited 1×
“Recent work on probabilistic models for reasoning about a user’s location, intentions, and focus of attention have highlighted opportunities for building new kinds of applications and services [10].”
BackgroundSelf-citationDiscovery and segmentation of activities in video
Brand, M., & Kettnaker, V. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868685 · Cited by 301 · cited 3×
“Brand and Kettnaker in [1] propose an entropicHMM approach to organize the observed video activities (office activity and outdoor traffic) into meaningful states.”
BackgroundMethodA practical methodology for speech source localization with microphone arrays
Brandstein, M. S., & Silverman, H. F. (1997) · Computer Speech & Language · doi:10.1006/csla.1996.0024 · Cited by 291 · cited 4×
“Typically, TDOA-based approaches have two steps: the time delay estimation and the sound source localization.”
BackgroundInfluentialLearning Variable-Length Markov Models of Behavior
Galata, A., Johnson, N., & Hogg, D. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0894 · Cited by 265 · cited 2×
“More complex models, such as Parameterized-HMM (PHMM) [19], Entropic-HMM [1], Variable-length HMM (VHMM) [8] and Coupled-HMM (CHMM) [2], have been used to recognize more complex activities such as the interaction between two people.”
Method
Cited by
Items 301–317 of 317
DISCOVERING THE TOP-K UNEXPLAINED SEQUENCESIN TIME-STAMPED OBSERVATION DATA
(2023) · NeuroQuantology · doi:10.48047/nq.2021.19.5.nq21076
“3 utilising statistical approaches or identifying aberrant behaviours from continuous user traces [5].”
BackgroundComplex Event Processing in Heterogeneous Domains
Persia, F., & D’Auria, D. (2023) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism59092.2023.00062
“…patterns in the context of video surveillance [1]: specifically, using coupled Hidden Markov Models (HMMs), Brand et al. [2], Oliver et al. [3], and Hamid et al. [4] use Dynamic Bayesian Networks (DBNs) to capture causal relationships between observations and hidden states, Albanese et al.…”
MethodTwo layered hidden Markov model for studying type 2 diabetes
Rao, P. T., & Narendra, S. (2024) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-024-02491-9 · Cited by 1
Santiteerakul, W. (2015) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc801885
Subbarao, M. V., Ram, G. C., Sravya, Y. K., Subhanjili, K. S., Varma, D. R., & Kumar, D. G. (2025) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-94283-9_22
Developmental Learning for User Activities
Huang, X., Weng, J., & Zhang, Z. (2013) · Springer eBooks · doi:10.1007/978-3-642-30574-0_58
Recognizing Human Actions and Goals in an Open Environment a Brain-Inspired Approach
Van Horenbeke, F. A. (2024) · Libera Università di Bolzano
Contributing to energy efficiency through a user-centered smart home
Dominici, M. (2013) · theses.fr (ABES) · doi:10.70675/77040a15zc448z463ez8dfaz69747581667f · Cited by 1
Analyse et reconnaissance de séquences vidéos d'activités humaines dans l'espace sémantique
Beaudry, C. (2015) · theses.fr (ABES) · doi:10.70675/13f70f03zd6c5z46f8z8816z5465bb0a1d51
ehavioral Recognition and multi-target tracking in partially observed environments
Tchango, A. F. (2015) · theses.fr (ABES) · doi:10.70675/432684d6z4046z42dbz948fz69d4b96a4122
Amroun, H. (2018) · theses.fr (ABES) · doi:10.70675/e1d74124z7080z4564z9804z501d417a4179
“L’état de l’art a montré que les approches utilisant des modèles supervisés (SVM, Réseaux de neurones, etc) possèdent deux modes de réponse : un mode de réponse « En ligne » et un mode de réponse « Hors ligne » [75-89] (Figure 5).”
BackgroundMethodInfluentialToward unsupervised human activity and gesture recognition in videos
Negin, F. (2018) · theses.fr (ABES) · doi:10.70675/cbc55a84zee02z4838zbafczf15751f62c2f
Liouane, Z. (2018) · theses.fr (ABES) · doi:10.70675/9d639f14zd293z4a3azb413z7feac09687b1 · Cited by 1
Distributed tracking in self-organized silly camera network
Khelifa, L. B. (2020) · theses.fr (ABES) · doi:10.70675/ac4ef324z9be8z4397zaaa8z070ebcfb7400
Approches probabilistes pour la perception et l’interprétation de l’activité humaine
Mehdi, N. (2024) · theses.fr (ABES) · doi:10.70675/2a8cff5fz1ad6z468dza381z75bc6864ff7f
Winkley, J. (2013) · Bradford Scholars (University of Bradford)
Vision-based 3D Human Motion Analysis in a Hierarchical Way
Huo, F. (2013) · Research Repository (Delft University of Technology) · doi:10.4233/uuid:a14f2944-d922-4127-8ad9-81966190a227
Metadata
- Authors
- Oliver, N., Horvitz, E., & Garg, A.
- Affiliations
- Microsoft (United States) (US)
- University of Illinois Urbana-Champaign (US)
- Venue
- Proceedings. Fourth IEEE International Conference on Multimodal Interfaces
- Publisher
- IEEE Comput. Soc
- Published
- 2003-06-26
- Pages
- 3-8
- OpenAlex
- W2134067070
- Cited by
- 312
- References
- 20
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 6 · 2022: 2 · 2021: 4 · 2020: 12 · 2019: 6 · 2018: 14 · 2017: 17 · 2016: 12 · 2015: 18 · 2014: 13 · 2013: 26 · 2012: 23
- FWCI
- 14.53
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, hidden Markov models, temporal granularity, video analysis, acoustic sensing, computer interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.