Efficient duration and hierarchical modeling for human activity recognition
Open accessAbstract
A challenge in building pervasive and smart spaces is to learn and recognize human activities of daily living (ADLs). In this paper, we address this problem and argue that in dealing with ADLs, it is beneficial to exploit both their typical duration patterns and inherent hierarchical structures. We exploit efficient duration modeling using the novel Coxian distribution to form the Coxian hidden semi-Markov model (CxHSMM) and apply it to the problem of learning and recognizing ADLs with complex temporal dependencies. The Coxian duration model has several advantages over existing duration parameterization using multinomial or exponential family distributions, including its denseness in the space of nonnegative distributions, low number of parameters, computational efficiency and the existence of closed-form estimation solutions. Further we combine both hierarchical and duration extensions of the hidden Markov model (HMM) to form the novel switching hidden semi-Markov model (SHSMM), and empirically compare its performance with existing models. The model can learn what an occupant normally does during the day from unsegmented training data and then perform online activity classification, segmentation and abnormality detection. Experimental results show that Coxian modeling outperforms a range of baseline models for the task of activity segmentation. We also achieve a recognition accuracy competitive to the current state-of-the-art multinomial duration model, while gaining a signi…
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes Coxian duration modeling for hidden semi-Markov models and a two-layer switching extension to recognize and segment daily activities in a smart home. Experiments show competitive accuracy with fewer parameters and faster computation than multinomial or exponential-family duration baselines, plus usable abnormality detection and partially supervised performance under missing tracking.
Key findings
- For same-category meal activities, the 5-phase Coxian HSMM reached 91.39% average classification accuracy, versus 68.02% for HMM, 69.05% for Poisson HSMM, 76.53% for Inverse Gaussian HSMM, and 95.56% for multinomial HSMM; the Coxian was about 10 times faster than the multinomial in that experiment.
- For morning-routine segmentation, the 5-phase Coxian switching HSMM achieved 97.73% average segmentation accuracy and 7.56% average early detection rate, compared with 93.69% for the smoothed multinomial switching HSMM and 64.14% for the two-layer HHMM.
- For duration abnormality detection, a 5-phase Coxian switching HSMM using a 2-phase Coxian abnormal-duration model reached 84% true positives at a false-positive rate no greater than 10%, compared with 82% for a 5-phase Coxian abnormal model and 78% for a uniform multinomial abnormal model.
- In a harder evening-routine setting with more than 35% missing tracks, the 3-phase Coxian switching HSMM improved from 49.4% segmentation accuracy with no labels to 73% with only 1% labeled data, while the HHMM rose only from 29% to 31%; with at least 4% labels, Coxian models stabilized around 90% for K ≥ 4.
Methods
- The authors define a discrete Coxian duration distribution and embed it in a hidden semi-Markov model (CxHSMM) and a two-layer switching hidden semi-Markov model (CxSHSMM), using dynamic Bayesian network representations, forward-backward inference, and EM parameter estimation.
- Data come from a laboratory kitchen with two ceiling cameras and a multi-camera tracker, with the floor quantized into 28 one-square-meter cells. Experiments include 48 sequences of three same-category meal activities, 62 unsegmented morning-routine sequences split into three datasets of 40 training and 22 testing sequences, 18 abnormal morning sequences, and 63 evening-routine sequences with 39 training and 24 testing sequences.
- Evaluation uses leave-one-out cross-validation in the first experiment, cross-validation over the number of Coxian phases K, comparisons of classification/segmentation accuracy, early detection rate, running time, ROC-based abnormality detection, and partially supervised training with 1% to 16% labeled data.
Limitations
- Stated in the paper: the tracking module can return neighboring positions rather than the true position, so the observation model is estimated offline; the harder setting has more than 35% missing tracks; and the Coxian approach requires choosing the number of phases K.
- Stated in the paper: object segmentation and tracking are not the focus, and the children, starting-children, and ending-children sets are defined manually using prior knowledge of the activity and environment.
- Evident from the text: the experiments use one kitchen, a single occupant, and relatively small sequence counts, so generalization to other homes, occupants, or larger datasets is not demonstrated.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
3 of 34 cited sources checked · 3 supported · 0 flagged
- Findingown data
In a more challenging setting where tracking is often lost and activities considerably overlap, with a small amount of labels supplied during training in a partially supervised learning mode, the models deliver reliable performance with a small number of phases.
“Finally, our models are further tested in a more challenging setting in which the tracking is often lost and the activities considerably overlap.With a small amount of labels supplied during training in a partially supervised learning mode, our models are again able to deliver reliable performance, again with a small number of phases”
Quote in the paperSubstantial claim - Findingnone given
The proposed model gains a significant reduction in computation compared to the multinomial duration model.
“while gaining a significant reduction in computation.”
Quote in the paperSubstantial claim - Findingown data
Coxian modeling outperforms a range of baseline models for the task of activity segmentation.
“Experimental results show that Coxian modeling outperforms a range of baseline models for the task of activity segmentation.”
Quote in the paperSubstantial claim - Findingown data
Cross-validation model selection on the number of phases K in the Coxian indicates that only a small K is required to achieve optimal performance.
“cross-validation model selection on the number of phases K in the Coxian indicates that only a small K is required to achieve the optimal performance.”
Quote in the paperSubstantial claim - Findingown data
The proposed model achieves recognition accuracy competitive to the current state-of-the-art multinomial duration model.
“We also achieve a recognition accuracy competitive to the current state-of-the-art multinomial duration model”
Quote in the paperSubstantial claim
- Findingnone given
By supplying a small amount of activity labels during training, the model can achieve fairly accurate segmentation and recognition with a small number of phases required.
“By supplying a small amount of activity labels during training, the model can achieve fairly accurate segmentation and recognition with a small number of phases required.”
Quote in the paperSubstantial claim - Findingown data
High accuracy can be achieved with a relatively small number of phases used in the Coxian, greatly reducing the number of free parameters.
“We empirically show that high accuracy can be achieved with a relatively small number of phases used in the Coxian, thus greatly reducing the number of free parameters.”
Quote in the paperSubstantial claim - Findingown data
In a more difficult experiment where objects can move freely, be occluded or out of camera view, resulting in missing observations, the CxSHSMM performs reasonably well.
“We further test the CxSHSMM in a more difficult experiment in which the object is permissible to move freely, be occluded or out of camera view, resulting in data with missing observation due to the failure of the visual tracking module.”
- Also stated in: § 1. Introduction · plain
“Our results again show that it performs reasonably well in such situations.”
Quote in the paperSubstantial claim - Also stated in: § 1. Introduction · plain
- Findingown data
By extending from HMM to 2-phase CxHSMM, the model improves recognition significantly from 68.02% to 78.61%.
“It is also interesting to note that, on comparison between the HMM and the CxHSMM, by simply adding one more geometric phase, i.e., extending from HMM to 2-phase CxHSMM, the model can be improved its recognition significantly (68.02% to 78.61%).”
Quote in the paperSubstantial claim - Findingown data
The IgHSMM performs comparably to a 2-phase CxHSMM, with 76% and 78% accuracy respectively.
“The IgHSMM performs comparably to a 2-phase CxHSMM with 76% and 78% accuracy respectively.”
Quote in the paperNot a substantial claim - Findingown data
Poisson and InvGaussian duration models have slightly underfitted the data.
“Intuitively from this figure, Poisson and InvGaussian duration models have slightly underfitted the data.”
Quote in the paperNot a substantial claim - Findingown data
By increasing K to 5, much better performance (91.39%) can be achieved.
“By adding a few more geometric phases (e.g., increase K to 5), we can achieve much better performance (91.39%).”
Quote in the paperSubstantial claim - Findingown data
Among these Coxians, recognition performance is achieved best at K=5.
“As the result has shown earlier, among these Coxians, the recognition performance is also achieved best at K = 5.”
Quote in the paperNot a substantial claim - Findingown data
There are significant overlaps between the children sets for different p.
“There are significant overlaps between these sets for different p.”
Quote in the paperNot a substantial claim - Findingnone given
Some of the 18 abnormal test sequences have only one or two activities containing abnormal durations.
“some of the 18 abnormal test sequences have only one or two activities containing abnormal durations.”
Quote in the paperNot a substantial claim - Findingreasoning
For K=3, the CxSHSMM mistakenly classified the majority of activity (a.2) as activity (a.3).
“For K = 3, our close examination shows that the CxSHSMM has mistakenly classified the majority of activity (a.2) as activity (a.3).”
Quote in the paperNot a substantial claim - Findingown data
With 4% labels and above, as more geometric phases are added (K = 2, 3, ...), the CxSHSMMs continue to improve their performance, stabilizing around 90% for K ≥ 4.
“In contrast, with 4% labels and above, as we add in more geometric phases into the state durations (K = 2, 3, . ..) the CxSHSMMs continue to improve their performance, stabilizing around 90% for K 4.”
Quote in the paperSubstantial claim - Findingnone given
Every sequence, including unseen testing sequences, has a portion of missing observations.
“Every sequence including the unseen testing sequences has a portion of missing observations.”
Quote in the paperNot a substantial claim - Findingown data
The HHMM has failed to capture these transitions.
“On the contrary, the HHMM has failed to capture these transitions.”
Quote in the paperSubstantial claim - Findingown data
With K = 5, the CxSHSMMs perform well across all six activities with more than 94% accuracy.
“With K 5 the CxSHSMMs performs well across all six activities with more than 94% in accuracy, demonstrating its feasibility for abnormality detection.”
Quote in the paperSubstantial claim - Findingown data
CxSHSMMs with a small number of phases (K ≤ 4) failed to segment the activities adequately on abnormal sequences.
“Similar to the case of normal data (cf.Table 3), the CxSHSMMs with a small number of phases (K 4) has failed to segment the activities adequately.”
Quote in the paperSubstantial claim - Findingown data
The HHMM performance remains around 60% even when supplied with up to 16% of labeled data.
“Fig. 18(a) further shows that the HHMM performance remains around 60% even when supplied with up to 16% of labeled data.”
Quote in the paperSubstantial claim - Findingown data
The CxSHSMMs perform comparably for K = 5, 6, and 7.
“Finally, we note that even though the CxSHSMMs perform comparably for K = 5, 6 and 7, when K = 5, it seems to offer a good trade-off between accuracy and EDR (upper bound = 31% in activity (a.6) -Table 5(b)).”
Quote in the paperSubstantial claim - Findingown data
The time slots are not distributed fairly among activities.
“The segmentation tasks at high-level activities is challenging, partially because the time slots are not distributed fairly among activities.”
Quote in the paperSubstantial claim - Findingown data
The abnormality detection rate is 84.09%.
“Given that abnormal data is not present in the training sets, the abnormality detection rate of 84.09% is a promising result.”
Quote in the paperSubstantial claim - Findingown data
With as little as 1% labels, the CxSHSMMs (e.g., K = 4, 5, 6, 9, 10) perform reasonably well, achieving around 80% accuracy on average.
“In fact, with as little as 1% labels, our results show that the CxSHSMMs (e.g, with K = 4, 5, 6, 9, 10) perform reasonably well, achieving around 80% accuracy on average.”
Quote in the paperSubstantial claim - Findingown data
On average, for K ≥ 4, the CxSHSMMs can correctly identify activities around 15% to 20% of their executable time.
“On average, for K 4, the CxSHSMMs can correctly identify activities around 15% to 20% of their executable time.”
Quote in the paperNot a substantial claim - Findingown data
The Coxian duration model generally requires a small number of phases to achieve its optimal performances.
“Finally, we again consistently observe throughout all our experiments thus far that: the Coxian duration model generally requires a small number of phases to achieve its optimal performances.”
Quote in the paperSubstantial claim - Findingown data
In experiments with both CxHSMM and CxSHSMM, high and comparable accuracy can be achieved with a relatively low number of phases (K = 5).
“In sets of experiments with both the CxHSMM and the CxSHSMM, our results have empirically shown that high and comparable accuracy can be achieved with a relatively low number of phases (K = 5), thus making the Coxian an attractive model for the domain of ADLs as well as a potential model for other applications.”
Quote in the paperSubstantial claim - Findingown data
The CxHSMM is consistently superior to the HMM, the PsHSMM, and the IgHSMM.
“The results have shown that the CxHSMM is consistently superior to the HMM, the PsHSMM and the IgHSMM.”
Quote in the paperSubstantial claim - Interpretationreasoning
The Coxian duration model has advantages over existing duration parameterization using multinomial or exponential family distributions.
“The Coxian duration model has several advantages over existing duration parameterization using multinomial or exponential family distributions”
Quote in the paperSubstantial claim - Premisenone given
The multinomial duration model requires a large number of free parameters, in order of the maximum duration M, which needs to be predefined.
“The multinomial requires a large number of free parameters (in order of the maximum duration M, which needs to be predefined)”
Quote in the paperSubstantial claim - Premisecitation
Most existing work on activity recognition has focused on representing and learning sequential and temporal characteristics in activity sequences.
“Most of the existing work on activity recognition has focused on representing and learning sequential and temporal characteristics in activity sequences.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [40] T. Starner, A. Pentland, Visual recognition of American sign language using hidden Markov models, in: Int. Workshop on Automatic Face and Gesture Recognition, 1995, pp. 184–194
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [42] J. Yamato, J. Ohya, K. Ishii, Recognizing human action in time-sequential images using hidden Markov model, in: IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 1992, pp. 379–385 source
- Interpretationreasoning
The Coxian duration model has a low number of parameters.
“low number of parameters”
- Also stated in: § 1. Introduction · plain
“the number of free parameters is adequately low, scaling linearly with the number of phases K”
Quote in the paperSubstantial claim - Also stated in: § 1. Introduction · plain
- Premisecitation
In most existing work, the state duration is modeled explicitly via the multinomial distribution.
“In most existing work, the state duration is modeled explicitly via the multinomial distribution [11,18,21,34,38].”
Quote in the paperSubstantial claim0 of 5 sources checked- cites [11] M.J.F. Gales, S.J. Young, The theory of segmental hidden Markov models, Technical Report CUED/F-INFENG/TR133, Cambridge University Engineering Department, June 1993 source
- cites [18] S. Luhr, S. Venkatesh, G. West, H.H. Bui, Duration abnormality detection in sequences of human activity, Technical report, Department of Computing, Curtin University of Technology, May 2004 source
- cites [21] Mitchell, 1999, On the complexity of explicit duration HMMs, IEEE Transactions on Speech and Audio Processing source
- cites [34] L.R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in: Procs. IEEE, vol. 77, 1989, pp. 257–286 source
- cites [38] M.J. Russell, R.K. Moore, Explicit modelling of state occupancy in hidden Markov models for automatic speech recognition, in: Proceedings of IEEE Conference on Acoustics Speech and Signal Processing, 1985, pp. 5–8 source
- Interpretationcitation
The Coxian distribution is theoretically flexible enough to approximate any arbitrary distribution.
“including its denseness in the space of nonnegative distributions”
- Also stated in: § 1. Introduction · plain
“it is theoretically flexible enough in approximating any arbitrary distribution [32]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [32] T. Osogami, M. Harchol-Balter, A closed-form solution for mapping general distributions to minimal PH-distributions, in: Int. Conf. on Modelling Tools and Techniques for Computer and Communication System Performance Evaluation, 2003, pp. 200–217 source
- Also stated in: § 1. Introduction · plain
- Interpretationnone given
In dealing with activities of daily living, it is beneficial to exploit both their typical duration patterns and inherent hierarchical structures.
“In this paper, we address this problem and argue that in dealing with ADLs, it is beneficial to exploit both their typical duration patterns and inherent hierarchical structures.”
- Also stated in: § 2.2. The hierarchical HMM (HHMM) · plain
“The SHSMM satisfies the need of exploiting both the hierarchical decompositions and the embedded duration characteristics of human daily activities.”
Quote in the paperNot a substantial claim- Rests on an assumption: Activities of daily living have typical duration patterns.
- Rests on an assumption: Activities of daily living have inherent hierarchical structures.
- Also stated in: § 2.2. The hierarchical HMM (HHMM) · plain
- Interpretationnone given
The Coxian duration model has closed-form estimation solutions.
“the existence of closed-form estimation solutions”
- Also stated in: § 1. Introduction · plain
“it has a closed-form re-estimation solution”
Quote in the paperSubstantial claim - Also stated in: § 1. Introduction · plain
- Interpretationreasoning
The Coxian duration model is computationally efficient.
“computational efficiency”
- Also stated in: § 1. Introduction · plain
“while maintaining computational efficiency”
Quote in the paperSubstantial claim - Also stated in: § 1. Introduction · plain
- Premisenone given
Poisson, Gamma, and exponential family duration models still suffer from the same computational problem as the multinomial, with time complexity O(M).
“Nevertheless, while keeping the number of free parameters low, these methods still suffer from the same computational problem as the multinomial (i.e., time complexity is still O (M)).”
Quote in the paperSubstantial claim - Premisereasoning
The multinomial duration model can be prone to overfitting if there is insufficient training data.
“and can be prone to overfitting if there is insufficient training data.”
Quote in the paperSubstantial claim - Interpretationnone given
The Coxian duration model removes the computational bottleneck faced by the multinomial and other generic exponential family distributions.
“More importantly, it removes the computational bottleneck faced by the multinomial and other generic exponential family distributions”
Quote in the paperNot a substantial claim - Interpretationreasoning
The multinomial duration model is an unsuitable choice for a wide range of applications, including activity recognition, where M could be arbitrarily large.
“makes the multinomial an unsuitable choice for a wide range of applications, including activity recognition, where M could be arbitrarily large.”
Quote in the paperSubstantial claim - Premisereasoning
The theoretical complexity for the HSMM is O(|Q|^2 M^2 T).
“Thus, the theoretical complexity for the HSMM is O (|Q | 2 M 2 T ).”
Quote in the paperSubstantial claim - Premisenone given
One weakness of hierarchical HMM variants is the lack of explicit duration models.
“Nonetheless, one of their weaknesses is the lack of explicit duration models.”
Quote in the paperSubstantial claim - Interpretationnone given
The CxSHSMM can be used to construct an abnormality detection scheme without the need of defining or observing abnormal data.
“In addition, as a by-product of the proposed model, we present an abnormality detection scheme without the need of defining or observing abnormal data.”
Quote in the paperSubstantial claim- Rests on an assumption: Abnormality in the duration of activities can provide vital clues to an alert system as it may indicate the onset of illness or sudden strokes.
- Interpretationreasoning
The SHSMM overcomes the weakness of hierarchical HMM variants by merging the two key extensions (hierarchy and duration) of the original HMM.
“The introduction of the SHSMM in this paper overcomes this weakness.It merges the two key extensions (hierarchy and duration) of the original HMM.”
Quote in the paperSubstantial claim - Premisecitation
More compact parameterizations such as Poisson, Gamma, or exponential family distributions keep the number of free parameters low.
“More compact parameterization has been attempted to overcome this problem, including Poisson [38], Gamma [16], or more generally, the exponential family distribution [20].”
- Also stated in: § 1. Introduction · plain
“while keeping the number of free parameters low”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [38] M.J. Russell, R.K. Moore, Explicit modelling of state occupancy in hidden Markov models for automatic speech recognition, in: Proceedings of IEEE Conference on Acoustics Speech and Signal Processing, 1985, pp. 5–8 source
- cites [16] Levinson, 1986, Continuously variable duration hidden Markov models for automatic speech recognition, Computer Speech and Language source
- cites [20] C.D. Mitchell, L.H. Jamieson, Modeling duration in a hidden Markov model with the exponential family, in: Proc. of IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, Minneapolis, Minnesota, 1993, pp. II.331–II.334 source
- Also stated in: § 1. Introduction · plain
- Premisereasoning
The first drawback in using the multinomial distribution is the substantial increase in computational load.
“The first drawback in using the multinomial distribution is the substantial increase in computational load.”
Quote in the paperSubstantial claim - Premisereasoning
The computational complexity for the HSMM is still significantly high, especially for large M which could be as large as the maximum observation length T in practice.
“Nevertheless, the computational complexity for the HSMM is still significantly high, especially for large M which unfortunately could be as large as the maximum observation length T in practice.”
Quote in the paperSubstantial claim - Premisenone given
The multinomial duration model has computational complexity in the order of O(M) in both training and classification.
“the burden in computation complexity (in order of O (M)) in both training and classification”
Quote in the paperSubstantial claim - Premisenone given
The second drawback of multinomial durations is the large number (M-1) of additional parameters required for each state.
“The second drawback of the multinomial durations is the large number (i.e.M -1) of additional parameters required for each state.”
Quote in the paperSubstantial claim - Interpretationreasoning
The problem of effective modeling of duration is still left unresolved.
“Hence, the problem of effective modeling of duration is still left unresolved.”
Quote in the paperSubstantial claim - Premisereasoning
The large number of parameters in multinomial durations could lead to overfitting when only a small amount of data is available for training.
“This could lead to overfitting when only small amount of data is available for training.”
Quote in the paperSubstantial claim - Interpretationreasoning
The Coxian parameterization avoids prior specification of the maximum possible duration M.
“avoiding prior specification of the maximum possible duration M.”
Quote in the paperSubstantial claim - Interpretationnone given
The number of free parameters in the Coxian scales linearly with the number of phases K.
“the number of free parameters is adequately low, scaling linearly with the number of phases K”
Quote in the paperSubstantial claim - Premisereasoning
Both discrete and continuous exponential family distributions suffer from the same computational drawback as the multinomial, because inference complexity scales linearly with the maximum duration length M.
“However, it turns out that while keeping the number of free parameters low, both discrete and continuous exponential family distributions suffer from the same computational drawback as the multinomial.This is because inference still has computational complexity that scales linearly with the maximum duration length M as these models have the same DBN representation as the multinomial HSMM (Fig. 1(b”
Quote in the paperSubstantial claim - Interpretationreasoning
A good fit to the empirical duration distribution in the training data does not translate to good generalization.
“However, since we are comparing the fitted model with the empirical duration distribution in the training data, a good fit here does not translate to good generalization.”
Quote in the paperSubstantial claim - Interpretationnone given
The discrete Coxian is much more flexible than the geometric distribution as its probability mass function is no longer monotonically decreasing.
“The discrete Coxian is much more flexible than the geometric distribution as its probability mass function is no longer monotonically decreasing.”
Quote in the paperSubstantial claim - Interpretationnone given
Within each p-initiated semi-Markov chain, the re-estimation process is equivalent to that of a CxHSMM except that explicit information about the current parent state is carried along.
“Within each p-initiated semi-Markov chain, the re-estimation process is equivalent to that of a CxHSMM except that the explicit information about the current parent state is carried along.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The Coxian can be effective at modeling arbitrary durations.
“Thus, it can be effective at modeling arbitrary durations.”
Quote in the paperSubstantial claim - Premisecitation
The low-level vision tracking module sometimes returns a neighboring position instead of the actual position occupied by the person.
“This tracking module, however, sometimes returns a neighboring position instead of the actual position occupied by the person, so an observation model is estimated offline with manually labeled ground truth [26].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [26] N.T. Nguyen, S. Venkatesh, G. West, H.H. Bui, Learning people movement model from multiple cameras for behaviour recognition, in: Joint IAPR International Workshops on Structural and Syntactical Pattern Recognition and Statistical Techniques in Pattern Recognition, Lisbon, Portugal, 2004, pp. 315–324 source
- Interpretationnone given
The discrete Coxian is more expressive than the nonnegative binomial distribution since it can weakly model multi-modal data.
“It is also more expressive than the nonnegative binomial distribution since it can weakly model multi-modal data.”
Quote in the paperSubstantial claim - Premisenone given
If duration is modeled as a multinomial or exponential family distribution, the complexity is O(|Q|^2 M T) with M being the maximum duration length.
“We note that if the duration is modeled as a multinomial distribution or an exponential family distribution, the complexity is O (|Q | 2 M T ) with M being the maximum duration length.”
Quote in the paperSubstantial claim - Interpretationown data
The confusion between activities (a.2) and (a.3) is consistent with the fact that they share more common durations.
“This is consistent with the fact that activities (a.2) and (a.3) share more common durations as shown in Table 1.”
Quote in the paperNot a substantial claim - Premisereasoning
In practice, long observation sequences cause the calculation of α_t to encounter the numerical underflow problem.
“In practice, we usually must deal with long observation sequences and thus the calculation of α t will encounter the numerical underflow problem since it will be a joint probability of a large number of variables when t becomes very large.”
Quote in the paperSubstantial claim - Interpretationcitation
By deriving an abnormal model θp and taking likelihood ratios R p (t), the scheme avoids the need to normalize the likelihood after setting a threshold because of uneven observation sequence lengths.
“Furthermore, by deriving an abnormal model θp and taking the likelihood ratios R p (t), we can avoid the unsettling problem of having to normalize the likelihood after setting a threshold because of the uneven length in observation sequences [18].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [18] S. Luhr, S. Venkatesh, G. West, H.H. Bui, Duration abnormality detection in sequences of human activity, Technical report, Department of Computing, Curtin University of Technology, May 2004 source
- Interpretationreasoning
Examining each p-initiated semi-Markov sequence independently avoids residual effects of previous activities in the likelihood, which is important when only some activities in the routine are abnormal.
“This is to avoid the residual effects of previous activities in the likelihood, which is especially important in the case where only some activities in the routine are abnormal.”
Quote in the paperSubstantial claim - Interpretationown data
The CxSHSMM with K = 5 demonstrates feasibility for abnormality detection.
“With K 5 the CxSHSMMs performs well across all six activities with more than 94% in accuracy, demonstrating its feasibility for abnormality detection.”
Quote in the paperSubstantial claim - Interpretationreasoning
The scheme can examine abnormality for every p-initiated semi-Markov sequence independently instead of considering the whole morning routine of six activities.
“We can examine the abnormality for every p-initiated semi-Markov sequence independently instead of considering the whole morning routine of six activities.”
Quote in the paperSubstantial claim - Interpretationreasoning
The scheme removes the need for manually constructing abnormal models using prior knowledge and speculations.
“Secondly, it removes the laborious and practically difficult task of manually constructing abnormal models using prior knowledge about the data and speculations on possible abnormal scenarios.”
Quote in the paperSubstantial claim - Interpretationreasoning
The abnormal model θp, constructed by only changing the duration model, suffices to capture abnormalities because the aim is to detect abnormality only in state durations and not in sequential order.
“We argue that the abnormal model θp , constructed by only changing the duration model, suffices to capture abnor- malities since our aim is to focus on detecting a more subtle form of abnormality, which is the abnormality only in the state durations and not in the sequential order.”
Quote in the paperSubstantial claim - Interpretationown data
K = 5 seems to offer a good trade-off between accuracy and EDR.
“Finally, we note that even though the CxSHSMMs perform comparably for K = 5, 6 and 7, when K = 5, it seems to offer a good trade-off between accuracy and EDR (upper bound = 31% in activity (a.6) -Table 5(b)).”
Quote in the paperNot a substantial claim - Interpretationreasoning
The scheme does not require training abnormal models.
“Thirdly, there is no need to train abnormal models, which is practically difficult as abnormal data are both diverse and rare.”
Quote in the paperSubstantial claim- Rests on an assumption: Abnormal data are both diverse and rare.
- Interpretationnone given
The theoretical time saving factor is the ratio of the maximum duration length M to the number of phases K.
“The theoretical time saving factor 15 is given as the ratio of the maximum duration length M to the number of phases K .”
Quote in the paperSubstantial claim - Interpretationown data
The incorporation of both duration and hierarchical properties in the CxSHSMM leads to reasonable results even on complicated and overlapping ADLs.
“The incorporation of both duration and hierarchical properties in our CxSHSMM model leads to reasonable results even on complicated and overlapping ADLs.”
Quote in the paperSubstantial claim - Interpretationreasoning
The full joint probability of m_t and m_{t+1} is O(M) instead of O(M^2).
“Note that the full joint probability of m t and m t+1 is just O (M) instead of O (M 2 ) (cf.Section 3.3).”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 39
- May combine two claims. 76
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationFine et al. [10] were the first to introduce the HHMM, generalizing the HMM by viewing each state as an autonomous probabilistic HMM model itself.
“Fine et al. [10] were the first to introduce the HHMM, generalizing the HMM by viewing each state as an autonomous probabilistic HMM model itself.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [10] Fine, 1998, The hierarchical hidden Markov model: Analysis and applications, Machine Learning source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe semantics of the proposed switching HSMM is somewhat similar to the switching linear dynamic system (SLDS) proposed by [28] for the bee-dance tracking problem.
“The semantics of our proposed switching HSMM is somewhat similar to the switching linear dynamic system (SLDS) proposed by [28] for the bee-dance tracking problem.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [28] S. Min Oh, J.M. Rehg, T. Balch, F. Dellaert, Learning and inference in parametric switching linear dynamic systems, in: International Conference on Computer Vision (ICCV-2005), Beijing, China, 2005 source
Classified as probably not a substantial claim.
PremisecitationIn a two-layer HHMM, the duration of a bottom-level state i in ch(p) follows a geometric distribution.
“In this two-layer HHMM, the duration of a bottom-level state i ∈ ch(p), denoted as D p,i , follows a geometric distribution.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [3] Bui, 2004, Hierarchical hidden Markov models with general state hierarchy
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [10] Fine, 1998, The hierarchical hidden Markov model: Analysis and applications, Machine Learning source
May combine two claims.
Findingown dataThe CxSHSMM significantly outperforms the HHMM (without duration model) and the MuSHSMM (multinomial duration).
“The experiments show that the CxSHSMM significantly outperforms the HHMM (without duration model) and the MuSHSMM (multinomial duration).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone givenThe Coxian parameterization requires a relatively small number of phases.
“Furthermore, the Coxian parameterization requires a relatively small number of phases.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe Coxian comes second at 91.39% when K=5, achieved with a significant speedup (about 10 times faster than the MuHSMM in this case).
“The Coxian comes second at 91.39% when K = 5, however, it was achieved with a significant speedup (about 10 times faster than the MuHSMM in this case).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe Multinomial was able to learn both dominant modes in the data and fitted best in this example.
“The Multinomial was able to learn both dominant modes in the data and fitted best in this example.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenIn this case, multinomial parameterization would require over 100 parameters, whereas the Coxian requires less than 10.
“We also note that, in this case, multinomial parameterization would requires over 100 parameters whilst it is less than 10 for the Coxian.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe empirical speedup factor goes from 7 times for the first four sequences to 10 times for the next three sequences.
“The empirical speedup factor goes from 7 times for the first four sequences, which are from activity (a.1) whose lengths are shortest among the three activity types, to 10 times for the next three sequences taken from activity (a.2), whose lengths are generally the longest.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe HMM performs worst with only 68% average classification accuracy, and the PsHSMM is almost equally poor at 69%.
“The result shows that the HMM performs worst with only 68% in average classification accuracy; the performance of the PsHSMM is almost equally poor (69%).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAmong the Coxian models, performance varies as the number of phases increases, and a good performance is observed when K=5 in terms of both recognition and early detection rates.
“Among the Coxian models, performance varies as the number of phases increases.We observe a good performance when K = 5 in terms of both recognition and early detection rates as shown in Table 2.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataBeing weakly multi-modal, the Coxian has learned the first dominant mode in the data well and smoothed out the less dominant one.
“Being weakly multi-modal, the Coxian has learned the first dominant mode in the data well and smoothed out the less dominant one.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataStarting from K=3, Coxian-based models begin to increase their performances and outperform the baseline models quickly.
“Starting from K = 3, Coxian-based models begin to increase their performances and outperform these baseline models quickly.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningMost models generally detect activity (a.1) accurately and early, while sometimes confusing the other two activities.
“It is further observed that most models generally detect activity (a.1) accurately and early, while sometimes confusing the other two activities.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAs the number of phases increases, the mode of the learned Coxian gradually shifts to the right, showing a sign of going from underfitting to good fitting and overfitting; starting from K=5, it matches reasonably well with the dominant mode from the empirical distribution.
“It can seen that as the number of phases increases, the mode of the learned Coxian gradually shifts to the right, showing sign of going from underfitting to good fitting and overfitting.Starting from K = 5, it matches reasonably well with the dominant mode from the empirical distribution (bottom chart, marked with * ).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe CxHSMM computation time does not increase noticeably with activity length, while the MuHSMM runs much slower as it moves from activities (a.1) to (a.2), taking more than 35 min per EM iteration.
“It is important to note that while the CxHSMM computation time does not increase noticeably with the activity length ((a.1) vs. (a.2)), the MuHSMM runs much slower as it moves from activities (a.1) to (a.2), taking more than 35 min per EM iteration.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the region of false alarm not greater than 10%, the 2-phase Coxian D p,i scores best with TP = 84%, compared to 82% for the 5-phase Coxian D p,i and 78% for the uniform multinomial D p,i.
“In the region of false alarm not greater than 10% (i.e.FP 10%), the 2-phase Coxian D p,i scores best with TP = 84% in comparison to 82%, and 78% from the 5-phase Coxian D p,i and the uniform multinomial D p,i , respectively.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor K = 4, despite gaining 80% overall, the CxSHSMM failed on activity (a.5) more than 50% of the time.
“For example, for K = 4, despite of gaining 80% overall, the CxSHSMM has failed miserably on the activity (a.5) more than 50% of the time.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWith just 1% training labels, the 3-phase CxSHSMM increased its performance to 73%, compared with a rise of only 2% (from 29% to 31%) for the HHMM.
“However, when supplied with a small fraction of training labels (e.g., with just 1%), the 3-phase CxSHSMM dramatically increases its performance to 73% as compared with a modest rise of only 2% (from 29% to 31%) for the case of the HHMM (further results are shown in Table A.6 in Appendix A).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe MuSHSMM segmented reasonably well for activities (a.1), (a.2), (a.4), (a.5), but failed on activity (a.6) one third of the time and occasionally failed on activity (a.3), resulting in 90.4% performance.
“The MuSHSMM has segmented reasonably well for the set of activities {(a.1), (a.2), (a.4), (a.5)}, but failed on activity (a.6) one third of the time, and occasionally failed on activity (a.3), resulting in a performance of 90.4%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone givenThe high-level activities share considerable overlappings in their trajectories, totally overlapping in some cases, and are more complicated than those in Section 5.2.
“In addition to this capturing flexibility, our high-level activities share considerable overlappings in their trajectories (totally overlap in some cases), and more complicated than those considered previously in Section 5.2.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataFor unlabeled data, the 3-phase CxSHSMM significantly performed better than the HHMM, but its performance was still very low and unsatisfactory (49.4%).
“The results show that, even though the 3-phase CxSHSMM significantly perform better than the HHMM for unlabeled data, its performance was still very low and unsatisfactory (49.4%).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataWith K=2, the segmentation result was less than 70% accuracy; activity (a.1) could not be recognized when K=4 and activity (a.2) when K=3.
“With K = 2, the segmentation result was less than 70% accuracy; activity (a.1) could not be recognized when K = 4 and so was activity (a.2) when K = 3.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe background uniform multinomial D p,i seems to be the least effective, while the 2-phase Coxian D p,i produces the considerably best ROC curve.
“The background uniform multinomial D p,i seems to be the least affective, while the 2-phase Coxian D p,i pro- duces the considerably best ROC curve.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningIn an example sequence with activities (a.1) to (a.6) where first two are abnormal and rest normal, the 5-phase CxSHSMM correctly detected only the first two activities as abnormal, while the HSMM continued to label the sequence as abnormal until its end.
“While the 5-phase CxSHSMM has successfully dealt with this scenario by correctly detecting only the first two activities are abnormal, the HSMM continues to label the sequence as abnormal until the sequence reaches its end.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor small numbers of phases (K=2,3,4), the CxSHSMM had trouble distinguishing between the first two activities, showing signs of underfitting, but still delivered good segmentation performance on the remaining activities.
“Our first observation is that, for small number of phases (K = 2, 3, 4) the CxSHSMM was having trouble in distinguishing between first two activities, showing sign of underfitting, but still delivering good segmentation performance on the remaining set of activities (Table 3(a)).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe two-layer HHMM, without duration knowledge, learned a poor transition model at the high level, resulting in low performance.
“Finally, as expected, the two-layer HHMM, without duration knowledge, has learned a poor transition model at the high level, resulting a low performance (i.e., it occasionally detecting some activities such as (a.2) or (a.3) correctly, while generally failing to detect the others).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThere are major overlappings between chS(5) and chS(6), and between chE(5) and chE(6), as sweeping starts and ends around the stove area.
“There are also major overlappings between chS(5) and chS(6), and between chE(5)and chE(6) as sweeping starts and ends around the stove area.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenEmptying the bin takes noticeably less time than sweeping the floor or watching television.
“For instance, emptying the bin takes noticeably less time than sweeping the floor or watching television, and thus is possibly overlooked by the model.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThere is no significant difference between the Coxian and the multinomial; both have learned reasonable transitions from activities (a.2) to (a.3) or (a.4), from (a.3) to (a.4) or (a.6), and from (a.5) to (a.3) or (a.6).
“In particular, there is no significant difference between the Coxian and the multinomial.They both have learned reasonable transitions: from activities (a.2) to (a.3) or (a.4), from activities (a.3) to (a.4) or (a.6) and from activities (a.5) to (a.3) or (a.6).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn a workstation with 3.2 GHz CPU and 2 GB memory, the 5-phase Coxian took approximately 20 min per EM iteration on one training sequence, while the MuSHSMM took approximately 19 hours (57 times slower).
“on a workstation configured with 3.2 GHz CPU, 2 GB memory the 5-phase Coxian took approximately 20 min per one EM iteration on one single training sequence, while the MuSHSMM took approximately 19 hours (57 times slower); therefore its results are not reported.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataStarting from K=5 onward, the CxSHSMM resolved the problem and produced consistent segmentation accuracy across all activities, achieving more than 96% accuracy on average; optimal performance was at K=5 with segmentation accuracy 97.73% and early detection rate 7.56%.
“However, starting from K = 5 onward, the CxSHSMM has successfully resolved this problem and produced consistent segmentation accuracy across all activities, achieving more than 96% accuracy on average.The optimal performance is again marked at K = 5 in terms of segmentation accuracy (97.73%) and early detection rate (7.56%) (Table 3).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the unconstrained setting, more than 35% of tracks were lost, affecting every sequence recorded in the dataset.
“This setting has created a significant portion of the tracks being lost (more than 35%), and affecting every sequence recorded in the dataset.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingreasoningch(5) is a subset of ch(6), as cleaning-stove concentrates only around the stove area while sweeping-floor is done on the whole floor.
“We observe that ch(5) ⊂ ch(6) as cleaning-stove concentrates only around the stove area while sweeping-floor is done on the whole floor.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataBoth the Coxian and the multinomial SHSMMs can capture the patterns in the training data adequately, while the two-layer HHMM has failed to do so.
“We found that while both the Coxian and the multinomial SHSMMs can capture the patterns in the training data adequately, the two-layer HHMM has failed to do so (Table 4).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe best baseline method is the smoothed MuSHSMM; its segmentation accuracy is comparable to the Coxian model for the first five activities, but it performs much poorly on the last activity, making its average performance approximately 3% lower than the optimal performance of the Coxian.
“The best performance among the baseline methods is the MuSHSMM with smoothing.The segmentation accuracy is comparable to the Coxian model for the first five activities.However, it performs much poorly on the last activity, making its average performance approximately 3% lower the optimal performance of the Coxian.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe filtering computations per time slice for K=5 is 0.73 s, improved by four times per time slice compared with the multinomial (about 3 s).
“With respect to the running time, the filtering computations per time slice for K = 5 is 0.73 s, improved by four times per time slice compared with the multinomial (about 3 s).”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningWhen K=2, the CxSHSMM occasionally segmented activity (a.1) earlier than its true ending time, while the 4-phase always did so, leading to poor performance on this activity for K=2 and 4.
“It shows that when K = 2 the CxSHSMM has occasionally segmented activity (a.1) earlier than its true ending time while the 4-phase always does so, leading to the poor performance on this activity for K = 2 and 4.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe occupant does not strictly follow the sequential order from activity (a.1) to (a.7), but occasionally deviates, such as cleaning the stove before/after watching television.
“The occupant does not strictly follow the sequential order from activity (a.1) to (a.7), but occasionally makes a deviation such as choosing to clean the stove (a.5) before/after watching television (a.4).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWith K > 4, there is no noticeable performance difference for the CxSHSMM when data is labeled with 4%, 8%, or 16%, except in segmentation accuracy when trained with 16% labeled data.
“We also observe from Fig. 18(a) that, with K > 4, there is no noticeable performance difference for the CxSHSMM when the data is labeled with 4%, 8% or 16% with an exception in segmentation accuracy when trained with 16% labeled data (Fig. 18(b)).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataFor this experiment setting, the CxSHSMM requires a small increase in computation cost compared with the two-layer HHMM (multiplied by a factor equal to the optimal K = 4), but has dramatically increased performance overall.
“For this particular experiment setting, it requires a small increase in computation cost as compared with the two-layer HHMM (multiplied by a factor equal to the optimal K = 4), but has dramatically increased the performance over all.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe CxHSMM achieves competitive performance close to the MuHSMM while gaining substantial improvement in computation time.
“In addition, it achieves a competitive performance close to that of the MuHSMM, whilst gaining a substantial improvement in computation time.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenThe model can learn what an occupant normally does during the day from unsegmented training data and then perform online activity classification, segmentation and abnormality detection.
“The model can learn what an occupant normally does during the day from unsegmented training data and then perform online activity classification, segmentation and abnormality detection.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Premisenone givenTwo popular classes of extensions to the HMM have been proposed: one relaxes the strong Markov assumption by modeling state duration, and the other enriches the basic HMM by introducing hierarchical structure.
“To overcome these limitations, two popular classes of extensions to the HMM have been proposed.The first relaxes the strong Markov assumption by modeling state duration, and the second enriches the basic HMM by introducing hierarchical structure.”
Quote in the paperSubstantial claimMay combine two claims.
Premisenone givenHMM performance seriously degrades when the range of activities becomes more complex, or the activities exhibit long-term temporal dependencies that are difficult to deal with under the strong Markov assumption.
“While using HMMs is suitable and efficient for learning simple sequential data, its performance seriously degrades when the range of activities becomes more complex, or the activities exhibit long-term temporal dependencies that are difficult to deal with under the strong Markov assumption.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenIf the state duration distribution is non-geometric, the corresponding semi-Markov model is strictly non-Markov.
“If the state duration distribution is non-geometric, the corresponding semi-Markov model is strictly non-Markov.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe work of [29] extended SLDS to incorporate duration at the top level, but duration is modeled explicitly as a multinomial which leads to the same complexity problems as outlined previously.
“This work has recently been extended to incorporate duration at the top level [29].However, duration is modeled explicitly as a multinomial which leads to the same complexity problems as we have outlined previously.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [29] S. Min Oh, J.M. Rehg, F. Dellaert, Parameterized duration modeling for switching linear dynamic systems, in: International Conference on Computer Vision and Pattern Recognition (CVPR 2006), New York, USA, 2006 source
May combine two claims.
PremisereasoningThe DBN representation of the HSMM enables it to be viewed as a member of the exponential family, and hence the HSMM parameter set θ can be estimated using the EM algorithm.
“Similar to the HMM case, the DBN representation of the HSMM enables it to be viewed as a member of the exponential family.Hence, in the learning phase, the HSMM parameter set θ can be estimated using the Expectation Maximization (EM) algorithm.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationIn [19], the authors used a Coxian to model the duration of stay of the elderly in the hospital, and the resulting best number of phases is small (equals 3), consistent with the conclusion in this paper.
“In [19], the authors used a Coxian to model the duration of stay of the elderly in the hospital.Based on the data collected from the patients, the model is fitted with different number of phases using a series of likelihood ratios testing to find the best fit model.The resulting best number of phases is small (equals 3) and it is consistent with the conclusion in this paper.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [19] Marshall, 2004, Using coxian phase-type distributions to identify patient characteristics for duration of stay in hospital, Health Care Management Science source
Classified as probably not a substantial claim.
Premisenone givenThe original HMM has an inference/learning complexity of O(|Q|^2 T).
“the original HMM, whose state space is |Q |, has an inference/learning complexity of O (|Q | 2 T )”
Quote in the paperSubstantial claimMay combine two claims.
PremisereasoningInference in the proposed switching HSMM can be done exactly, whereas inference in SLDS is intractable and needs to be approximated.
“inference in ours can be done exactly, whilst that in the SLDS is intractable, and needs to be approximated.”
Quote in the paperSubstantial claimMay combine two claims.
Premisenone givenThere has been no attempt to formulate a model combining hierarchical and semi-Markov extensions, or to empirically demonstrate the usefulness of such joint modeling over other existing methods.
“However, there has been no attempt to formulate such a model, or to empirically demonstrate the usefulness of such joint modeling over other existing methods.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationBy taking advantage of the determinism of m_t, the complexity of HSMM can be reduced to O(|Q|^2 M T), or even better to O((|Q|M+|Q|^2)T).
“By taking advantage of the determinism of m t (i.e.conditionally on a given state, m t+1 = m t -1), the complexity can be reduced to O (|Q | 2 M T ), or even better to O ((|Q |M +|Q | 2 )T )”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [43] Yu, 2003, An efficient forward-backward algorithm for an explicit-duration hidden Markov model, IEEE Signal Processing Letters source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenIf M is set to the observation length T, the problem is then to predetermine the maximum value for T.
“If M is set to the observation length T , the problem is then to predetermine the maximum value for T .”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe most common choice for modeling the state duration is the multinomial due to its simplicity.
“The most common choice for modeling the state duration is the multinomial [18,21,34,43] due to its simplicity.”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [18] S. Luhr, S. Venkatesh, G. West, H.H. Bui, Duration abnormality detection in sequences of human activity, Technical report, Department of Computing, Curtin University of Technology, May 2004 source
- cites [21] Mitchell, 1999, On the complexity of explicit duration HMMs, IEEE Transactions on Speech and Audio Processing source
- cites [34] L.R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in: Procs. IEEE, vol. 77, 1989, pp. 257–286 source
- cites [43] Yu, 2003, An efficient forward-backward algorithm for an explicit-duration hidden Markov model, IEEE Signal Processing Letters source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenIf the state duration distribution D_i is a geometric random variable, the HSMM reduces to an HMM.
“Clearly, if D i is a geometric random variable (or exponential as in the case of continuous time), the HSMM reduces to an HMM.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationLuhr et al. [17] were the first to employ the HHMM in modeling and recognizing human activities.
“Luhr et al. [17] were the first to employ the HHMM in modeling and recognizing human activities.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [17] S. Luhr, H.H. Bui, S. Venkatesh, G. West, Recognition of human activity through hierarchical stochastic learning, in: Int. Conf. on Pervasive Computing and Communication, 2003, pp. 416–422 source
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenTraditionally, the state duration D_i is modeled as the multinomial, or more generally, a member of the exponential family.
“Traditionally, D i is usually modeled as the multinomial, or more generally, a member of the exponential family.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe CxSHSMM can capture normal duration patterns of atomic activities spent at each location.
“As the CxSHSMM can capture normal duration patterns of atomic activities spent at each location”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn a standard HMM, the duration for a state can be viewed as a geometric random variable parameterized by the corresponding diagonal entry in the transition matrix.
“In a standard hidden Markov model [34], the (random) duration for a state can be viewed as a geometric random variable parameterized by the corresponding diagonal entry in the transition matrix.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [34] L.R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in: Procs. IEEE, vol. 77, 1989, pp. 257–286 source
May combine two claims.
Premisenone givenDiscrete distribution parameterization such as Poisson can be estimated in closed-form, whereas continuous distribution such as Gamma requires numerical approximation during learning.
“In addition, whereas the discrete distribution parameterization (e.g., Poisson) can be estimated in a closed-form, the continuous distribution (e.g., the Gamma) requires numerical approximation during learning.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisereasoningThe proposed switching HSMM differs from SLDS in that its state spaces are discrete, whereas SLDS is continuous at the lower level, and thus SLDS cannot model duration information.
“While both having two layers and their top layers switch in a similar manner, they are at least different in two fundamental ways: our state spaces are discrete, whilst the SLDS is continuous at the lower level, and thus SLDS cannot model duration information”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisenone givenIn HHMM and related models, the state hierarchy is restricted to a tree structure and does not allow sharing of lower-level states by states at higher levels.
“Nevertheless, in these models the state hierarchy in the HHMM is restricted to a tree structure.It does not allow the sharing of lower-level states by states at higher levels.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationBui et al. [3] introduced the concept of structure sharing to allow overlapping of common substructures in the HHMM topology, providing more flexibility.
“Bui et al. [3] introduced the concept of structure sharing to allow the overlapping of common substructures in the HHMM topology, thus providing more flexibility in the model.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [3] Bui, 2004, Hierarchical hidden Markov models with general state hierarchy
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisereasoningThe semi-Markov extension overcomes the limitation of the standard HMM by allowing more flexible duration distributions.
“The semi-Markov extension overcomes this limitation by allowing more flexible duration distributions.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataDuration information is important in activity modeling and can be effectively exploited by the Coxian parameterization.
“We demonstrate that duration information is important in activity modeling and can be effectively exploited by the Coxian parameterization.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenK is typically much smaller than the maximum duration M in practice.
“where K is typically much smaller than the maximum duration M in practice”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenThe hierarchical HMM variants have been reported to successfully exploit the hierarchical structures in human activities.
“The hierarchical HMM variants have been reported to successfully exploit the hierarchical structures in human activities.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenIn multinomial durations, M must be determined in advance.
“In addition, M must be determined in advance.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPrevious work has recognized the need for combining both the hierarchical and semi-Markov extensions into a unified framework.
“We note that previous work [14] has also recognized the need for combining both the hierarchical and semi-Markov extensions into a unified framework.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] H. Kautz, O. Etzioni, D. Fox, D. Weld, Foundations of assisted cognition systems, Technical report, University of Washington, CSE, March 2003
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationnone givenThe number of free parameters for the Coxian duration model is |Q|(2K-1), which is usually much smaller than |Q|(M-1) for the explicit duration model, where M can be potentially as large as T.
“Finally, note that the number of free parameters for the Coxian duration model is |Q |(2K -1) which is usually much smaller than |Q |(M -1) for the explicit duration model, where M can be potentially as large as T .”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe work in [37] considers fitting web server traffic data using Coxian phase-type distributions, and its model training method can be viewed as a special case of the CxSHSMM when the starting and ending indices at the top level are known.
“The work in [37] considers the problem of fitting web server traffic data using the Coxian phasetype distributions.The model training method presented in that paper can be viewed as a special case of the CxSHSMM when the starting and ending indices at the top level are known.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [37] Riska, 2002, Matrix-analytic analysis of a map/ph/1 queue fitted to web server data source
May combine two claims.
Interpretationnone givenThe CxHSMM scales linearly with the standard HMM multiplied by its number of phases K, whereas the MuHSMM and exponential family duration distribution HSMMs scale by the maximum duration length M.
“Regarding time complexity, the CxHSMM, as mentioned earlier, scales linearly with the standard HMM multiplied by its number of phases K , whereas the MuHSMM and the exponential family duration distribution HSMM (including PsHSMM and IgHSMM) scale by the maximum duration length M.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningIf duration is modeled by multinomial or exponential family distributions, the complexity is O(|Q*|^2 |Q|^2 M T), where M is the maximum duration length and typically M >> K; thus, when the model becomes hierarchical, a greater computational factor is saved by using the Coxian duration model.
“Again, if the duration is modeled by the multinomial or exponential family distributions, the complexity will be O (|Q * | 2 |Q | 2 M T ), where M is the maximum duration length and typically M K .Thus, when the model becomes more complex (i.e.hierarchical), a greater computational factor is saved by using the Coxian duration model.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenThe Coxian does not require a state to execute in a sequence of phases but allows entry into any arbitrary phase via the prior phase probability μ_m.
“In addition the Coxian does not require a state to execute in a sequence of phases but allows entry into any arbitrary phase via the prior phase probability μ m .”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningFor K << M, the CxHSMM can achieve significant speedup and avoid the problem of determining M in advance.
“For K M we can achieve significant speedup and at the same time avoided the problem of determining M in advance.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataIn comparison with PsHSMM and IgHSMM, CxHSMM is better in both performance and running time; in comparison with MuHSMM, CxHSMM retains slightly worse performance but at a small fraction of computational time.
“Therefore, in comparison with the PsHSMM and the IgHSMM, the CxHSMM is better not only in performance but also in running time; whereas in comparison with the MuHSMM, the CxHSMM retains a slightly worse performance but at a small fraction of the computational time.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThe study employs a leave-one-out cross validation strategy for training and testing.
“To ensure an objective result, we employ a leave-one-out cross validation strategy for training and testing.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningBecause within a given state the phase variables are constrained so that m_{t+1} ∈ {m_t, m_t-1}, the full joint probability of m_t and m_{t+1} can be represented in O(K) space instead of O(K^2), reducing the overall complexity to O(|Q|^2 K T) (or O(|Q|^2 K) per filtering step).
“However, since within a given state the phase variables are constrained so that m t+1 ∈ {m t , m t -1}, the full joint probability of m t and m t+1 can be represented in just O (K ) space instead of O (K 2 ).This reduces the overall complexity to O (|Q | 2 K T ) (or O (|Q | 2 K ) per filtering step).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationThe mean and variance of a Coxian distribution can be derived in closed-form expressions.
“The mean and variance of a Coxian distribution can also be derived in closed-form expressions [9,24]”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [9] T.V. Thi Duong, Efficient duration modelling in the hierarchical hidden semi-Markov models and their applications. PhD thesis, Department of Computing, Curtin University of Technology, 2008
- cites [24] Neuts, 1981
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone givenThe Coxian duration model can be viewed as a special state-tying mechanism where a state is split into K sub-states each controlling a separate Coxian phase.
“The Coxian duration model can also be viewed as a special statetying mechanism where a state is split into K sub-states each controlling a separate Coxian phase.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe state space of S_t in the CxSHSMM is O(|Q*||Q|K), and the recursive complexity of the smoothing distribution is O(|Q*|^2 |Q|^2 K T).
“The state space of S t is now O (|Q * ||Q |K ), therefore, the recursive complexity of the smoothing distribution is O (|Q * | 2 |Q | 2 K T ).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationAn observation model is estimated offline with manually labeled ground truth.
“This tracking module, however, sometimes returns a neighboring position instead of the actual position occupied by the person, so an observation model is estimated offline with manually labeled ground truth [26].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] N.T. Nguyen, S. Venkatesh, G. West, H.H. Bui, Learning people movement model from multiple cameras for behaviour recognition, in: Joint IAPR International Workshops on Structural and Syntactical Pattern Recognition and Statistical Techniques in Pattern Recognition, Lisbon, Portugal, 2004, pp. 315–324 source
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenFor K = 1, the CxSHSMM is equivalent to a HHMM.
“Finally, note that for K = 1, the CxSHSMM is equivalent to a HHMM.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe K-multinomial distribution is a special case of the Coxian if all λ_i is set to 1.
“The K -multinomial distribution is also a special case if all λ i is set to 1”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataFor the CxHSMM, six variants are trained by varying K from 2 to 7, and cross-validated performance on unseen data is measured to select the most suitable K.
“For the CxHSMM, we train six different variants by varying K from 2 to 7 (note that for K = 1, the CxHSMM reduces to a HMM).We measure the model's cross-validated performance in terms of classification accuracy and early detection rate (defined in the next section) on unseen data to select the most suitable K .”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe Multinomial has learned a rather 'spiky' distribution, showing a potential cause of concern for overfitting, whereas the Coxian seems to have the right fit, being able to pick up the most dominant mode and provide a smoother distribution.
“To illustrate this matter further, Fig. 10 plots another example where the Multinomial has learned a rather 'spiky' distribution, showing a potential cause of concern for overfitting, whereas the Coxian seems to have the right fit, being able to pick up the most dominant mode and provide a smoother distribution.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisenone given[2] did not provide any empirical evaluation, nor did it address the issue of model selection.
“In addition, [2] did not provide any empirical evaluation, nor did it address the issue of model selection.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [2] J.A. Bilmes, What HMMs can do, in: IEICE Transactions on Information and Systems, 2006, pp. 869–891 source
Probably not a substantial claim: may not pass S4 (based).
InterpretationreasoningSince the CxHSMM can be represented as a DBN, existing learning and inference methods for DBNs can be readily applied to our problem.
“Since the CxHSMM can be represented as a DBN, existing learning and inference methods for DBNs can be readily applied to our problem.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone givenWhen K=1, the CxHSMM is equivalent to an HMM.
“We note that when K = 1 the model is equivalent to a HMM.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenA very long duration would ideally require more phases while a short one can have as small as one phase.
“A very long duration would ideally require more phases while a short one can have as small as one phase (which, in this case, reduces to a single geometric).”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe recursive calculation of α_t is performed efficiently via dynamic programming, and in an identical fashion to that of the HMM, resulting in an inference complexity of O(|Q|^2 K^2 T), or O(|Q|^2 K^2) for each filtering step.
“The recursive calculation of αt (s) is performed efficiently via dynamic programming, and in an identical fashion to that of the HMM.That results in an inference complexity of O (|Q | 2 K 2 T ), or O (|Q | 2 K 2 ) for each filtering step.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataModel performance slightly decreases when K=6 and 7, a sign of starting to overfit the training data; thus K=5 is the optimal number of phases selected for this experiment.
“The model performance slightly decreases when K = 6 and 7, a sign of starting to overfit the training data.Thus, K = 5 is the optimal number of phases selected for this experiment.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningIn this experiment, K is optimal at 5, M varies from 100 to 120, and thus the Coxian is faster than other baseline models by a theoretical factor of 20 to 24 times.
“In this experiment, K is optimal at 5, whereas M varies from 100 to 120 depending on each activity.Thus, the Coxian is faster than other baseline models by a theoretical factor of 20 to 24 times.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThis makes the HSMM less flexible and unable to isolate abnormal segments in a sequence.
“This makes the HSMM less flexible and unable to isolate the abnormal segments in a sequence.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe proposed scheme automatically constructs a general abnormal model for each normal activity class and does not require adding new abnormal models in response to unseen data.
“automatically constructing a general abnormal model for each normal activity class, our scheme offers three advantages.Firstly, it does not require the addition of new abnormal models in response to unseen data.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe HSMM cannot segment the sequence into the six high-level activities, so it learns only a normal duration model at each cell location for the entire morning routine.
“Since the HSMM cannot segment the sequence into the six high-level activities, it learns only a normal duration model at each cell location for the entire morning routine.”
- Also stated in: § 6. Conclusion · plain
“We note that the flat HSMM cannot be used for high-level segmentation.”
Quote in the paperSubstantial claim- Also stated in: § 6. Conclusion · plain
May combine two claims.
PremisecitationThe 2-phase Coxian is chosen to represent abnormal data because it involves least computation and is known to have a high variance [32] suiting the variable characteristics of abnormality.
“The 2-phase Coxian is chosen to represent the abnormal data, not only because it involves least computation, but it is known to have a high variance [32] suiting the variable characteristics of abnormality.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [32] T. Osogami, M. Harchol-Balter, A closed-form solution for mapping general distributions to minimal PH-distributions, in: Int. Conf. on Modelling Tools and Techniques for Computer and Communication System Performance Evaluation, 2003, pp. 200–217 source
Classified as probably not a substantial claim.
Study design and conductreasoningTo ensure an objective evaluation, three different data sets (A, B, and C) are constructed, each consisting of 40 training and 22 testing sequences randomly partitioned from the 62 sequences.
“To ensure an objective evaluation, we construct three different data sets (A, B, and C), each consisting of 40 training and 22 testing sequences randomly partitioned from the 62 sequences.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningOne possible explanation for the K=3 misclassification is that activities (a.2) and (a.3) share many common children states and have identical starting children sets.
“One possible explanation is that, these two activities share many common children states, in addition to the fact that their starting children sets are identical.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenWhen applied to ADLs, the CxSHSMM can learn what an occupant normally does from unsegmented training data and then perform online activity classification and segmentation.
“When applying this model to the ADLs domain, the model can learn what an occupant normally does from unsegmented training data, and then performs online activity classification and segmentation.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe Coxian parameterization is more robust than the multinomial because it has significantly fewer free parameters, thus delivering more stable performances across activities.
“The improvements in both recognition rate and abnormality detection in our experiments confirm our belief that both duration and hierarchy information are crucial in the accurate modeling of ADLs; they further show that the Coxian parameterization is more robust as compared to the multinomial by having a significantly fewer number of free parameters, thus delivering more stable performances across”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenThe CxHSMM has three significant advantages over existing models: computational efficiency, low dimensionality of parameter space, and existence of closed-form parameter estimation.
“Our first main contribution is the innovative use of the Coxian distribution to efficiently model the duration information, resulting in a novel form of stochastic model, the CxHSMM, which has three significant advantages over existing models: its computational efficiency, low dimensionality of parameter space, and the existence of closed-form parameter estimation.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataImprovements in both recognition rate and abnormality detection in the experiments confirm that both duration and hierarchy information are crucial in accurate modeling of ADLs.
“The improvements in both recognition rate and abnormality detection in our experiments confirm our belief that both duration and hierarchy information are crucial in the accurate modeling of ADLs; they further show that the Coxian parameterization is more robust as compared to the multinomial by having a significantly fewer number of free parameters, thus delivering more stable performances across”
Quote in the paperSubstantial claim
The paper relies on this without support.
Activities of daily living have typical duration patterns.
“in dealing with ADLs, it is beneficial to exploit both their typical duration patterns and inherent hierarchical structures”
The paper relies on this without support.
Activities of daily living have inherent hierarchical structures.
“in dealing with ADLs, it is beneficial to exploit both their typical duration patterns and inherent hierarchical structures”
The paper relies on this without support.
Abnormality in the duration of activities can provide vital clues to an alert system as it may indicate the onset of illness or sudden strokes.
“Finally, abnormality in the duration of activities, if detected, can provide vital clues to an alert system as it may indicate the onset of illness or sudden strokes.”
The paper relies on this without support.
The geometric duration distribution of the two-layer HHMM is too restrictive to model realistic data.
“This however is too restrictive to model realistic data.”
The paper relies on this without support.
Abnormality in the duration of activities can provide important clues for an alert system, and a person staying at a location for longer than usual might indicate the onset of illness.
“Abnormality in the duration of activities, if detected, can provide important clues for an alert system.For example, in the elder care domain, a person staying at a location for a longer duration than usual might indicate the onset of illness.”
The paper relies on this without support.
Abnormal data are both diverse and rare.
“Thirdly, there is no need to train abnormal models, which is practically difficult as abnormal data are both diverse and rare.”
The paper relies on this without support.
The ability to point out when behavior has become abnormal or returned to normal is important in issuing timely alerts to caregivers.
“The ability to point out when the behavior has become abnormal, or returned to normal, is equally important in issuing timely alerts to caregivers.”
The paper relies on this without support.
The ability of the SHSMM to recognize early that activities have returned to normal is greatly important in monitoring ADLs in a smart home.
“We note that the ability of the SHSMM to recognize early that activities have returned to normal is greatly important in the context of monitoring ADLs in a smart home (e.g., for the aged).”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Semi-Markov models can significantly outperform hierarchical models, despite their better duration modelling.
“It has been shown that semi-Markov models can significantly outperform hierarchical models, despite their better duration modelling [5].”
From Activity recognition using semi-Markov models on real world smart home datasets (2010) · cites this paper as [5]
Section 5.4.3 (page unavailable) reports that the Coxian switching hidden semi-Markov model significantly outperformed a standard hierarchical HMM in activity segmentation. But the winning model combines semi-Markov duration modeling with a hierarchical structure; the result does not establish that a non-hierarchical semi-Markov model outperforms hierarchical models generally. Section 2.2 also says hierarchical HMMs lack explicit duration models, rather than having better duration modeling. (LLM, conf=0.83)
Experimental — accuracy not yet measuredDuong et al. applied HSMMs to activity recognition and compared performance using various duration distributions, suggesting the Coxian distribution for computational efficiency.
“In work by Duong et al.HSMMs were applied to activity recognition [5].They compared performance of the model using var-ious duration distributions and suggested the use of the Coxian distribution for computational efficiency.”
From Activity recognition using semi-Markov models on real world smart home datasets (2010) · cites this paper as [5]
The Coxian distribution can perform equally well as other distributions, but can save significant computational cost.
“Previous work has shown that the Coxian distribution can perform equally well as other distributions, but can save significant computational cost [5].”
From Activity recognition using semi-Markov models on real world smart home datasets (2010) · cites this paper as [5]
A lot of work is evaluated on laboratory datasets and simulated data.
“A lot of work is evaluated on laboratory datasets [5,14,24] and simulated data [9,11].”
From Activity recognition using semi-Markov models on real world smart home datasets (2010) · cites this paper as [5]
Previous work has separately evaluated HSMMs and SMCRFs on simulated and laboratory data, but this work is the first to evaluate these models on real-world activity recognition data and compare their performance in a single paper.
“Previous work has separately evaluated HSMMs [5] and SMCRFs [11,24] on simulated and laboratory data, but our work is the first to evaluate these models on real world activity recognition data and compare their performance in a single paper.”
From Activity recognition using semi-Markov models on real world smart home datasets (2010) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Table A.3 is labeled as the wrong model
MinorThe text identifies Table A.3 as containing CxSHSMM parameters, but the table heading calls them CxHSMM parameters.
“Table A.3 CxHSMM parameter.”
“Finally, the full set of the CxSHSMM's parameters when mapped into DBN is presented in Table A.3 in Appendix A.”
Coxian variance formula fails for the stated multinomial case
MinorThe displayed variance becomes zero when every phase-termination probability is 1. Yet the paper says this setting produces a multinomial distribution governed by μ, which can have nonzero variance across phase durations.
“σ 2 Cox = K m=1 μ 2 m m k=1 1 -λ k λ 2 k (5”
“The K -multinomial distribution is also a special case if all λ i is set to 1 (in that case Pr( X i = 1) = 1; thus, μ serves as the multinomial parameter).”
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · see citing works
Advances in Neural Information Processing Systems 14
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 9,184 · see citing works
A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
Rabiner, L. R. (1990) · Elsevier eBooks · doi:10.1016/b978-0-08-051584-7.50027-9 · Cited by 1,868 · see citing works
The Visual Analysis of Human Movement: A Survey
Gavrila, D. M. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0716 · Cited by 1,789 · see citing works
Matrix-Geometric Solutions to Stochastic Models
(1984) · doi:10.1007/978-3-642-69546-9_91 · Cited by 1,673 · see citing works
Human motion analysis: a review
Aggarwal, J. K., & Cai, Q. (2002) · doi:10.1109/namw.1997.609859 · Cited by 1,401 · see citing works
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273 · see citing works
Human Motion Analysis: A Review
Aggarwal, J. K., & Cai, Q. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0744 · Cited by 1,156 · see citing works
A model for reasoning about persistence and causation
Dean, T., & Kanazawa, K. (1989) · Computational Intelligence · doi:10.1111/j.1467-8640.1989.tb00324.x · Cited by 999 · see citing works
The hierarchical hidden Markov model: Analysis and applications
Fine, S., Singer, Y., & Tishby, N. (1998) · Machine Learning · doi:10.1023/a:1007469218079 · Cited by 906 · see citing works
An HMM-based threshold model approach for gesture recognition
Lee, H.-K., & Kim, J. H. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799904 · Cited by 673 · see citing works
Visual Recognition of American Sign Language Using Hidden Markov Models.
Starner, T. E. (1995) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 659 · see citing works
From HMM's to segment models: a unified view of stochastic modeling for speech recognition
Ostendorf, M., Digalakis, V. V., & Kimball, O. A. (1996) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.536930 · Cited by 587 · see citing works
Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model
Duong, T. V., Bui, H. H., Phung, D. Q., & Venkatesh, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.61 · Cited by 535 · cited 1× · see citing works
“9 We preliminarily introduce this model in our previous work in [8].”
MethodSelf-citationDetecting unusual activity in video
Zhong, H., Shi, J., & Visontai, M. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315249 · Cited by 497 · see citing works
Continuously variable duration hidden Markov models for automatic speech recognition
Levinson, S. E. (1986) · Computer Speech & Language · doi:10.1016/s0885-2308(86)80009-2 · Cited by 457 · see citing works
View-Invariant Representation and Recognition of Actions
Rao, C., Yılmaz, A., & Shah, M. A. (2002) · International Journal of Computer Vision · doi:10.1023/a:1020350100748 · Cited by 433 · see citing works
Layered representations for human activity recognition
Oliver, N., Horvitz, E., & Garg, A. (2003) · Proceedings. Fourth IEEE International Conference on Multimodal Interfaces · doi:10.1109/icmi.2002.1166960 · Cited by 312 · see citing works
Nguyen, N., Phung, D., Venkatesh, S., & Bui, H. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.203 · Cited by 312 · see citing works
Self-citationThe Inverse Gaussian Distribution: A Case Study in Exponential Families.
Jørgensen, B., & Seshadri, V. (1996) · Journal of the American Statistical Association · doi:10.2307/2291426 · Cited by 243 · see citing works
Policy Recognition in the Abstract Hidden Markov Model
Bui, H., Venkatesh, S., & WEST, G. A. W. (2002) · Cited by 243 · see citing works
Self-citationAn efficient forward-backward algorithm for an explicit-duration hidden Markov model
Yu, S.-Z., & Kobayashi, H. (2003) · IEEE Signal Processing Letters · doi:10.1109/lsp.2002.806705 · Cited by 226 · see citing works
Explicit modelling of state occupancy in hidden Markov models for automatic speech recognition
Russell, M., & Moore, R. (1985) · ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1985.1168477 · Cited by 194 · see citing works
Linear-time inference in Hierarchical HMMs
Murphy, K. P., & Paskin, M. A. (2001) · Cited by 187 · see citing works
BILMES, J. A. (2006) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e89-d.3.869 · Cited by 172 · see citing works
Matrix geometric solutions in stochastic models
Sengupta, B. (1987) · Communications in Statistics. Stochastic Models · doi:10.1080/15326348708807058 · Cited by 159 · see citing works
Vaswani, N., Roy–Chowdhury, A. K., & Chellappa, R. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.852197 · Cited by 149 · see citing works
Policy Recognition in the Abstract Hidden Markov Model
Bui, H. H., Venkatesh, S., & West, G. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.839 · Cited by 123 · see citing works
Self-citationFitch, A. J., Kadyrov, A., Christmas, W. J., & Kittler, J. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.849767 · Cited by 113 · see citing works
Marshall, A. H., & McClean, S. I. (2004) · Health Care Management Science · doi:10.1007/s10729-004-7537-z · Cited by 86 · see citing works
(2004) · Deakin Research Online (Deakin University) · Cited by 82 · see citing works
Self-citationPROCEEDINGS OF THE NINETEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE
Tate, A., Dalton, J., Siebra, C. D. A., et al. (2004) · National Conference on Artificial Intelligence · Cited by 67 · see citing works
On the complexity of explicit duration HMM's
Mitchell, C., Harper, M., & Jamieson, L. (1995) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.388149 · Cited by 63 · see citing works
(2003) · Cited by 62 · see citing works
Continuously variable duration hidden Markov models for speech analysis
Levinson, S. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1986.1168801 · Cited by 60 · see citing works
Recognition of human activity through hierarchical stochastic learning
Luhr, S., Bui, H. H., Venkatesh, S., & West, G. A. W. (2004) · Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003). · doi:10.1109/percom.2003.1192766 · Cited by 58 · see citing works
Self-citationA Closed-Form Solution for Mapping General Distributions to Minimal PH Distributions
Osogami, T., & Harchol-Balter, M. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45232-4_13 · Cited by 55 · see citing works
The theory of segmental hidden Markov models
(1993) · Cited by 54 · see citing works
Segmental hidden Markov models
Gales, M. J. F., & Young, S. J. (1993) · 3rd European Conference on Speech Communication and Technology (Eurospeech 1993) · doi:10.21437/eurospeech.1993-354 · Cited by 53 · see citing works
Modeling duration in a hidden Markov model with the exponential family
Mitchell, C. D., & Jamieson, L. H. (1993) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1993.319304 · Cited by 49 · see citing works
Learning and inference in parametric switching linear dynamic systems
Oh, S. M., Rehg, J. M., Balch, T., & Dellaert, F. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.135 · Cited by 40 · see citing works
Matrix-analytic methods: theory and applications
Latouche, G., & Taylor, P. G. (2002) · Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) · Cited by 38 · see citing works
MATRIX-ANALYTIC ANALYSIS OF A MAP/PH/1 QUEUE FITTED TO WEB SERVER DATA
RISKA, A., SQUILLANTE, M. S., YU, S.-Z., LIU, Z., & ZHANG, L. (2002) · Matrix-Analytic Methods · doi:10.1142/9789812777164_0018 · Cited by 38 · see citing works
Time series prediction using belief network models
Dagum, P., & Galper, A. R. (1995) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1995.1027 · Cited by 36 · see citing works
Explicit State Duration HMM for Abnormality Detection in Sequences of Human Activity
Lühr, S., Venkatesh, S., West, G., & Bui, H. H. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28633-2_125 · Cited by 34 · see citing works
Self-citationLearning hierarchical models of activity
Osentoski, S., Manfredi, V., & Mahadevan, S. (2005) · doi:10.1109/iros.2004.1389465 · Cited by 32 · see citing works
Matrix -Analytic Methods: Theory and Applications
Metcalfe, A. V., Swailes, D. C., & Green, D. (2002) · Cited by 31 · see citing works
Parameterized Duration Mmodeling for Switching Linear Dynamic Systems
Oh, S. M., Rehg, J. M., & Dellaert, F. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.218 · Cited by 26 · see citing works
Multiple frame motion inference using belief propagation
Gao, J., & Shi, J. (2004) · doi:10.1109/afgr.2004.1301644 · Cited by 24 · see citing works
Statistical shape theory for activity modeling
Vaswani, N., Chowdhury, A. R., & Chellappa, R. (2003) · 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). · doi:10.1109/icassp.2003.1199519 · Cited by 14 · see citing works
Duration Abnormality Detection in Sequences of Human Activity
Lühr, S., Venkatesh, S., WEST, G. A. W., & Bui, H. (2004) · Deakin Research Online (Deakin University) · Cited by 14 · see citing works
Self-citationLearning People Movement Model from Multiple Cameras for Behaviour Recognition
Nguyen, N. T., Venkatesh, S., West, G. A. W., & Bui, H. H. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-27868-9_33 · Cited by 7 · see citing works
Self-citation(2008) · eSpace (Curtin University) · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
5 of the 58 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- K. Murphy, Learning switching Kalman filter models, Technical report, Campaq Cambridge Research Lab, 1998
- U. Nodelman, C.R. Shelton, D. Koller, Expectation maximization and complex duration distributions for continuous time Bayesian networks, in: Proc. of the 21st International Conference on Uncertainty in Artificial Intelligence, 2005, pp. 421–430
Cited by
Sorted by citations
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215 · see citing works
Ordóñez, F. J., de Toledo, P., & Sanchis, A. (2013) · Sensors · doi:10.3390/s130505460 · Cited by 279 · see citing works
“Systems that recognize ADL from sensor data are now an active topic of research; indeed diverse approaches have been proposed to deal with the activity recognition problem, ranging from video cameras [7], RFID readers [8] and wearable sensors [9].”
BackgroundHuman activity recognition based on multienvironment sensor data
Li, Y., Yang, G., Su, Z., Li, S., & Wang, Y. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.10.015 · Cited by 251 · see citing works
Human Activity Recognition from Wireless Sensor Network Data: Benchmark and Software
van Kasteren, T. L. M., Englebienne, G., & Kröse, B. (2011) · Atlantis ambient and pervasive intelligence · doi:10.2991/978-94-91216-05-3_8 · Cited by 215 · see citing works
“the location of a person in a kitchen setup [ 19 ].”
BackgroundReview of fall detection techniques: A data availability perspective
Khan, S. S., & Hoey, J. (2016) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2016.10.014 · Cited by 210 · see citing works
“[85] model the duration of activities using a Coxian distribution [86] and consider a hierarchy of activities to propose a Switching Hidden Semi-Markov Model and show its application to activity segmentation and abnormality detection in smart environments.”
MethodPlan, Activity, and Intent Recognition
Sukthankar, G., Geib, C., Bui, H., Pynadath, D. V., & Goldman, R. P. (2014) · Elsevier eBooks · doi:10.1016/c2012-0-01169-6 · Cited by 157 · see citing works
Self-citationTransferring Knowledge of Activity Recognition across Sensor Networks
van Kasteren, T. L. M., Englebienne, G., & Kröse, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12654-3_17 · Cited by 151 · see citing works
“Sensing systems may include camera’s [10], RFID [19,30], wearables [11,15] and wireless sensor networks [23,27].”
BackgroundActivity recognition using semi-Markov models on real world smart home datasets
van Kasteren, T. L. M., Englebienne, G., & Kröse, B. J. A. (2010) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-2010-0070 · Cited by 131 · see citing works
“Previous work has shown that the Coxian distribution can perform equally well as other distributions, but can save significant computational cost [5].”
InfluentialSensor-based human activity recognition system with a multilayered model using time series shapelets
Liu, L., Peng, Y., Liu, M., & Huang, Z. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.09.024 · Cited by 102 · see citing works
Online activity recognition using evolving classifiers
Ordóñez, F. J., Iglesias, J. A., de Toledo, P., et al. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.08.066 · Cited by 80 · see citing works
Computational State Space Models for Activity and Intention Recognition. A Feasibility Study
Krüger, F., Nyolt, M., Yordanova, K., Hein, A., & Kirste, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109381 · Cited by 78 · see citing works
Exploring Techniques for Vision Based Human Activity Recognition: Methods, Systems, and Evaluation
Xu, X., Tang, J., Zhang, X., et al. (2013) · Sensors · doi:10.3390/s130201635 · Cited by 75 · see citing works
THE DESIGN OF A PROACTIVE PERSONAL AGENT FOR TASK MANAGEMENT
Yorke‐Smith, N., Saadati, S., Myers, K. L., & Morley, D. N. (2012) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213012500042 · Cited by 70 · see citing works
Development of Audio Sensing Technology for Ambient Assisted Living: Applications and Challenges
Vacher, M., Portet, F., Fleury, A., & Noury, N. (2011) · International Journal of E-Health and Medical Communications · doi:10.4018/jehmc.2011010103 · Cited by 74 · see citing works
“Therefore, activity recognition is an active research area (Duong et al., 2009)(Vacher et al., 2010a) but, despite this, it has still not reached a satisfactory performance nor led to a standard methodology given the high number of flat configurations.”
BackgroundChahuara, P., Fleury, A., Portet, F., & Vacher, M. (2016) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-160386 · Cited by 68 · see citing works
“Hidden Markov Models (HMMs) [61] (Figure 2) are extensively used in activity recognition, for which it has become a “standard” approach [23,52,84].”
InfluentialTwo-Layer Hidden Markov Model for Human Activity Recognition in Home Environments
Kabir, M. H., Hoque, M. R., Thapa, K., et al. (2016) · International Journal of Distributed Sensor Networks · doi:10.1155/2016/4560365 · Cited by 67 · see citing works
“Microphones and video camera based activity recognition is complex to implement because it requires processing of multidimensional data and may violate issue of user’s privacy [1–6].”
MethodTao, L., Paiement, A., Damen, D., et al. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.11.016 · Cited by 65 · see citing works
Vacher, M., Fleury, A., Portet, F., Sérignat, J.-F., & Noury, N. (2010) · InTech eBooks · doi:10.5772/7596 · Cited by 63 · see citing works
“The second section is devoted to the Health Smart Home of the TIMC-IMAG laboratory which served for the experiments described further in this chapter.”
BackgroundMethodInfluentialBayesian Hierarchical Dynamic Model for Human Action Recognition
Zhao, R., Xu, W., Su, H., & Ji, Q. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00792 · Cited by 67 · see citing works
“To handle speed variation, Hidden semi-Markov Model (HSMM) [56] and its variants [11, 34, 33] are proposed to explicitly model the lasting time of hidden states.”
Liu, T., & Zhu, K. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3004445 · Cited by 58 · see citing works
“Hence, the SHSMM [29], [30] is unable to represent the degradation process”
BackgroundInfluentialA systematic review of data-driven approaches in player modeling of educational games
Hooshyar, D., Yousefi, M., & Lim, H. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-017-9609-8 · Cited by 59 · see citing works
“It has been actively investigated with a variety of machine learning techniques such as Bayesian inference models (Geib and Goldman 2009), dynamic Bayesian networks (Duong et al. 2009), Markov logic networks (Ha et al. 2012), and Artificial Neural Networks (Min et al. 2014).”
BackgroundFeature extraction for human activity recognition on streaming data
Yala, N., Fergani, B., & Fleury, A. (2015) · International Symposium on Innovations in Intelligent SysTems and Applications · doi:10.1109/inista.2015.7276759 · Cited by 57 · see citing works
Player goal recognition in open-world digital games with long short-term memory networks
Min, W., Mott, B., Rowe, J., et al. (2016) · International Joint Conference on Artificial Intelligence · Cited by 54 · see citing works
Roggen, D., Magnenat, S., Waibel, M., & Tröster, G. (2011) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2011.940992 · Cited by 51 · see citing works
“supplement its known set of behaviors with an internal model to recognize different demonstrated activities [10], [11], and even build a repertoire of sub-goals and obtain a hierarchical decomposition of its actions [12].”
Gaggioli, A., Ferscha, A., Riva, G., Dunne, S., & Viaud‐Delmon, I. (2015) · doi:10.1515/9783110471137 · Cited by 51 · see citing works
Persim 3D: Context-Driven Simulation and Modeling of Human Activities in Smart Spaces
Lee, J. W., Cho, S., Liu, S., et al. (2015) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2015.2467353 · Cited by 39 · see citing works
Roggen, D., Magnenat, S., Waibel, M., & Tröster, G. (2011) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-010001702 · Cited by 34 · see citing works
“Using activity recognition, the robot can supplement its known set of behaviors with an internal model to recognize different demonstrated activities [10], [11] and even build a repertoire of subgoals and obtain a hierarchical decomposition of its actions [12].”
BackgroundA multi-phase DES modelling framework for patient-centred care
Gillespie, J., McClean, S. I., Garg, L., et al. (2016) · Journal of the Operational Research Society · doi:10.1057/jors.2015.114 · Cited by 32 · see citing works
“…work well for a range of settings and scales, including hospitals (Fackrell, 2009; Marshall and Zenga, 2012; Tang et al, 2012; Griffiths et al, 2013; Garg et al, 2015), community care (Xie et al, 2006), emergency services (Knight and Harper, 2012) and patient activity recognition (Thi et al, 2009).”
BackgroundNguyen, T., Phung, D., Gupta, S., et al. (2013) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2013.6526713 · Cited by 32 · see citing works
“Early work in activity recognition has mainly focused on signals acquired from fixed cameras (e.g [10], [11]).”
BackgroundSelf-citationUsing Markov Logic Network for On-Line Activity Recognition from Non-visual Home Automation Sensors
Chahuara, P., Fleury, A., Portet, F., & Vacher, M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34898-3_12 · Cited by 32 · see citing works
“[10] extended a conventional HMM to model the duration of an activity and Naaem et al.”
MethodHuman Activity Discovery and Recognition Using Probabilistic Finite-State Automata
Viard, K., Fanti, M. P., Faraut, G., et al. (2020) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.2989226 · Cited by 29 · see citing works
“By using a similar model, article [16] addresses the problem of recognizing ADLs in smart homes in a hidden semi-Markov model (HSMM) framework.”
MethodA Network of Dynamic Probabilistic Models for Human Interaction Analysis
Suk, H., Jain, A. K., & Lee, S. (2011) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2133570 · Cited by 28 · see citing works
An Annotation Technique for In-Home Smart Monitoring Environments
Zamil, M. G. H. A., Rawashdeh, M., Samarah, S., et al. (2017) · IEEE Access · doi:10.1109/access.2017.2779158 · Cited by 27 · see citing works
“In other cases, the experimenters have guided participants toward the exact order in which the activities should be performed, so that the right activity labels are known before the sensor reports its data [16], [17].”
BackgroundKarami, A., Fleury, A., Boonært, J., & Lecœuche, S. (2016) · Information · doi:10.3390/info7020035 · Cited by 28 · see citing works
“• Sequential algorithms, such as Hidden Markov Models (HMMs) [17], Conditional Random Fields (CRFs) [18] or also Markov Logic Networks (MLNs) [19].”
BackgroundMulti-instance Metric Learning
Xu, Y., Ping, W., & Campbell, A. T. (2011) · Proceedings · doi:10.1109/icdm.2011.106 · Cited by 25 · see citing works
“Activity recognition [12] is an important task in machine learning and data mining due to its wide application domains such as medical diagnosis [22], human behavior modeling [20] and public facility analysis [42].”
BackgroundA hierarchical neuro-fuzzy architecture for human behavior analysis
Acampora, G., Foggia, P., Saggese, A., & Vento, M. (2015) · Information Sciences · doi:10.1016/j.ins.2015.03.021 · Cited by 25 · see citing works
Improving Activity Recognition by Segmental Pattern Mining
Avcı, U., & Passerini, A. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.127 · Cited by 19 · see citing works
“Index Terms—Activity recognition, pattern mining, segmental labeling Ç”
BackgroundDeliberative acting, planning and learning with hierarchical operational models
Patra, S., Mason, J., Ghallab, M., Nau, D. S., & Traverso, P. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103523 · Cited by 20 · see citing works
Yin, Q., Yue, S., Zha, Y., et al. (2016) · Mathematical Problems in Engineering · doi:10.1155/2016/1907971 · Cited by 16 · see citing works
“Duong et al. proposed a Coxian hidden semi-Markov model (CxHSMM) for recognizing human activities of daily living (ADL) [24].”
BackgroundLarge-scale statistical modeling of motion patterns
Rana, S., Phung, D., Pham, S., et al. (2012) · doi:10.1145/2425333.2425340 · Cited by 13 · see citing works
“Simple moving objects can also be tracked by the standard Kalman filters such as [4]where a hierarchical HMM is used to model the”
MethodSelf-citationLog-Viterbi algorithm applied on second-order hidden Markov model for human activity recognition
Yang, S., Thapa, K., Kabir, M. H., et al. (2018) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147718772541 · Cited by 12 · see citing works
Han, T. A., & Pereira, L. M. (2013) · Intelligent Decision Technologies · doi:10.3233/idt-130170 · Cited by 12 · see citing works
“[86, 22]).”
Online Bayesian Learning in Probabilistic Graphical Models using Moment Matching with Applications
Omar, F. (2018) · UWSpace (University of Waterloo) · doi:10.13140/rg.2.2.22951.04003 · Cited by 10 · see citing works
Learning Latent Activities from Social Signals with Hierarchical Dirichlet Processes
Phung, D., Nguyen, T., Gupta, S., et al. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-398532-3.00006-3 · Cited by 10 · see citing works
Self-citationAgent‐oriented activity recognition in the event calculus: An application for diabetic patients
Kafalı, Ö., Romero, A. E., & Stathis, K. (2017) · Computational Intelligence · doi:10.1111/coin.12121 · Cited by 9 · see citing works
Jiao, P., Xu, K., Yue, S., et al. (2017) · Discrete Dynamics in Nature and Society · doi:10.1155/2017/4580206 · Cited by 9 · see citing works
“[18] proposed a Coxian hidden semi-Markov model (CxHSMM) for recognizing human activities of daily living (ADL).”
BackgroundUser-optimized activity recognition for exergaming
Mortazavi, B. J., Pourhomayoun, M., Lee, S. I., et al. (2015) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2015.11.001 · Cited by 9 · see citing works
“Most multiple model systems [24,26,37] still present classification results as an overall metric.”
BackgroundLearning body part‐based pose lexicons for semantic action recognition
Zhou, L. M., & Jiang, T. (2022) · IET Computer Vision · doi:10.1049/cvi2.12143 · Cited by 8 · see citing works
Classification and Decision-Theoretic Framework for Detecting and Reporting Unseen Falls
Khan, S. S. (2016) · UWSpace (University of Waterloo) · doi:10.13140/rg.2.2.34981.29929 · Cited by 8 · see citing works
Giakoumis, D., Stavropoulos, G., Kikidis, D., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16199-0_57 · Cited by 8 · see citing works
“During inference, by employing the forward-backward algorithm, the probability that the respective model can produce the input trajectory can be calculated [6].”
BackgroundMethodInfluentialEveryday Life Sounds Database: Telemonitoring of Elderly or Disabled
Abdoune, L., & Fezari, M. (2014) · Journal of Intelligent Systems · doi:10.1515/jisys-2014-0110 · Cited by 7 · see citing works
Activity recognition using logical hidden semi-Markov models
Zha, Y., Yue, S., Yin, Q., et al. (2013) · doi:10.1109/iccwamtip.2013.6716604 · Cited by 7 · see citing works
“Generally, there are two ways to overcome the limitations of standard models: the one is introducing hierarchical structure; the other is modeling states duration and transition more accurately [9].”
BackgroundAn efficient method of human behavior recognition in smart environments
Hu, C.-H., & Wo, S. (2010) · International Conference on Computer Application and System Modeling · doi:10.1109/iccasm.2010.5622464 · Cited by 7 · see citing works
“In this paper, combining the two methods, the study on recognizing human behaviors with vision sensors have typically involved two basic steps[6]: (1) human tracking and detection, and (2) behavior recognition.”
BackgroundMethodLearning alternative ways of performing a task
Nieves, D., Ramírez-Quintana, M. J., Monserrat, C., Ferri, C., & Hernández‐Orallo, J. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113263 · Cited by 6 · see citing works
“Probabilistic models are often used, such as Hidden Markov Models (HMMs) (Boger et al., 2005; Kalra et al., 2013; Duong et al., 2009) or Dynamic and Naïve Bayes networks (Baker et al., 2009; Dai et al., 2008; Oh et al., 2014).”
MethodA temporal belief-based hidden markov model for human action recognition in medical videos
Ahouandjinou, A., Motamed, C., & Ezin, E. C. (2015) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661815030025 · Cited by 6 · see citing works
“HMM’s states are based on the extraction of low level features in videos.”
BackgroundMethodInfluentialA sound database for health smart home
Abdoune, L., & Fezari, M. (2014) · doi:10.1109/wccais.2014.6916546 · Cited by 6 · see citing works
PASS: A Parallel Activity-Search System
Pugliese, A., Subrahmanian, V. S., Thomas, C., & Molinaro, C. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.171 · Cited by 6 · see citing works
“3 and suppose P = {P1, P2} with P1 = {Detect Person, Detect Car Moving, Detect Car Stopped, Detect Door Opening} and P2 = {Detect Person Moving, Detect Door Closing}.”
MethodInfluentialImproving activity recognition by segmental pattern mining
Avcı, U., & Passerini, A. (2012) · doi:10.1109/percomw.2012.6197605 · Cited by 6 · see citing works
Vasileiadis, M., Giakoumis, D., Votis, K., et al. (2016) · doi:10.1145/2910674.2935830 · Cited by 5 · see citing works
“In [7], PIR sensors were used to record the occupant’s movement, while in [8][9] RGB cameras were utilized towards activity recognition.”
MethodFeature extractionand incremental learning to improve activity recognition on streaming data
Yala, N., Fergani, B., & Fleury, A. (2015) · doi:10.1109/eais.2015.7368787 · Cited by 5 · see citing works
Mokhtari, N., Nédélec, A., & Loor, P. D. (2022) · Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications · doi:10.5220/0010835800003124 · Cited by 4 · see citing works
“Studies have been made in this research field to determine the characteristics of an activity as well as the differences between form and style of the same activity performed by several people (LeCun et al., 2015; Duong et al., 2009).”
BackgroundProactivity: The Next Step in Voice Assistants for the TV Ecosystem
Abreu, J., Santos, R., Silva, T., Marques, T., & Cardoso, B. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-56574-9_7 · Cited by 4 · see citing works
Recognition of human activity based on probabilistic finite-state automata
Viard, K., Fanti, M. P., Faraut, G., et al. (2017) · doi:10.1109/etfa.2017.8247621 · Cited by 4 · see citing works
“Therefore AR methods based on several activity models in which a sequence likelihood computation allows recognition of the performed activity are more efficient [12].”
MethodCredal human activity recognition based-HMM by combining hierarchical and temporal reasoning
Ahouandjinou, A., Motamed, C., Ezin, E. C., & Pinti, A. (2015) · International Conference on Image Processing Theory, Tools and Applications (IPTA) · doi:10.1109/ipta.2015.7367094 · Cited by 4 · see citing works
“models includes: the Abstract HMM [11], the Hierarchical HMM [2], [8], [10], and the Layered HMM [12] and Semi-Hidden Markov Model (SHMM) and introduces its hidden variants [13] including explicit duration HMMs [2], [8] and segmental HMMs [9].”
MethodActivity Playback Modeling for Smart Home Simulation
Liu, S., Helal, S., & Lee, J. W. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-19312-0_8 · Cited by 4 · see citing works
“Duong [7][8] also used HMM based techniques to model activities, and took a step further using Coxian distribution to model the duration of the states.”
MethodSynthetic ground truth data generation for automatic trajectory-based ADL detection
Papamakarios, G., Giakoumis, D., Votis, K., et al. (2014) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2014.6864297 · Cited by 4 · see citing works
“3c), we use as in [12], HMMs to model them; hidden states correspond to house areas and 2D locations are the observable variables.”
BackgroundMethodInfluentialDevelopment of Audio Sensing Technology for Ambient Assisted Living
Vacher, M., Portet, F., Fleury, A., & Noury, N. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-2794-9.ch009 · Cited by 4 · see citing works
On-line ADL Recognition with Prior Knowledge
Ullberg, J., Coradeschi, S., & Pecora, F. (2010) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-676-8-354 · Cited by 4 · see citing works
Enhanced Spatio- Temporal Image Encoding for Online Human Activity Recognition
Mokhtari, N., Fer, V., Nédélec, A., et al. (2023) · doi:10.1109/icmla58977.2023.00130 · Cited by 3 · see citing works
Using Markov Models to Characterize and Predict Process Target Compliance
McClean, S. I. (2021) · Mathematics · doi:10.3390/math9111187 · Cited by 3 · see citing works
Using model’s temporal features and hierarchical structure for similar activity recognition
Li, Q., Ning, H., Mao, L., & Chen, L. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02035-6 · Cited by 3 · see citing works
Papamakarios, G., Giakoumis, D., Vasileiadis, M., et al. (2015) · doi:10.1515/9783110471137-016 · Cited by 3 · see citing works
“Duong, Phung, Bui, and Venkatesh (2009) used a two-layer Hidden Semi-Markov Model to infer activities solely based on resident location trajectories.”
MethodUsing Hidden Semi-Markov Model for learning behavior in smarthomes
Paris, A., Arbaoui, S., Cislo, N., Amraoui, A. E., & Ramdani, N. (2015) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/coase.2015.7294171 · Cited by 3 · see citing works
“The HSMM, and its related models, are frequently used in the modeling of the behavior or supervision systems in smart homes, as in [20] [21].”
MethodMultiple model recognition for near-realistic exergaming
Mortazavi, B. J., Pourhomayoun, M., Nyamathi, S., Wu, B., Lee, S. I., & Sarrafzadeh, M. (2015) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2015.7146520 · Cited by 3 · see citing works
A Logical Hierarchical Hidden Semi-Markov Model for Team Intention Recognition
Yue, S., Jiao, P., Zha, Y., et al. (2015) · Discrete Dynamics in Nature and Society · doi:10.1155/2015/975951 · Cited by 3 · see citing works
“When 𝑒 𝑘 = 0 , 𝜋 𝑘 will continue at the next time; in the other case, it will be changed according to Δ 𝑡 or 𝛾 𝑡 .”
MethodInfluentialContinuous discovery of co-location contexts from Bluetooth data
Nguyen, T., Gupta, S., Venkatesh, S., et al. (2014) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2014.12.005 · Cited by 3 · see citing works
Self-citationFixed-lag particle filter for continuous context discovery using Indian Buffet Process
Nguyen, T., Gupta, S., Venkatesh, S., et al. (2014) · doi:10.1109/percom.2014.6813939 · Cited by 3 · see citing works
“A wide range of sensors has been used, varying from static camera [7], [8] to WiFi hotspots [3], [21], [22].”
BackgroundSelf-citationRecognizing and Discovering Activities of Daily Living in Smart Environments
Avci, U. (2013) · Università degli studi di Trento · doi:10.15168/11572_368953 · Cited by 3 · see citing works
Augmenting Mobile Localization with Activities and Common Sense Knowledge
Bicocchi, N., Castelli, G., Mamei, M., et al. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25167-2_8 · Cited by 3 · see citing works
“This approach, showed to be prone to over-fitting, is sensitive to application domain and requires more data to initialize the system [8].”
MethodChahuara, P., Vacher, M., & Portet, F. (2010) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 3 · see citing works
Switching GMM-HMM for Complex Human Activity Modeling and Recognition
Qin, W., & Wu, H. (2022) · doi:10.1109/cac57257.2022.10055662 · Cited by 2 · see citing works
“Unlike HHMM, the LHMM is not a single model but a set of HMMs arranged hierarchically, and each HMM has to be trained separately.”
MethodInfluentialLearning to Abstract and Predict Human ActionsPreprint
de Morais, R. F. A. B., Le, V., Tran, T., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.09234 · Cited by 2 · see citing works
“Early works investigated the hierarchy of activity through layered HMM [6], layered CRF [23], and linguistic-like grammar [21].”
Self-citationAhouandjinou, A., Ezin, E. C., & Motamed, C. (2015) · Revue Africaine de la Recherche en Informatique et Mathématiques Appliquées · doi:10.46298/arima.1999 · Cited by 2 · see citing works
“The proposed multi-camera scenario recognition approach is based on a Temporal HMM (THMM) inspired from many related work proposed in [1, 6, 7, 8, 9].”
MethodMulti-Agent Intention Recognition using Logical Hidden Semi-Markov Models
Yue, S., Zha, Y., Yin, Q., et al. (2014) · doi:10.5220/0005036707010708 · Cited by 2 · see citing works
“further proposed Coxian switching hidden semiMarkov model, which both built a hierarchical structure and introduced Coxian distribution modeling the duration of states to recognize human activities of daily living (Duong et al., 2009).”
BackgroundA Review of Dynamic Bayesian Network Techniques with Applications in Healthcare Risk Modelling
Mesgarpour, M., Chaussalet, T., & Chahed, S. (2014) · WestminsterResearch (University of Westminster) · doi:10.4230/oasics.scor.2014.89 · Cited by 2 · see citing works
Optimizing Maintenance Planning in the Production Industry Using the Markovian Approach
Kareem, B., & Owolabi, H. (2012) · The Journal of Engineering Research [TJER] · doi:10.24200/tjer.vol9iss2pp46-63 · Cited by 2 · see citing works
“Markovian based models have been applied in manpower planning in the manufacturing industries in the areas of optimal portfolio choice (Elliott and Siu 2009), promotion effects on retention rates (Tsao et al. 2009), and human activity recognition (Duong et al. 2009).”
BackgroundMethodInfluentialAnalysis and performance of three methods of human action recognition
Shrivastava, R., & Singh, A. P. (2012) · Cited by 2 · see citing works
Applying a Dynamic Bayesian Network Framework to Transliteration Identification
Nabende, P. (2010) · doi:10.63317/4gmr8qbctv9p · Cited by 2 · see citing works
“…classification (Filali and Bilmes, 2005), cognate identification (Kondrak and Sherif, 2006), Human behaviour modelling (Oliver & Horvitz, 2003; Duong et al., 2009), etc. DBNs generalize a variety of models including some of the most common models that have been used in various Natural…”
BackgroundAbdelkawy, H. (2021) · theses.fr (ABES) · doi:10.70675/3ae0f056z1a4az4407z8309zd6153c0e83d7 · Cited by 1 · see citing works
Deliberative Acting, Online Planning and Learning with Hierarchical Operational ModelsPreprint
Patra, S., Mason, J., Ghallab, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01909 · Cited by 1 · see citing works
An Overview of Classification Issues in Sensor-Based Activity Recognition
Ahad, M. A. R., Antar, A. D., & Ahmed, M. (2020) · Intelligent systems reference library · doi:10.1007/978-3-030-51379-5_7 · Cited by 1 · see citing works
Using Phase-type Models to Monitor and Predict Process Target Compliance
McClean, S. I., Stanford, D. A., Garg, L. K., et al. (2019) · doi:10.5220/0007362200820090 · Cited by 1 · see citing works
“…work well for a range of settings and scales, including hospitals (Fackrell, 2009), (Tang et al., 2012), (Marshall and Zenga, 2012), and (Griffiths et al., 2013), community care (Xie et al., 2006), emergency services (Knight and Harper, 2012) and patient activity recognition (Duong et al., 2009).”
BackgroundClassics of Deep Learning Approach for Human Behaviour Ontology: A Survey
Divakar, H. R., & kash, B. R. P. (2017) · International Journal of Computer Trends and Technology · doi:10.14445/22312803/ijctt-v51p107 · Cited by 1 · see citing works
“Human activities have inherent hierarchical structures, and in the context of using sensors for HAR, are very prone to small translations at the input [21], [22].”
BackgroundLearning Multifaceted Latent Activities from Heterogeneous Mobile Data
Nguyen, T. B., Nguyen, V., Nguyen, T., Venkatesh, S., Kumar, M. J., & Phung, D. (2016) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2016.48 · Cited by 1 · see citing works
“This is closely related to the field of activity recognition which has attracted significant research attention in during the last two decades with various success such as recognition of Activity of Daily Living (ADL) (e.g., [12], [13]).”
Self-citationA two-layer semi-Markov model for recognizing the destination of a moving agent
Yue, S., Xu, K., Qin, L., et al. (2015) · doi:10.1109/icma.2015.7237608 · Cited by 1 · see citing works
“Duong presented a Coxian Switching Hidden semi-Markov Model (CxSHSMM) to recognize human activities of daily living [12].”
BackgroundAnalyse sonore et multimodale dans le domaine de l'assistance à domicile
Vacher, M. (2011) · HAL · Cited by 2 · see citing works
Modèles Décisionnels d'Interaction Homme-Robot
Karami, A., & Mouaddib, A. (2011) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 1 · see citing works
Thornton, C., Smith, B. C., Besné, G. M., Little, B., & Wang, Y. (2024) · IEEE International Conference on Cybernetics, Cognition and Machine Learning Applications (ICCCMLA) · doi:10.1109/icccmla63077.2024.10871508
“Much work has gone into applying machine learning - both supervised and unsupervised - to human activity recognition using wearable sensors, including HSMMs [34].”
Smith, D., Baumgartner, P., McGinness, L. P., Kapoor, R., Rana, M., Rahman, A., Schutt, A., & Tartaglia, E. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4792141
An Approach for Spatial Optimization on Positioning Surveillance Cameras
Tapia-McClung, R., & Lopez‐Farias, R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-65282-0_24
- Authors
- Duong, T., Phung, D., Bui, H., & Venkatesh, S.
- Affiliations
- Curtin University (AU)
- SRI International (US)
- Corresponding author
- Duong, Thi
- Venue
- Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2009-05
- Volume
- 173
- Issue
- 7-8
- Pages
- 830-856
- ISSN
- 0004-3702 (ISSN-L)
- OpenAlex
- W2121454513
- Cited by
- 108
- References
- 58
- Citations by year
- 2024: 3 · 2023: 1 · 2022: 4 · 2021: 4 · 2020: 8 · 2019: 4 · 2018: 3 · 2017: 7 · 2016: 13 · 2015: 19 · 2014: 10 · 2013: 9 · 2012: 8
- FWCI
- 7.77
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Artificial Intelligence (publishedVersion)
- eSpace (Curtin University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, activities of daily living, Coxian distribution, hidden semi-Markov model, duration modeling, hierarchical models, activity segmentation, anomaly detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review