CoChat
Sign Up
PreprintCited by 606Context-Aware Activity Recognition SystemsGait Recognition and AnalysisHuman Pose and Action Recognition

Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables

Open access
Hammerla, Nils Y., Halloran, Shane, Ploetz, Thomas·2016·arXiv
DOI 10.48550/arxiv.1604.08880arXiv 1604.08880
Open this paper in CoChat — free accountOpen PDF

Abstract

Human activity recognition (HAR) in ubiquitous computing is beginning to adopt deep learning to substitute for well-established analysis techniques that rely on hand-crafted feature extraction and classification techniques. From these isolated applications of custom deep architectures it is, however, difficult to gain an overview of their suitability for problems ranging from the recognition of manipulative gestures to the segmentation and identification of physical activities like running or ascending stairs. In this paper we rigorously explore deep, convolutional, and recurrent approaches across three representative datasets that contain movement data captured with wearable sensors. We describe how to train recurrent approaches in this setting, introduce a novel regularisation approach, and illustrate how they outperform the state-of-the-art on a large benchmark dataset. Across thousands of recognition experiments with randomly sampled model configurations we investigate the suitability of each model for different tasks in HAR, explore the impact of hyperparameters using the fANOVA framework, and provide guidelines for the practitioner who wants to apply deep learning in their problem setting.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1604.08880

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Previous unsupervised learning approaches involving Restricted Boltzmann Machines and convolutional autoencoders were trained using signal reconstruction.

    “We note that previous unsupervised learning approaches involving Restricted Boltzmann Machines[63] and convolutional autoencoders [31] were trained using signal reconstruction.”

    From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [31]

    The citation [31] is attached to the claim about convolutional autoencoders. In §3.2 (p. 3), this paper describes convolutional networks with a final softmax layer trained to minimise negative log likelihood, not autoencoders trained to reconstruct signals. The Results (§5, p. 6) also state that the authors relied solely on supervised training. (LLM, conf=0.88)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

  • Most recent unsupervised pre-training approaches do not specifically target temporality, a characteristic inherent to body-worn sensor data.

    “While they result in effective representations, most of these approaches do not specifically target a characteristic inherent to body-worn sensor data - temporality.”

    From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [31]

    Section 2 (pp. 1–2) describes body-worn sensor data as time series and says movement-data frames are usually treated as statistically independent. It also discusses pre-trained networks, but does not establish that most unsupervised pre-training approaches fail to target temporality; its account of their results is mixed rather than uniformly effective. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

  • Unlabeled data can be utilized to learn useful representations for wide ranging tasks.

    “Previous works such as [31, 63, 69] have demonstrated how unlabeled data can be utilized to learn useful representations for wide ranging tasks, including identifying kitchen activities [11], activity tracking in car manufacturing [71], classifying every day activities such as walking or running [4, 10, 51, 66], and medical scenarios involving identifying freeze of gait in patients suffering from”

    From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [31]

    Section 2 (p. 2) describes earlier work using generatively trained auto-encoders in activity recognition and pre-trained networks in several applications, which supports the general idea of learning representations from data. But it reports mixed results for the auto-encoders and does not show that this paper itself demonstrated useful representations learned from unlabeled data across the wide range of tasks claimed. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

  • There is not yet a consensus on the gold standard feature representation for HAR using wearables.

    “There is not yet a consensus on the gold standard feature representation for HAR using wearables [31].”

    From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [31]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 17

  1. [Alsheikh et al. , 2015] Mohammad Abu Alsheikh, Ahmed Selim, Dusit Niyato, Linda Doyle, Shaowei Lin, and Hwee-Pink Tan. Deep activity recognition models with triaxial accelerometers. arXiv:1511.04664 , 2015. · arXiv
  2. [Bulling et al. , 2014] Andreas Bulling, Ulf Blanke, and Bernt Schiele. A tutorial on human activity recognition using body-worn inertial sensors. ACM Computing Surveys (CSUR) , 46(3):33, 2014.
  3. [Chavarriaga et al. , 2013] Ricardo Chavarriaga, Hesam Sagha, Alberto Calatroni, Sundara Tejaswi Digumarti, Gerhard Tr¨ oster, Jos´ e del R Mill´ an, and Daniel Roggen. The opportunity challenge: A benchmark database for on-body sensor-based activity recognition. Pattern Recognition Letters , 2013.
  4. [Collobert et al. , 2011] Ronan Collobert, Koray Kavukcuoglu, and Cl´ ement Farabet. Torch7: A matlablike environment for machine learning. In BigLearn, NIPS Workshop , 2011.
  5. [Duchi et al. , 2011] John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. The Journal of Machine Learning Research , 12:2121-2159, 2011.
  6. [Gregor et al. , 2015] Karol Gregor, Ivo Danihelka, Alex Graves, and Daan Wierstra. Draw: A recurrent neural network for image generation. arXiv:1502.04623 , 2015. · arXiv
  7. [Hutter et al. , 2014] Frank Hutter, Holger Hoos, and Kevin Leyton-Brown. An efficient approach for assessing hyperparameter importance. In ICML , pages 754-762, 2014.
  8. [Lane et al. , 2015] Nicholas D Lane, Petko Georgiev, and Lorena Qendro. Deepear: robust smartphone audio sensing in unconstrained acoustic environments using deep learning. In Ubicomp , pages 283-294. ACM, 2015.
  9. [Neverova et al. , 2015] Natalia Neverova, Christian Wolf, Griffin Lacey, Lex Fridman, Deepak Chandra, Brandon Barbello, and Graham Taylor. Learning human identity from motion patterns. arXiv:1511.03908 , 2015. · arXiv
  10. [Pl¨ otz et al. , 2011] Thomas Pl¨ otz, Nils Y Hammerla, and Patrick Olivier. Feature learning for activity recognition in ubiquitous computing. In IJCAI , 2011.
  11. [Rad et al. , 2015] Nastaran Mohammadian Rad, Andrea Bizzego, Seyed Mostafa Kia, Giuseppe Jurman, Paola Venuti, and Cesare Furlanello. Convolutional neural network for stereotypical motor movement detection in autism. arXiv:1511.01865 , 2015. · arXiv
  12. [Ronao and Cho, 2015] Charissa Ann Ronao and Sung-Bae Cho. Deep convolutional neural networks for human activity recognition with smartphone sensors. In Neural Information Processing , pages 46-53. Springer, 2015.
  13. [Ronaoo and Cho, 2015] Charissa Ann Ronaoo and SungBae Cho. Evaluation of deep convolutional neural network architectures for human activity recognition with smartphone sensors. In Proc. of the KIISE Korea Computer Congress , pages 858-860, 2015.
  14. [Srivastava et al. , 2014] Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. JMLR , 2014.
  15. [Yang et al. , 2015] Jian Bo Yang, Minh Nhut Nguyen, Phyo Phyo San, Xiao Li Li, and Shonali Krishnaswamy. Deep convolutional neural networks on multichannel time series for human activity recognition. In IJCAI , 2015.
  16. [Zeng et al. , 2014] Ming Zeng, Le T Nguyen, Bo Yu, Ole J Mengshoel, Jiang Zhu, Pang Wu, and Juyong Zhang. Convolutional neural networks for human activity recognition using mobile sensors. In MobiCASE , pages 197-205. IEEE, 2014.
  17. [Zhang et al. , 2015] Licheng Zhang, Xihong Wu, and Dingsheng Luo. Human activity recognition with hmm-dnn model. In ICCI , pages 192-197. IEEE, 2015.

Cited by

Sorted by citations

Authors
Hammerla, N. Y., Halloran, S., & Ploetz, T.
Affiliations
  • Babylon Health (GB)
  • Newcastle University (GB)
ORCID
Halloran, Shane
Venue
arXiv
Publisher
arXiv
Published
2016
Pages
1533-1540
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1604.08880
arXiv
1604.08880
OpenAlex
W2344284192
Cited by
606
References
6
Citations by year
2025: 26 · 2024: 39 · 2023: 51 · 2022: 71 · 2021: 111 · 2020: 111 · 2019: 92 · 2018: 71 · 2017: 27 · 2016: 6 · 2015: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
Keywords
human activity recognition, wearable sensors, convolutional neural networks, recurrent neural networks, deep learning, regularization, hyperparameter sensitivity, movement data, gesture recognition

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review