On the role of features in human activity recognition
The DOI matches its Crossref record; 41 of the 43 references it cites were found in a registry or an index.
Abstract
Traditionally, the sliding window based activity recognition chain (ARC) has been dominating practical applications, in which features are carefully optimized towards scenario specifics. Recently, end-to-end, deep learning methods, that do not discriminate between representation learning and classifier optimization, have become very popular also for HAR using wearables, promising "out-of-the-box" modeling with superior recognition capabilities. In this paper, we revisit and analyze specifically the role feature representations play in HAR using wearables. In a systematic exploration we evaluate eight different feature extraction methods, including conventional heuristics and recent representation learning methods, and assess their capabilities for effective activity recognition on five benchmarks. Optimized feature learning integrated into the conventional ARC leads to comparable if not better recognition results as if using end-to-end learning methods, while at the same time offering practitioners more flexibility to optimize their systems towards specifics of wearables and their constraints and limitations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As shown by Haresamudram et al. [76], these features are not computationally intensive and can be computed on the fly on many wearable devices, even those with severe resource limitations.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as Haresamudram et al. [76]
In the citing paper
“In such cases distribution-based features (e.g., ECDF [72]) are a surprisingly strong option and can be computed on-the-fly [76].”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [76]
In the citing paper
“In contrast, previous studies applied self-supervised training and fine-tuning only on the same data sources24,27,40, making it necessary to pre-train on every new dataset in practical applications.”
From Self-supervised learning for human activity recognition using 700,000 person-days of wearable data (2024) · cites this paper as [24]
In the citing paper
“Recent work towards such unsupervised pre-training has gone beyond the early introduction using Restricted Boltzmann Machines (RBMs) [63], involving (variants of) autoencoders [31, 74], and self-supervision [32, 69].”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [31]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“In a recurrent autoencoder, Vanilla RNNs or more powerful variants such as long short-term memory networks (LSTM) [22], or gated recurrent units (GRU) [8] are used for both encoder and decoder [40].”
MethodA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · cited 2×
“While we study the performance of both unsupervised and supervised methods, special emphasis is placed on unsupervised methods, as they have the advantage of automatically deriving generalizable features from unlabelled data [21, 37].”
Background(2016) · Cited by 11,679
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911 · cited 1×
“They have been used, e.g., for generating raw audio [ 42].”
MethodDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 5×
“We also compare overall classification capabilities of the explored feature representations within the ARC paradigm [6] to a state-of-the-art end-to-end HAR system that does not separate representation learning from classifier training (DeepConvLSTM [34]).”
BackgroundMethodInfluentialSelf-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036 · cited 1×
“They are utilized to learn features by predicting geometric transformations, and solving jigsaw puzzles [24].”
MethodA tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 4×
“The standard activity recognition chain (ARC, [6]) defines a series of processing steps, where each step has a clearly defined goal.”
BackgroundMethodInfluentialDeconvolution and Checkerboard Artifacts
Odena, A., Dumoulin, V., & Olah, C. (2016) · Distill · doi:10.23915/distill.00003 · Cited by 1,640 · cited 1×
“The decoder inverts the encoding operations step-by-step including convolution, upsampling and interpolation, reshaping, and padding operations to match the sizes of the corresponding encoder convolution blocks [33].”
MethodExperiencing SAX: A novel symbolic representation of time series
Lin, J., Keogh, E., Wei, L., & Lonardi, S. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-007-0064-z · Cited by 1,618
Research works printed but not linked: 11
- Amiriparian S., Proc. DCASE 2017 Workshop.
- Chung J., Proc. Int. Conf. Machine Learning (ICML).
- Frank J., Proc. AAAI Conf. on Art. Intelligence (AAAI).
- A. Graves and M. Ranzato. 2018. Unsupervised Deep Learning Tutorial - Part 1 NeurIPS 2018. https://ranzato.github.io/publications/tutorial_deep_unsup_learning_part1_NeurIPS2018.pdf A. Graves and M. Ranzato. 2018. Unsupervised Deep Learning Tutorial - Part 1 NeurIPS 2018. https://ranzato.github.io/publications/tutorial_deep_unsup_learning_part1_NeurIPS2018.pdf
- A. Graves and M. Ranzato. 2018. Unsupervised Deep Learning Tutorial - Part 2 NeurIPS 2018. https://ranzato.github.io/publications/tutorial_deep_unsup_learning_part2_NeurIPS2018.pdf A. Graves and M. Ranzato. 2018. Unsupervised Deep Learning Tutorial - Part 2 NeurIPS 2018. https://ranzato.github.io/publications/tutorial_deep_unsup_learning_part2_NeurIPS2018.pdf
- Hammerla N., Proc. AAAI Conf. on Art. Intelligence (AAAI).
- Hammerla N., Proc. Int. Joint Conf. on Art. Intelligence (IJCAI).
- Plötz T., Proc. Int. Joint Conf. on Art. Intelligence (IJCAI).
- Srivastava N., Proc. Int. Conf. Machine Learning (ICML).
- Yang J., Proc. Int. Joint Conf. on Art. Intelligence (IJCAI).
- Zeng M., Proc. Int. Symp. Wearable Computing (ISWC).
Cited by
Self-supervised learning for human activity recognition using 700,000 person-days of wearable data
Yuan, H., Chan, S., Creagh, A. P., Tong, C., Acquah, A., Clifton, D. A., & Doherty, A. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01062-3 · Cited by 166
“Current human activity recognition (HAR) models typically rely on manual feature engineering (Twomey et al., 2018; Haresamudram et al., 2019) partly due to the very limited size of existing labelled datasets.”
Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463506 · Cited by 150
“There is not yet a consensus on the gold standard feature representation for HAR using wearables [31].”
BackgroundMethodInfluentialSelf-citationMasked reconstruction based self-supervision for human activity recognition
Haresamudram, H., Beedu, A., Agrawal, V., Grady, P. L., Essa, I., Hoffman, J., & Plötz, T. (2020) · Proceedings of the 2020 International Symposium on Wearable Computers · doi:10.1145/3410531.3414306 · Cited by 146
“For USC-HAD, we followed the protocol from [12] with data from participants 1 − 10 for training, from participants 11 and 12 for validation, and from participants 13 and 14 for testing.”
BackgroundMethodResultInfluentialSelf-citationAbedin, A., Ehsanpour, M., Shi, Q., Rezatofighi, H., & Ranasinghe, D. C. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448083 · Cited by 107
“bution imbalance for Opportunity and Hospital datasets. 4.2 Unified Evaluation Protocol To ensure a fair comparison, we directly adopt the evaluation protocol and metrics used in the recent literature [13, 37, 15, 47]. Where possible, sensor data are down-sampled to 33 Hz to achieve a consistent temporal resolution wit…”
MethodInfluentialAssessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
“Similar to the original papers, the learning rate for classifiers for CPC, Masked reconstruction, and Autoencoder [25] reduces by a factor of 0.8 every 10 epochs.”
BackgroundMethodResultInfluentialSelf-citation
Metadata
- Authors
- Haresamudram, H., Anderson, D. V., & Plötz, T.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- Proceedings of the 23rd International Symposium on Wearable Computers
- Publisher
- ACM
- Published
- 2019-09-09
- Pages
- 78-88
- OpenAlex
- W2972118594
- Cited by
- 90
- References
- 43
- Citations by year
- 2026: 7 · 2025: 14 · 2024: 19 · 2023: 14 · 2022: 16 · 2021: 12 · 2020: 8
- FWCI
- 2.90
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Symposium on Wearable Computers (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- human activity recognition, wearable sensors, feature extraction, representation learning, end-to-end deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the role of features in human activity recognition. https://app.cochat.ai/papers/10.1145/3341163.3347727
- The paper
- Haresamudram, H., Anderson, D. V., & Plötz, T. (2019). On the role of features in human activity recognition. Proceedings of the 23rd International Symposium on Wearable Computers. https://doi.org/10.1145/3341163.3347727
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.