Cross-dataset deep transfer learning for activity recognition
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Convolution Neural Network (CNN) filters learned on one domain can be used as feature extractors on another similar domain. Transferring filters allow reusing datasets across domains and reducing labelling costs. In this paper, four activity recognition datasets were analyzed to study the effects of transferring filters across the datasets. A spectro-temporal ResNet was implemented as a deep, end-to-end learning architecture. We analyzed the number of transferred CNN residual blocks with respect to the size of the target-adaptation data. The analysis showed that transfer learning using small adaptation subsets is more useful when the target domain contains a small number of different activities. Furthermore, the similarity between the domains, participating in the transfer learning scenario, seems to play a role in its success. The most successful transfer achieved an F1-score of 93%, which is an increase of 9 percentage points compared to a domain-specific baseline model.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Gjoreski et al. [9] demonstrated that successful transfer learning depends on the similarity of the domain between the base and target task.”
From Complex Deep Neural Networks from Large Scale Virtual IMU Data for Effective Human Activity Recognition Using Wearables (2021) · cites this paper as [9]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
(2010) · International Conference on Machine Learning · Cited by 13,995
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456
Gradient Flow in Recurrent Nets: The Difficulty of Learning LongTerm Dependencies
(2009) · A Field Guide to Dynamical Recurrent Networks · doi:10.1109/9780470544037.ch14 · Cited by 1,246
(2015) · Cited by 989
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Transfer learning for activity recognition: a survey
Cook, D., Feuz, K. D., & Krishnan, N. C. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0665-3 · Cited by 447
A deep learning approach to on-node sensor data analytics for mobile or wearable devices
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2633287 · Cited by 439
Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection
Zappi, P., Lombriser, C., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., & Tröster, G. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77690-1_2 · Cited by 329
Gjoreski, H., Ciliberto, M., Wang, L., Ordonez Morales, F. J., Mekki, S., Valentin, S., & Roggen, D. (2018) · IEEE Access · doi:10.1109/access.2018.2858933 · Cited by 276
Self-citationBhattacharya, S., & Lane, N. D. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994564 · Cited by 236
Morales, F. J. O., & Roggen, D. (2016) · Proceedings of the 2016 ACM International Symposium on Wearable Computers · doi:10.1145/2971763.2971764 · Cited by 136
Gjoreski, M., Janko, V., Slapničar, G., Mlakar, M., Reščič, N., Bizjak, J., Drobnič, V., Marinko, M., Mlakar, N., Luštrek, M., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.04.004 · Cited by 96
Self-citationFoundations and Trends in Signal Processing: DEEP LEARNING – Methods and Applications
Deng, L., & Yu, D. (2014) · Cited by 81
An LSTM Based System for Prediction of Human Activities with Durations
Krishna, K., Jain, D., Mehta, S. V., & Choudhary, S. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161201 · Cited by 68
Empirical Study and Improvement on Deep Transfer Learning for Human Activity Recognition
Ding, R., Li, X., Nie, L., Li, J., Si, X., Chu, D., Liu, G., & Zhan, D. (2018) · Sensors · doi:10.3390/s19010057 · Cited by 63
Context-based ensemble method for human energy expenditure estimation
Gjoreski, H., Kaluža, B., Gams, M., Milić, R., & Luštrek, M. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.05.001 · Cited by 62
Self-citationCalatroni, A., Roggen, D., & Tröster, G. (2011) · International Conference on Networked Sensing Systems · Cited by 43
Three-layer Activity Recognition Combining Domain Knowledge and Meta-classification
Kozina, S. (2013) · Journal of Medical and Biological Engineering · doi:10.5405/jmbe.1321 · Cited by 42
Real-Time Transfer and Evaluation of Activity Recognition Capabilities in an Opportunistic System
Kurz, M., Hölzl, G., Ferscha, A., Calatroni, A., Roggen, D., & Tröster, G. (2011) · Cited by 37
A Versatile Annotated Dataset for Multimodal Locomotion Analytics with Mobile Devices
Gjoreski, H., Ciliberto, M., Morales, F. J. O., Roggen, D., Mekki, S., & Valentin, S. (2017) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3131672.3136976 · Cited by 34
Self-citationSupervised and Unsupervised Transfer Learning for Activity Recognition from Simple In-home Sensors
Inoue, S., & Pan, X. (2016) · EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous) · doi:10.1145/2994374.2994400 · Cited by 27
Research works printed but not linked: 3
- H. Gjoreski , J. Bizjak , M. Gjoreski , M. Gams ( 2016 ). Comparing deep and classical machine learning methods for human activity recognition using wrist accelerometer , in: Proceedings of the IJCAI 2016 Workshop on Deep Learning for Artificial Intelligence , New York, NY, USA , Vol. 10 . H. Gjoreski, J. Bizjak, M. Gjoreski, M. Gams (2016). Comparing deep and classical machine learning methods for human activity recognition using wrist accelerometer, in: Proceedings of the IJCAI 2016 Workshop on Deep Learning for Artificial Intelligence, New York, NY, USA, Vol. 10.
- 10.5555/1786014.1786017 · doi:10.5555/1786014.1786017
- 10.5555/3104322.3104425 · doi:10.5555/3104322.3104425
Cited by
Alzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“on is pragmatic since the smart devices can be placed in diverse positions such as in the hand, in a pocket, or on the nose (e.g., goggles), and inappropriate selection may lead to negative transfer. [43] proves that the similarity between domains in transfer learning is determinative. [155] suggests that higher simil…”
BackgroundDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
“on is pragmatic since the smart devices can be placed in diverse positions such as in the hand, in a pocket, or on the nose (e.g., goggles), and inappropriate selection may lead to negative transfer. [43] proves that the similarity between domains in transfer learning is determinative. [155] suggests that higher simil…”
BackgroundTransfer Learning in Sensor-Based Human Activity Recognition: A Survey
Dhekane, S. G., & Ploetz, T. (2025) · ACM Computing Surveys · doi:10.1145/3717608 · Cited by 42
Sense and Learn: Self-supervision for omnipresent sensors
Saeed, A., Ungureanu, V., & Gfeller, B. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100152 · Cited by 34
Metadata
- Authors
- Gjoreski, M., Kalabakov, S., Luštrek, M., Gams, M., & Gjoreski, H.
- Affiliations
- Jožef Stefan International Postgraduate School (SI)
- Ss. Cyril and Methodius University in Skopje (MK)
- Venue
- Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers
- Publisher
- ACM
- Published
- 2019-09-09
- Pages
- 714-718
- OpenAlex
- W2972942909
- Cited by
- 28
- References
- 32
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 2 · 2023: 3 · 2022: 3 · 2021: 7 · 2020: 6
- FWCI
- 1.50
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- cross-dataset transfer learning, activity recognition, convolutional neural networks, residual blocks, domain adaptation, domain similarity, small adaptation data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.