Cross-Dataset Activity Recognition via Adaptive Spatial-Temporal Transfer Learning
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Human activity recognition (HAR) aims at recognizing activities by training models on the large quantity of sensor data. Since it is time-consuming and expensive to acquire abundant labeled data, transfer learning becomes necessary for HAR by transferring knowledge from existing domains. However, there are two challenges existing in cross-dataset activity recognition. The first challenge is source domain selection. Given a target task and several available source domains, it is difficult to determine how to select the most similar source domain to the target domain such that negative transfer can be avoided. The second one is accurately activity transfer. After source domain selection, how to achieve accurate knowledge transfer between the selected source and the target domain remains another challenge. In this paper, we propose an Adaptive Spatial-Temporal Transfer Learning (ASTTL) approach to tackle both of the above two challenges in cross-dataset HAR. ASTTL learns the spatial features in transfer learning by adaptively evaluating the relative importance between the marginal and conditional probability distributions. Besides, it captures the temporal features via incremental manifold learning. Therefore, ASTTL can learn the adaptive spatial-temporal features for cross-dataset HAR and can be used for both source domain selection and accurate activity transfer. We evaluate the performance of ASTTL through extensive experiments on 4 public HAR datasets, which demonstrates its effectiveness. Furthermore, based on ASTTL, we design and implement an adaptive cross-dataset HAR system called Client-Cloud Collaborative Adaptive Activity Recognition System (3C2ARS) to perform HAR in the real environment. By collecting activities in the smartphone and transferring knowledge in the cloud server, ASTTL can significantly improve the performance of source domain selection and accurate activity transfer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757 · cited 2×
“…existing work either proposes to perform distribution adaptation, which can explicitly reduce the distribution divergence [34, 51, 52, 61], or proposes to learn transferable features in the manifold space in which manifold distance can be adopted to minimize the distribution distance [18, 19, 48].”
BackgroundMethod(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“ASTTL is a generic transfer learning method which allows it to be easily extended to deep model by using the deep features extracted by deep neural networks such as CNNs [59] and LSTM [36].”
BackgroundMatrix multiplication via arithmetic progressions
Coppersmith, D., & Winograd, S. (1990) · Journal of Symbolic Computation · doi:10.1016/s0747-7171(08)80013-2 · Cited by 2,248
A Kernel Method for the Two-Sample-Problem
Gretton, A., Borgwardt, K. M., Rasch, M., Schölkopf, B., & Smola, A. J. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0069 · Cited by 2,167
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
Self-citationAnalysis of Representations for Domain Adaptation
Ben-David, S., Blitzer, J., Crammer, K., & Pereira, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0022 · Cited by 2,019 · cited 1×
“In previous work [56], the adaptive factor µ is calculate by the proxy A -distance [5].”
MethodDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
Self-citationReturn of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004 · cited 5×
“Due to the differences in calculation methods, the results obtained by different methods may vary greatly, so we normalized the results of CORAL to 0-1.”
BackgroundMethodInfluentialDomain adaptation with structural correspondence learning
Blitzer, J., McDonald, R., & Pereira, F. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610094 · Cited by 1,543
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 1×
“This dataset also recorded four external factors of gender, age, height and weight of subjects ) [41] is made up of 9 subjects performing 18 activities with 3 inertial measurement sensor units on 3 body parts, and a heart rate monitor, collecting data in continuous time.”
MethodFedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
Chen, Y., Qin, X., Wang, J., Yu, C., & Gao, W. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988604 · Cited by 1,005 · cited 1×
“For instance, the activities of the elderly are extremely important to help analyze and detect several cognitive diseases such as Parkinson’s disease [9, 10].”
BackgroundSelf-citationUSC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511 · cited 1×
“Some existing methods achieve HAR by exploiting the deep understanding of signal data [61], or focusing on machine learning methods such as traditional methods of active learning [25], similarity graph [43] and deep learning methods [14, 22, 24, 31, 53].”
MethodA-Wristocracy: Deep learning on wrist-worn sensing for recognition of user complex activities
Vepakomma, P., De, D., Das, S. K., & Bhansali, S. (2015) · 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2015.7299406 · Cited by 136 · cited 1×
“HAR has been widely applied in various fields to optimize the interaction between human and computer such as gesture recognition [40], fatigue detection [30] and smart home sensing [50].”
MethodCross Validation Framework to Choose amongst Models and Datasets for Transfer Learning
Zhong, E., Fan, W., Yang, Q., Verscheure, O., & Ren, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15939-8_35 · Cited by 132 · cited 1×
“The parameters are tuned according to transfer cross-validation [63].”
MethodActive learning enabled activity recognition
Hossain, H. M. S., Khan, M. A. A. H., & Roy, N. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.08.017 · Cited by 92
Research works printed but not linked: 51
- 10.1016/j.patcog.2017.07.019 · DOI · Paper page
- 10.1007/978-3-642-35395-6_30 · DOI · Paper page
- 10.1109/CVPR.2014.318 · DOI
- 10.1093/comjnl/bxt075 · DOI · Paper page
- 10.1145/3128572.3140444 · DOI · Paper page
- Qingchao Chen Yang Liu etal 2018. Re-weighted adversarial adaptation network for unsupervised domain adaptation. In CVPR. 7976--7985. Qingchao Chen Yang Liu et al. 2018. Re-weighted adversarial adaptation network for unsupervised domain adaptation. In CVPR. 7976--7985. · DOI · Paper page
- Chen Yiqiang, 2019, Cross-position activity recognition with stratified transfer learning. Pervasive and Mobile Computing
- 10.1007/s00500-012-0822-8 · DOI
- 10.1109/CVPR.2018.00432 · DOI · Paper page
- 10.1145/3161190 · DOI
- 10.3390/s19010057 · DOI · Paper page
- Fawcett Tom, 2006, An introduction to ROC analysis. Pattern recognition letters 27, 8
- Foster George, Discriminative instance weighting for domain adaptation in statistical machine translation
- 10.5555/2354409.2355024 · doi:10.5555/2354409.2355024
- 10.1109/ICCV.2011.6126344 · DOI · Paper page
- Gretton Arthur, 2012, Journal of Machine Learning Research
- Gretton Arthur, Conference on Advances in Neural Information Processing Systems.
- 10.1145/1390156.1390204 · DOI · Paper page
- 10.1145/3214269 · DOI · Paper page
- 10.1016/j.pmcj.2010.11.005 · DOI
- 10.1145/1409635.1409638 · DOI · Paper page
- John G Kemeny and J Laurie Snell. 1976. Markov Chains. Springer-Verlag New York. John G Kemeny and J Laurie Snell. 1976. Markov Chains. Springer-Verlag New York.
- Al Hafiz Khan Md Abdullah, PerCom
- Lei Jianmei, 2018, Study on Driving Fatigue Evaluation System Based on Short Time Period ECG Signal. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC). IEEE, 2466--2470
- 10.1145/3314404 · DOI
- 10.1016/j.patrec.2013.04.012 · DOI
- 10.1109/18.61115 · DOI · Paper page
- 10.1109/TKDE.2014.2373376 · DOI · Paper page
- Pan Sinno Jialin, 2008, Transfer Learning via Dimensionality Reduction, AAAI, 8, 677
- 10.1109/TNN.2010.2091281 · DOI · Paper page
- 10.1109/TKDE.2009.191 · DOI · Paper page
- 10.1016/j.artint.2018.11.005 · DOI
- 10.1109/ICDMW.2012.46 · DOI
- 10.1145/3130959 · DOI
- 10.1109/TMC.2018.2789890 · DOI · Paper page
- Schultz Lex Razoux, 2018, Distance Based Source Domain Selection for Sentiment Classification. arXiv preprint arXiv:1808.09271 · arXiv
- 10.1007/978-3-540-75225-7_5 · DOI · Paper page
- 10.5555/3016100.3016186 · doi:10.5555/3016100.3016186
- Tan Ben, 2017, Sinno Jialin Pan, and Qiang Yang
- Wang Jindong, 2019, Transfer Learning with Dynamic Distribution Adaptation. arXiv preprint arXiv:1909.08531 · arXiv
- 10.1109/ICDM.2017.150 · DOI · Paper page
- 10.1109/PERCOM.2018.8444572 · DOI · Paper page
- Wang Jindong, 2019, Easy Transfer Learning By Exploiting Intra-domain Structures. arXiv preprint arXiv:1904.01376 · arXiv
- Wang Jindong, 2018, Visual Domain Adaptation with Manifold Embedded Distribution Alignment. In ACM Multimedia Conference. ACM, 402--410
- Jindong Wang Vincent W Zheng Yiqiang Chen and Meiyu Huang. 2018. Deep transfer learning for cross-domain activity recognition. In ICCSE. ACM 16. Jindong Wang Vincent W Zheng Yiqiang Chen and Meiyu Huang. 2018. Deep transfer learning for cross-domain activity recognition. In ICCSE. ACM 16. · DOI · Paper page
- 10.1109/MIS.2018.012001555 · DOI
- Yang Jianbo, 2015, Twenty-Fourth International Joint Conference on Artificial Intelligence.
- Yu Chaohui, 2019, Transfer Learning with Dynamic Adversarial Adaptation Network. arXiv preprint arXiv:1909.08184 · arXiv
- 10.1145/3314420 · DOI
- Zhuang Fuzhen, 2015, Sinno Jialin Pan, and Qing He
- Zhuo Hankz Hankui, 2014, Action-model acquisition for planning via transfer learning. Artificial intelligence 212
Cited by
FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
Chen, Y., Qin, X., Wang, J., Yu, C., & Gao, W. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988604 · Cited by 1,005
“To this end, there are mainly two kinds of approaches: instance reweighting(11) and feature matching.(12) Recently, deep transfer learning methods have made considerable success in many application fields.”
BackgroundSelf-citationHong, Z., Li, Z., Zhong, S., Lyu, W., Wang, H., Ding, Y., He, T., & Zhang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659597 · Cited by 67
“Due to the heterogeneity of sensor readings, models trained on one domain might not achieve comparable performance on other domains [49, 51, 83].”
BackgroundMethodResultInfluentialPractically Adopting Human Activity Recognition
Xu, H., Zhou, P., Tan, R., & Li, M. (2023) · Proceedings of the 29th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3570361.3613299 · Cited by 55
Domain Generalization for Activity Recognition via Adaptive Feature Fusion
Qin, X., Wang, J., Chen, Y., Lu, W., & Jiang, X. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3552434 · Cited by 55
Self-citationSanabria, A. R., Zambonelli, F., Dobson, S., & Ye, J. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101477 · Cited by 43
“Adaptive Spatial-Temporal Transfer Learning (ASTTL) [32] transfers activity knowledge and selects an appropriate source domain for cross-dataset HAR problems.”
BackgroundMethodInfluential
Metadata
- Authors
- Qin, X., Chen, Y., Wang, J., & Yu, C.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2019-12-11
- Volume
- 3
- Issue
- 4
- Pages
- 1-25
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3003860764
- Cited by
- 87
- References
- 17
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.