The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Towards a Dynamic Inter-Sensor Correlations Learning Framework for Multi-Sensor-Based Wearable Human Activity Recognition
Abstract
Multi-sensor-based wearable human activity recognition (WHAR) is a research hotspot in the field of ubiquitous computing. Extracting effective features from multi-sensor data is essential to improve the performance of activity recognition. Despite the excellent achievements of previous works, the challenge remains for modelling the dynamic correlations between sensors. In this paper, we propose a lightweight yet efficient GCN-based dynamic inter-sensor correlations learning framework called DynamicWHAR for automatically learning the dynamic correlations between sensors. DynamicWHAR is mainly composed of two modules: Initial Feature Extraction and Dynamic Information Interaction. Firstly, Initial Feature Extraction module performs data-to-feature transformation to extract the initial features of each sensor. Subsequently, Dynamic Information Interaction module explicitly models the specific interaction intensity between any two sensors, and performs dynamic information aggregation between sensors by the learned interaction intensity. Extensive experiments on four diverse WHAR datasets and two different resource-constrained devices validate that DynamicWHAR outperforms the SOTA models in both recognition performance and computational complexity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539 · cited 1×
“In skeleton-based HAR, the time series of 3D coordinates of multiple skeleton joints are estimated either from 2D images by pose estimation algorithms [6] or directly collected by depth cameras ( e.g., Kinetics) [58].”
MethodSpatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410 · cited 2×
“In recent years, skeleton-based HAR models have been developed from CNN-RNN-based models [24, 25, 56] to GCN-based models [8, 29, 41, 42, 51, 55, 57].”
MethodNTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Shahroudy, A., Liu, J., Ng, T.-T., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.115 · Cited by 3,148
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 15×
“To further investigate the efficiency of the proposed framework, we implement DynamicWHAR and the SOTA models on two embedded devices, i.e. , Raspberry Pi 4 Model B and OnePlus 8.”
BackgroundMethodInfluentialProceedings of the International Joint Conference on Artificial Intelligence 2007
Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761
Microsoft Kinect Sensor and Its Effect
Zhang, Z. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.24 · Cited by 2,487
Two-Stream Adaptive Graph Convolutional Networks for Skeleton-Based Action Recognition
Shi, L., Zhang, Y., Cheng, J., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01230 · Cited by 2,071
NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
Liu, J., Shahroudy, A., Perez, M., Wang, G., Duan, L.-Y., & Kot, A. C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2916873 · Cited by 1,818
Wang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., & Campbell, A. T. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2632054 · Cited by 1,116
Research works printed but not linked: 9
- Will Kay Joao Carreira Karen Simonyan Brian Zhang Chloe Hillier Sudheendra Vijayanarasimhan Fabio Viola Tim Green Trevor Back Paul Natsev et al. 2017. The kinetics human action video dataset. arXiv preprint arXiv:1705.06950 (2017). · arXiv
- Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations. 1--15.
- Song-Mi Lee, Sang Min Yoon, and Heeryon Cho. 2017. Human activity recognition from accelerometer data using convolutional neural network. In Proceedings of the IEEE International Conference on Dig Data and Smart Computing. 131--134.
- Chenglin Li, Carrie Lu Tong, Di Niu, Bei Jiang, Xiao Zuo, Lei Cheng, Jian Xiong, and Jianming Yang. 2021. Similarity embedding networks for robust human activity recognition. ACM Transactions on Knowledge Discovery from Data 15, 6 (2021), 1--17.
- Chao Li, Qiaoyong Zhong, Di Xie, and Shiliang Pu. 2017. Skeleton-based action recognition with convolutional neural networks. In Proceedings of the IEEE International Conference on Multimedia & Expo Workshops. 597--600.
- Chao Li, Qiaoyong Zhong, Di Xie, and Shiliang Pu. 2018. Co-occurrence feature learning from skeleton data for action recognition and detection with hierarchical aggregation. arXiv preprint arXiv:1804.06055 (2018). · arXiv
- 10.1145/3432208 · DOI · Paper page
- Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. PyTorch: An imperative style, high-performance deep learning library. In Proceedings of the Advances in Neural Information Processing Systems. 8026--8037.
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems. 5998--6008.
Cited by
Suh, S., Rey, V. F., & Lukowicz, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110143 · Cited by 107
Yin, Y., Xie, L., Jiang, Z., Xiao, F., Cao, J., & Lu, S. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3357591 · Cited by 108
“…especially for fine-grained activity and multi-level activity recognition, e.g., in-air hand gesture recognition [119], finger touch identification [79], tongue-jaw movement recognition [61], personal cough detection [89], sleep apnea detection [93], and daily activity recognition [97], [98], [103].”
Context-aware mutual learning for semi-supervised human activity recognition using wearable sensors
Qu, Y., Tang, Y., Yang, X., Wen, Y., & Zhang, W. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119679 · Cited by 34
Chen, W., Cheng, J., Wang, L., Zhao, W., & Matusik, W. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699747 · Cited by 48
Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition
Miao, S., Chen, L., & Hu, R. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3631415 · Cited by 23
Self-citationChen, L., Hu, R., Wu, M., & Zhou, X. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610909 · Cited by 36
Self-citationLi, J., Chen, G., & Antwi‐Afari, M. F. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105554 · Cited by 25
Zhu, Y., Luo, H., Chen, R., & Zhao, F. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3285547 · Cited by 25
GOAT: A Generalized Cross-Dataset Activity Recognition Framework with Natural Language Supervision
Miao, S., & Chen, L. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699736 · Cited by 27
Self-citationTemporal Action Localization for Inertial-based Human Activity Recognition
Bock, M., Moeller, M., & Laerhoven, K. V. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699770 · Cited by 29
Zou, H., Chen, Z., Zhang, C., Yuan, A., Wang, B., Wang, L., Li, J., & Pan, Y. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3373444 · Cited by 15
Uhlenberg, L., Haeusler, L. O., & Amft, O. (2024) · IEEE Access · doi:10.1109/access.2024.3513477 · Cited by 16
“The dataset has been widely used in the literatures [13], [14], [29], and [58] and includes recordings outside the laboratory.”
InfluentialAccurate and Efficient Human Activity Recognition Through Semi-Supervised Deep Learning
Long, X., Wang, P., Gu, F., Chen, C., & Guo, S. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3561418 · Cited by 11
Zhang, Y., Hu, Z., Berger, U., & Pan, S. (2023) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/3583120.3586960 · Cited by 11
Ahmad, N., & Leung, H.-F. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3643511 · Cited by 13
A Lightweight Deep Human Activity Recognition Algorithm Using Multiknowledge Distillation
Chen, R., Luo, H., Zhao, F., Meng, X., Xie, Z., & Zhu, Y. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3443308 · Cited by 15
“With the progression of deep learning, mechanisms, such as attention [10], [11], [12] and graph neural networks (GNNs) [13], [14], [15], now facilitate information fusion among different sensors and wearable positions, offering a more integrated approach to understanding activity patterns.”
BackgroundMethodA Novel Framework for Future Human Activity Prediction Using Sensor-Based Data
(2023) · International journal of intelligent engineering and systems · doi:10.22266/ijies2023.1231.81 · Cited by 8
Wei, Q., Huang, J., Gao, Y. C., & Dong, W. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749509 · Cited by 21
Deep convolutional state space model as human activity recognizer
Wang, L., Bu, C., Yao, M., Xiong, D., Wang, S., Cheng, D., Zhang, L., Wu, H., & Song, A. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103982 · Cited by 8
Eff-WHAR: A Lightweight Design for Efficient Wearable Sensor-Based Human Activity Recognition
Chen, Z., Zou, H., Wang, L., Wang, B., Zhang, F., Ma, S., Pan, Y., & Li, J. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3509961 · Cited by 8
Wonderwall: A Virtual-to-Real Foundation Model for IMU-based HAR
Miao, S., & Chen, L. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3789688 · Cited by 9
Self-citationAhmad, N., Leung, H.-F., & Farnia, F. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3555799 · Cited by 4
“Later, alongside temporal feature extraction (TFE), HAR models based on learning correlations among sensing devices emerge [14], [15].”
InfluentialA Conditional KAN Diffusion Network for Human Activity Recognition with Missing Sensor Signal Series
Xiong, H., Gong, J., Luo, H., Zhao, F., Gao, Y., Chen, R., & Xiao, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890337 · Cited by 2
“We used weighted F1 and accuracy as the primary metrics to compare CKAD with several state-of-the-art models including DynamicWHAR [32] , GlobalFusion [33] , HELP [34] , HYU-CSE [35] , ConvNext [36] .”
Feature selection based L1alm-DT and MHT-LSTM for human activity recogition via sensor
Ram, R. S., Boobalan, S., Prakash, S. A., & Sekhar, V. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02598-w · Cited by 1
Dong, L., Xu, X., He, G., Xu, Y., Rasol, J., Tao, C., & Zhang, Z. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2025.04.019 · Cited by 1
Certified Robustness against Sensor Heterogeneity in Acoustic Sensing
Nguyen, D. P., Dai, Y., Li, X., & Tan, R. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749481 · Cited by 1
Kao, Y., & Wei, C. (2026) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.70430 · Cited by 2
Toward Wearable Sensor-Based Human Activity Recognition: A Survey
Zou, H., Chen, Z., Pan, Y., & Li, J. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3702134 · Cited by 3
“Miao et al. [153] propose a dynamic HAR that employs a framework for learning the dynamic sensor correlation.”
GAN-Enhanced Vertical Federated Learning System for WHAR with non-IID Data
Lee, C., Cho, S., Park, H., Park, J., & Lee, S. (2024) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms59830.2024.10575811 · Cited by 1
“However, considering heterogeneous IoT devices in WHAR exacerbates this issue, as it introduces imbalances not only in label distribution but also between different modalities [4], [5].”
BackgroundXiong, H., Luo, H., Gong, J., Zhao, F., Wang, J., & Ma, X. (2024) · IEEE Smart World Congress (SWC) · doi:10.1109/swc62898.2024.00169
“[47]: An efficient GCN-based framework for automatically learning dynamic sensor correlations in activity recognition.”
Dridi, J., Amayri, M., & Bouguila, N. (2025) · Sustainable Cities and Society Advances · doi:10.1016/j.scsadv.2025.100005
Li, Z., Tao, J., & Shou, D. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3652182
DMS: Throughput-Aware Distributed Multimodal Model Surgery on Embedded Devices
Cai, Q., Li, K., Zhang, K., Xie, X. N., Tong, X., & Li, K. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3682748
“The typical applications of distributed multimodal applications include action recognition with multiple sensors [13], [14], target tracking using multiple drones [27], and motion tracking utilizing multiple inertial measurement units [28], among others [29], [30], [31].”
Xiong, H., Luo, D., Zhao, F., Gao, Y., Yue, X., Gong, J., & Luo, H. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461250
Open-ended Human Activity Understanding via LLM-assisted Motion Decomposition and Semantic Fusion
Wei, Q., Hu, K., Huang, J., Guo, C. C., Gao, Y. N., & Dong, W. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831643 · Cited by 2
Lee, Y.-R., & Tseng, V. S. M. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728704
“Conversely, graph-based methods like DynamicWHAR [7] excel at modeling spatiotemporal correlations but require static sensor topologies , making them inapplicable to the dynamic configurations in Hybrid DA.”
Metadata
- Authors
- Miao, S., Chen, L., Hu, R., & Luo, Y.
- Affiliations
- Zhejiang University (CN)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2022-09-06
- Volume
- 6
- Issue
- 3
- Pages
- 1-25
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4294898655
- Cited by
- 36
- References
- 53
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 12 · 2023: 6 · 2022: 1
- FWCI
- 2.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Engineering › Biomedical Engineering › Advanced Sensor and Energy Harvesting Materials
- Keywords
- multi-sensor data, graph convolutional networks, feature extraction, resource-constrained devices, lightweight models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.