IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition
Open accessThe DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
One of the primary challenges in the field of human activity recognition (HAR) is the lack of large labeled datasets. This hinders the development of robust and generalizable models. Recently, cross modality transfer approaches have been explored that can alleviate the problem of data scarcity. These approaches convert existing datasets from a source modality, such as video, to a target modality, such as inertial measurement units (IMUs). With the emergence of generative AI models such as large language models (LLMs) and text-driven motion synthesis models, language has become a promising source data modality as well - as shown in proof of concepts such as IMUGPT. In this work, we conduct a large-scale evaluation of language-based cross modality transfer to determine their effectiveness for HAR. Based on this study, we introduce two new extensions for IMUGPT that enhance its use for practical HAR application scenarios: a motion filter capable of filtering out irrelevant motion sequences to ensure the relevance of the generated virtual IMU data, and a set of metrics that measure the diversity of the generated data facilitating the determination of when to stop generating virtual IMU data for both effective and efficient processing. We demonstrate that our diversity metrics can reduce the effort needed for the generation of virtual IMU data by at least 50%, which opens up IMUGPT for practical use cases beyond a mere proof of concept.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“IMUGPT2.0 [116] introduces a motion filter (to eliminate irrelevant generated sequences) and metrics to evaluate the diversity of generated data, resulting in a 50% effort reduction for generating virtual IMU data.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [116]
In the citing paper
“Leng et al. [116,117] demonstrate how foundational models can be used to generate realistic and useful IMU data.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [116]
Citations
Cites
1 retracted
Research on Data Security and Privacy Protection of Wearable Equipment in Healthcare
Jiang, D., & Shi, G. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/6656204 · Cited by 48 · cited 1×
“However, one of the biggest challenges that the HAR community faces is the lack of large-scale labeled datasets due to the expensive annotation process, the need for domain experts, and potential issues with invasion of privacy [16, 18, 31, 35, 61].”
RetractedAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · cited 1×
“Preliminary experiments demonstrated the promising potential of the approach, showing that the extracted virtual IMU data can lead to significant improvements in the downstream HAR performance.”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 1×
“Further details about how the comparative diversity is utilized to halt the generation process is highlighted in the subsequent sections.”
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602 · cited 2×
“The problem is framed as a binary classification task where the input is a textual description 𝑚 , the motion caption of a human motion sequence, along with a specific activity of interest 𝑎 .”
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734 · cited 1×
“Approaches for generating virtual data through cross modality transfer from different data sources have been explored across various domains (Table 1). cross modality transfer has been actively investigated for the generation of virtual IMU data for HAR from various sources.”
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
Kudo, T., & Richardson, J. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/d18-2012 · Cited by 2,869 · cited 1×
“Further details about how the comparative diversity is utilized to halt the generation process is highlighted in the subsequent sections.”
Large Language Models are Zero-Shot Reasoners
Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · arXiv · doi:10.48550/arxiv.2205.11916 · Cited by 2,013 · cited 1×
“Further details about how the comparative diversity is utilized to halt the generation process is highlighted in the subsequent sections.”
Openface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
Research works printed but not linked: 14
- Lei Bai, Lina Yao, Xianzhi Wang, Salil S. Kanhere, and Yang Xiao. 2020. Prototype Similarity Learning for Activity Recognition. In Advances in Knowledge Discovery and Data Mining, Hady W. Lauw, Raymond Chi-Wing Wong, Alexandros Ntoulas, Ee-Peng Lim, See-Kiong Ng, and Sinno Jialin Pan (Eds.). Springer International Publishing, Cham, 649--661.
- Richard O. Duda, Peter E. Hart, and David G. Stork. 2000. Pattern Classification (2nd Edition) (2 ed.). Wiley-Interscience.
- Biao Jiang, Xin Chen, Wen Liu, Jingyi Yu, Gang Yu, and Tao Chen. 2023. MotionGPT: Human Motion as a Foreign Language. arXiv preprint arXiv:2306.14795 (2023). · arXiv
- Jing Lin, Ailing Zeng, Shunlin Lu, Yuanhao Cai, Ruimao Zhang, Haoqian Wang, and Lei Zhang. 2023. Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset. Advances in Neural Information Processing Systems (2023).
- MinYen Lu, ChenHao Chen, Shigemi Ishida, Yugo Nakamura, and Yutaka Arakawa. 2022. A study on estimating the accurate head IMU motion from Video. Proceedings of the Symposium on Multimedia, Distributed, Cooperative, and Mobile (DICOMO) 2022 2022 (07 2022), 918--923. https://cir.nii.ac.jp/crid/1050011771467456512
- OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat Red Avila Igor Babuschkin Suchir Balaji Valerie Balcom et al. 2023. GPT-4 Technical Report. arXiv:2303.08774 [cs.CL] · arXiv
- Francisco Javier Ordóñez and Daniel Roggen. 2016. Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors (2016).
- Gemini Team, Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Slav Petrov, Melvin Johnson, and Ioannis Antonoglou others. 2023. Gemini: A Family of Highly Capable Multimodal Models. arXiv:2307.09288 [cs.CL] · arXiv
- 10.5555/3295222.3295378 · doi:10.5555/3295222.3295378
- Chenhan Xu, Huining Li, Zhengxiong Li, Xingyu Chen, Aditya Singh Rathore, Hanbin Zhang, Kun Wang, and Wenyao Xu. 2022. The Visual Accelerometer: A High-fidelity Optic-to-Inertial Transformation Framework for Wearable Health Computing. In 2022 IEEE 10th International Conference on Healthcare Informatics (ICHI). IEEE, 319--329.
- Hyungjun Yoon, Hyeongheon Cha, Canh Hoang Nguyen, Taesik Gong, and Sung-Ju Lee. 2022. IMG2IMU: Applying Knowledge from Large-Scale Images to IMU Applications via Contrastive Learning. arXiv preprint arXiv:2209.00945 (2022). · arXiv
- Jianrong Zhang, Yangsong Zhang, Xiaodong Cun, Shaoli Huang, Yong Zhang, Hongwei Zhao, Hongtao Lu, and Xi Shen. 2023. T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
- Mingyuan Zhang, Xinying Guo, Liang Pan, Zhongang Cai, Fangzhou Hong, Huirong Li, Lei Yang, and Ziwei Liu. 2023. ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model. arXiv preprint arXiv:2304.01116 (2023). · arXiv
- Mi Zhang and Alexander A. Sawchuk. 2012. USC-HAD: A Daily Activity Dataset for Ubiquitous Activity Recognition Using Wearable Sensors. Association for Computing Machinery.
Cited by
Transfer Learning in Sensor-Based Human Activity Recognition: A Survey
Dhekane, S. G., & Ploetz, T. (2025) · ACM Computing Surveys · doi:10.1145/3717608 · Cited by 42
Self-citationHaresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33
Self-citationLarge Language Models Are Zero-Shot Recognizers for Activities of Daily Living
Civitarese, G., Fiori, M., Choudhary, P., & Bettini, C. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3725856 · Cited by 67
“Another line of research leverages a pre-trained model generating 3D motion sequences from text [51] to generate synthetic labeled data from wearable/mobile devices [34].”
Large Language Models are Zero-Shot Recognizers for Activities of Daily Living
Civitarese, G., Fiori, M., Choudhary, P., & Bettini, C. (2024) · arXiv · doi:10.48550/arxiv.2407.01238 · Cited by 28
“Another line of research leverages a pre-trained model generating 3D motion sequences from text [51] to generate synthetic labeled data from wearable/mobile devices [34].”
LLMs and IoT: A Comprehensive Survey on Large Language Models and the Internet of Things
Sarhaddi, F., Nguyen, N. T., Zuniga, A., Khan, M., Hui, P., Tarkoma, S., Flores, H., & Nurmi, P. (2026) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2026.3680064 · Cited by 33
GOAT: A Generalized Cross-Dataset Activity Recognition Framework with Natural Language Supervision
Miao, S., & Chen, L. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699736 · Cited by 27
Uhlenberg, L., Haeusler, L. O., & Amft, O. (2024) · IEEE Access · doi:10.1109/access.2024.3513477 · Cited by 16
“The selection of DeepConvLSTM as baseline model was due to its extensive application and validation in related work, e.g., [22], [27], and [40].”
InfluentialEnhancing Wearable Fall Detection System via Synthetic Data
Debnath, M., Alamgeer, S., Kabir, M. S., & Ngu, A. H. H. (2025) · Sensors · doi:10.3390/s25154639 · Cited by 13
“In parallel, we intend to explore the cross-modal data generation techniques such as text-to-motion methods IMUGPT [40] and T2M-GPT [41], which generate skeleton data-based motions from given text prompts.”
Zheng, W., & Arakawa, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3598088 · Cited by 13
“Despite the availability of various datasets, selecting suitable data sources for specific tasks is complicated by heterogeneity, sensor noise, limited labels, and device variability [118], [191].”
Fiori, M., Civitarese, G., Choudhary, P., & Bettini, C. (2025) · ACM Transactions on Internet of Things · doi:10.1145/3766900 · Cited by 21
Wang, B., Garcia, L. A., & Srivastava, M. B. (2024) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw63631.2024.00028 · Cited by 10
“Other LLM-based systems have also been created that are capable of operating over sensor data and environmental events [29]–[31].”
UniMTS: Unified Pre-training for Motion Time Series
Zhang, X., Teng, D., Chowdhury, R., Li, S., Hong, D., Gupta, R., & Shang, J. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-3414 · Cited by 8
Emotion Recognition on the Go: Utilizing Wearable IMUs for Personalized Emotion Recognition
Leng, Z., Jung, M., Hwang, S., Oh, S., Zhang, L., Plötz, T., & Kim, K. K. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3678452 · Cited by 10
Self-citationRay, L. S. S., Xia, Q., Rey, V. F., Wu, K., & Lukowicz, P. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1569205 · Cited by 11
Motion2Press: Cross Model Learning from IMU to Plantar Pressure for Gait Analysis
Ren, J., Zheng, R., Zhang, W., She, D., Bai, Y., Jin, Z., & Gao, Y. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749499 · Cited by 9
Wei, Q., Huang, J., Gao, Y. C., & Dong, W. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749509 · Cited by 21
WatchGuardian: Enabling User-Defined Personalized Just-in-Time Intervention on Smartwatch
Lei, Y., Cao, Y., Wang, W. K., Dong, Y., Yin, C., Cao, W., Zhang, P., Yang, J., Yao, B., Peng, Y., et al. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3788689 · Cited by 10
Bian, S., Liu, M., Ray, L. S. S., Zhou, B., Guo, B., Yu, Z., Plötz, T., Lukowicz, P., Yuan, S., & Rey, V. F. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3810230 · Cited by 16
Self-citationSynthesizing mmWave range-doppler data from videos for privacy-preserving human activity recognition
Zhang, X., Wang, S., Cui, Z., Li, B.-R., Zhou, X., Xu, Z.-D., & Li, Z. (2026) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-025-00205-z · Cited by 3
Wonderwall: A Virtual-to-Real Foundation Model for IMU-based HAR
Miao, S., & Chen, L. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3789688 · Cited by 9
Video2mmPoint: Synthesizing mmWave Point Cloud Data From Videos for Gait Recognition
Fan, Y., Wang, Y., Zheng, H., & Shi, Z. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3483835 · Cited by 4
“Significant progress has been made in generating IMU data from various modalities such as video [37], audio [38], and text [39], [40].”
Matching Skeleton-based Activity Representations with Heterogeneous Signals for HAR
Li, S., Zhang, J., Fu, X., Zhang, X., Shang, J., & Gupta, R. K. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722089 · Cited by 5
Ray, L. S. S., Krupp, L., Rey, V. F., Zhou, B., Suh, S., & Lukowicz, P. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3732001 · Cited by 7
From Vision to Motion: Translating Large-Scale Knowledge for Data-Scarce IMU Applications
Yoon, H., Cha, H., Nguyen, H. C., Gong, T., & Lee, S.-J. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3556998 · Cited by 10
“0[41]tackleddatascarcityby generatingvirtualIMUdata,usingvideosandtextualdescrip-tions,respectively.”
SmartGlove: Robust Sign Language Recognition With Cross-Domain Generation
Feng, M., Li, K., Chen, J., Zhang, J., Liu, D., Liu, Y., Chen, S., Tao, X., Tong, X., Xie, X. N., et al. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3623388 · Cited by 5
“…without requiring complex sensor data or feature processing and achieves real-time recognition directly from a single snapshot; 2) compared with [32], [33], [34], our cross-domain feature generation does not rely on modeling complex temporal dependencies across video frames; instead, we…”
InfluentialIMUZero: Zero-Shot Human Activity Recognition by Language-Based Cross Modality Fusion
Su, J., Ge, F., Wen, Z., Li, T., Bai, Y., Zhou, Y., & Zhang, X. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3770669 · Cited by 8
LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Data
Imran, S. A., Khan, M. N. H., Biswas, S., & Islam, B. (2025) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3714394.3756187 · Cited by 67
COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition
Chen, B., Wongso, W., Li, Z., Khaokaew, Y., Xue, H., & Salim, F. D. (2026) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3810218 · Cited by 1
“[25, 26] synthesized IMU signals from video and language models, demonstrating the potential for large-scale HAR by alleviating the need for extensive real-world IMU data collection.”
UniMTS: Unified Pre-training for Motion Time Series
Zhang, X., Teng, D., Chowdhury, R. R., Li, S., Hong, D., Gupta, R. K., & Shang, J. (2024) · arXiv · Cited by 9
“We aim for a more generic yet challenging generalization scenario where pre-training and downstream datasets share different label names.”
Vsens Toolkit: AR-based Open-ended System for Virtual Sensors
Liang, F., Min, T., Xia, C., & Sugiura, Y. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3721177 · Cited by 1
DML-FitAR: A Deep Metric Learning Approach for IMU-Based Fitness Activity Recognition
Li, T., Li, D., Chen, Y., Li, Z., Ma, Y., Liu, D., Feng, X., Wu, J. Y., & Guo, C. (2025) · International Conference on Multimedia Retrieval · doi:10.1145/3731715.3733311 · Cited by 1
W2W: A Simulated Exploration of IMU Placement Across the Human Body for Designing Smarter Wearable
Ray, L. S. S., Zhou, B., & Lukowicz, P. (2025) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3715071.3750417 · Cited by 7
Wolling, F., Kostolani, D., Trollmann, P., & Michahelles, F. (2025) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3715071.3750419 · Cited by 3
CHEF-VL: Detecting Cognitive Sequencing Errors in Cooking with Vision-language Models
Wang, R., Gao, P., Lynch, P., Liu, T., Lee, Y., Baum, C. M., Connor, L. T., & Lu, C. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3770714 · Cited by 3
Vsens: Incorporating XR into the Process of Collecting Virtual IMU Data
Liang, F., Min, T., Xia, C., & Sugiura, Y. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3790110 · Cited by 1
Hwang, S., Leng, Z., Oh, S., Kim, K. K., & Plötz, T. (2024) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3675095.3676617 · Cited by 1
Self-citationTifex-Py: Time-Series Feature Extraction for Python in a Human Activity Recognition Scenario
Ejtehadi, M., Graham, G. E., Ringstrom, C., Du, E., Riener, R., & GRANADOS, D. F. P. (2025) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr66766.2025.11062978 · Cited by 2
“…[21] (ManFE); MotionSense [26] (ManFE); PAMAP2 [8], [32] (AutoFE) and [8], [31] (ManFE); REALDISP [11] (ManFE); RealWorld [35], [38], [39] (AutoFE) and [35] (ManFE); UniMiBSHAR [6], [43] (AutoFE) and [9] (ManFE); USC-HAD [5], [46] (AutoFE) and [35] (ManFE); and WISDM [49] (AutoFE - no CV) and [7]”
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Ploetz, T. (2024) · arXiv · Cited by 31
Self-citationSynthetic Sensory Data Generators: How Much Progress Are We Making?
Sharma, R., Khamis, A., Khalifa, S., Bretherton, D., & Kusý, B. (2025) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops65533.2025.00084 · Cited by 1
“A common paradigm in SSDGs leverages human motion generation to simulate sensor data for tasks such as human activity classification [12], [13].”
Patidar, P., Arakawa, R., Graça, R., Moutinho, R., Soares, A., Vasconcelos, A., Talami, F., da Silva, J. C., Silva, I., Mendes-Santos, C., et al. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3770674 · Cited by 4
Adapting and Evaluating Human Motion Models for Generating Synthetic Gesture Sensor Data
Kalyani, P., Espinoza, A. A., & Longoria, R. G. (2025) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2025.12.214
Uhlenberg, L., Gebelein, M. J., Haeusler, L. O., & Amft, O. (2025) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3714394.3754444
Text2IMU: Advancing Human Activity Recognition by Text-Driven IMU Data Synthesis
Haeusler, L. O., Uhlenberg, L., & Amft, O. (2025) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn66969.2025.11337798 · Cited by 5
“Leng et al. [7], [8] utilised T2M-GPT and proposed the IMUGPT framework to generate synthetic accelerometer data.”
Exploring the Role of Generative AI in Supporting Physical and Mental Health Among Students
Xu, C., & Qiu, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13022-8_29
Li, T., Li, Z., Li, D., Wu, J., Chen, Y., Feng, X. T., Ma, Y., Liu, D., & Guo, C. (2025) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb65343.2025.11410654
“In contrast, IMUGPT [18, 17] employs text-to-motion generative models like T2M-GPT [35] to directly produce required motion sequences, eliminating the need for data collecting and annotations, though its effectiveness may still be limited by the capability of generative models yet.”
PrivCLIP: Dynamic User-Controllable Privacy-Preserving Few-Shot Sensing Framework
Chathoth, A. K., Yu, S., & Lee, S. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402272 · Cited by 1
“Once a suitable gray-listed replacement activity is selected, the corresponding textual description of that replacement activity is sent to IMU-GPT [16], a human motion generation framework, that produces a sanitized version of the sensor data representing the non-sensitive activity.”
ArmPad: Transforming Forearms Into Interaction Interfaces With Smartwatches
Yang, Z., Yang, Q., Liu, Z., Li, Z., Zou, Y., & Wu, K. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3672486
Rob2HanD: LLM-Driven Robotic Arm for IMU Interaction Dataset Generation
Liu, J., Yu, C., Chen, X., Bu, J., & Zeng, L. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791740
Head2Body: Body Pose Generation from Multi-Sensory Head-Mounted Inputs
Tran, M., Mao, H.-D., Chen, Q.-S., & Kim, Y. (2025) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51701.2025.00644 · Cited by 2
Efficient federated self-supervised human activity recognition via delta-loss client clustering
Bukit, T. A., Yahya, B. N., & Lee, S. (2026) · Digital Signal Processing · doi:10.1016/j.dsp.2026.106251
IMU2Video: World Model-Enabled Video Generation from IMU sensors
Li, Q., Wu, R., & Xu, W. (2026) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3812836.3814749
HMotionGPT: Aligning Hand Motions and Natural Language for Activity Understanding with Smart Rings
Gao, Y., She, D., Liang, W., Wang, C., Xiao, Y., Yao, X., Liu, C., Huang, Z., & Jin, Z. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3810222 · Cited by 3
RadSyn: Synthesizing Large-Scale Realistic mmWave Radar Training Data via Video and Text Fusion
Deng, K., Ling, Y., Xing, L., Cao, Z., Wu, H., & Ma, H. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3704562
“Encouragingly, recent works [17], [18], [19], [20] have demonstrated the feasibility of synthesizing perception data–such as radar, WiFi, and IMU signals–through modality conversion from sources like video, motion capture (MoCap), or text.”
Khan, I., Martins, J. A., & Cardoso, P. J. S. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104592
A Quantitative Comparison of Human Body Modeling Methods to Synthesize IMU Data
Uhlenberg, L., Kempfle, J., Haeusler, L. O., & Amft, O. (2026) · IEEE Access · doi:10.1109/access.2026.3726408
“Additionally, current trend models in the field of HAR generate synthetic IMU data from videos [21], [22] and text prompts [23], [24].”
InfluentialContinuous ASL Fingerspelling Recognition from Wearable Accelerometers
Hou, Z., Xie, Y.-C., Li, F., & Wang, H.-G. (2026) · IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1109/chase69719.2026.00096
“Language-to-motion synthesis approaches such as IMUGPT 2.0 [26] generate virtual IMU data by converting textual activity descriptions into motion sequences and then mapping those motions into wearable signals, but the generated motions may not preserve the fine-grained hand articulation needed for…”
InfluentialKostolani, D., Wolling, F., Schlund, S., & Michahelles, F. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2026.1873283
Jin, J. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01904-x
“It is suitable for film and television scenes with frequent lens switching and significant changes in action rhythm [22, 23].”
Zheng, W., & Arakawa, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38407-2_24
Spilz, A., Oppel, H., & Münz, M. (2026) · AI · doi:10.3390/ai7090381
SolarSim: Physics-Based Simulation of Wearable Solar Harvester Signals for Motion Sensing
Ghalwash, Y., Khamis, A., Khalifa, S., Sandhu, M. M., & Jurdak, R. (2026) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3830727.3834813
TSGen: A Framework for Indoor Trajectory-Semantic Data Synthesis
Chu, R., Cai, Q., Yan, Y., Tong, X., Tang, N., Liu, X., Xie, X. N., Gong, Z., & Qu, W. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831992
AutoResearcHAR: A Multi-Agent Framework for Dataset Adaptive IMU Based Human Activity Recognition
Ray, L. S. S., Rey, V. F., Bian, S., Suh, S., Lukowicz, P., & Zhou, B. (2026) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3830727.3834823
Dong, C.-F., Zhang, Q., & Wang, D. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3832005 · Cited by 1
HAR-R1: Hierarchical LLM Reasoning for Cross-Domain Human Activity RecognitionPreprint
Li, S., Ban, L., Zhu, T., Tian, J., Fang, L., Shi, P. J., Šolić, P., & Chen, L. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7649976
Metadata
- Authors
- Leng, Z., Bhattacharjee, A., Rajasekhar, H., Zhang, L., Bruda, E., Kwon, H., & Plötz, T.
- Affiliations
- Georgia Institute of Technology (US)
- Emory University (US)
- ORCID
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2024-08-22
- Volume
- 8
- Issue
- 3
- Pages
- 1-32
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4402350391
- Cited by
- 61
- References
- 58
- Citations by year
- 2026: 26 · 2025: 29 · 2024: 6
- FWCI
- 8.48
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Human Motion and Animation
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- human activity recognition, cross-modality transfer, large language models, inertial measurement unit, data scarcity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.