IMUTube: Automatic Extraction of Virtual on-body Accelerometry from Video for Human Activity Recognition
The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
The lack of large-scale, labeled data sets impedes progress in developing robust and generalized predictive models for on-body sensor-based human activity recognition (HAR). Labeled data in human activity recognition is scarce and hard to come by, as sensor data collection is expensive, and the annotation is time-consuming and error-prone. To address this problem, we introduce IMUTube, an automated processing pipeline that integrates existing computer vision and signal processing techniques to convert videos of human activity into virtual streams of IMU data. These virtual IMU streams represent accelerometry at a wide variety of locations on the human body. We show how the virtually-generated IMU data improves the performance of a variety of models on known HAR datasets. Our initial results are very promising, but the greater promise of this work lies in a collective approach by the computer vision, signal processing, and activity recognition communities to extend this work in ways that we outline. This should lead to on-body, sensor-based HAR becoming yet another success story in large-dataset breakthroughs in recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Due to these factors, publicly available wearable sensor datasets are typically limited in size and variability, often containing only 10-20 participants and a handful of activities, recorded over a few hours [109].”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [109]
In the citing paper
“The system leads to improving model performance when integrating real and virtual IMU data [108,109].”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [109]
In the citing paper
“Cross-modality transfer approaches [54,108,109,161,162] are instrumental for extracting virtual IMU data from 2D RGB videos of activities.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [109]
In the citing paper
“IMUTube [109] extracts virtual IMU data from 2D RGB videos using pose tracking.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [109]
In the citing paper
“In recent years, there has been a growing interest in the combination of data obtained from videobased systems together with the time-series data originating from on-body sensors Rey et al. (2019); Kwon et al. (2020); Fortes Rey et al. (2021).”
From Opportunity++: A Multimodal Dataset for Video- and Wearable, Object and Ambient Sensors-Based Human Activity Recognition (2021) · cites this paper as Kwon et al. (2020)
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203 · cited 2×
“Recently, data generation using either oversampling or generative adversarial networks (GANs [82]) have also been successfully introduced to sensor-based human activity recognition [93].”
BackgroundMethodHinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260 · cited 1×
“Regardless of its utility, the HAR field has yet to experience significant improvements in recognition accuracy, in contrast to the breakthroughs in other fields, such as speech recognition [34], natural language processing [19], and computer vision [32].”
BackgroundGANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 1×
“In particular, if the target dataset is significantly smaller compared to the base dataset, transfer learning enables training a large target network without overfitting [94], and typically results in improved performance.”
Background
Research works printed but not linked: 37
- S. Alireza Golestaneh and L. Karam . 2017. Spatially-varying blur detection based on multiscale fused and sorted transform coefficients of gradient magnitudes . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 5800--5809 . S. Alireza Golestaneh and L. Karam. 2017. Spatially-varying blur detection based on multiscale fused and sorted transform coefficients of gradient magnitudes. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 5800--5809.
- T. Alldieck , M. Magnor , B. Bhatnagar , C. Theobalt , and G. Pons-Moll . 2019. Learning to reconstruct people in clothing from a single RGB camera . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1175--1186 . T. Alldieck, M. Magnor, B. Bhatnagar, C. Theobalt, and G. Pons-Moll. 2019. Learning to reconstruct people in clothing from a single RGB camera. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1175--1186.
- M. Andriluka , L. Pishchulin , P. Gehler , and B. Schiele . 2014. 2D Human Pose Estimation: New Benchmark and State of the Art Analysis . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). M. Andriluka, L. Pishchulin, P. Gehler, and B. Schiele. 2014. 2D Human Pose Estimation: New Benchmark and State of the Art Analysis. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- O. Bogdan , V. Eckstein , F. Rameau , and J. Bazin . 2018 . DeepCalib: a deep learning approach for automatic intrinsic calibration of wide field-of-view cameras . In Proceedings of the ACM SIGGRAPH European Conference on Visual Media Production. ACM , 6 : 1 - 6 :10. O. Bogdan, V. Eckstein, F. Rameau, and J. Bazin. 2018. DeepCalib: a deep learning approach for automatic intrinsic calibration of wide field-of-view cameras. In Proceedings of the ACM SIGGRAPH European Conference on Visual Media Production. ACM, 6:1-6:10.
- Z. Cao , T. Simon , S. Wei , and Y. Sheikh . 2017. Realtime multi-person 2d pose estimation using part affinity fields . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 7291--7299 . Z. Cao, T. Simon, S. Wei, and Y. Sheikh. 2017. Realtime multi-person 2d pose estimation using part affinity fields. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 7291--7299.
- Blender Online Community . 2018. Blender - a 3D modelling and rendering package . Blender Foundation, Stichting Blender Foundation, Amsterdam . http://www.blender.org Blender Online Community. 2018. Blender - a 3D modelling and rendering package. Blender Foundation, Stichting Blender Foundation, Amsterdam. http://www.blender.org
- C. Gu , C. Sun , D. Ross , C. Vondrick , C. Pantofaru , Y. Li , S. Vijayanarasimhan , G. Toderici , S. Ricco , R. Sukthankar , C. Schmid , and J. Malik . 2018. Ava: A video dataset of spatio-temporally localized atomic visual actions . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 6047--6056 . C. Gu, C. Sun, D. Ross, C. Vondrick, C. Pantofaru, Y. Li, S. Vijayanarasimhan, G. Toderici, S. Ricco, R. Sukthankar, C. Schmid, and J. Malik. 2018. Ava: A video dataset of spatio-temporally localized atomic visual actions. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 6047--6056.
- S. Haradal , H. Hayashi , and S. Uchida . 2018. Biosignal data augmentation based on generative adversarial networks . In Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 368--371 . S. Haradal, H. Hayashi, and S. Uchida. 2018. Biosignal data augmentation based on generative adversarial networks. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 368--371.
- K. He , X. Zhang , S. Ren , and J. Sun . 2016. Deep residual learning for image recognition . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770--778 . K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770--778.
- I. Joel , A.and Stergios. 2011 . A Direct Least-Squares (DLS) method for PnP . In IEEE International Conference on Computer Vision (ICCV). IEEE. I. Joel, A.and Stergios. 2011. A Direct Least-Squares (DLS) method for PnP. In IEEE International Conference on Computer Vision (ICCV). IEEE.
- C. Kang , H. Jung , and Y. Lee . 2019 . Towards Machine Learning with Zero Real-World Data. In The ACM Workshop on Wearable Systems and Applications. 41--46 . C. Kang, H. Jung, and Y. Lee. 2019. Towards Machine Learning with Zero Real-World Data. In The ACM Workshop on Wearable Systems and Applications. 41--46.
- P. Karlsson , B. Lo , and G. Z. Yang . 2014. Inertial sensing simulations using modified motion capture data . In Proceedings of the International Conference on Wearable and Implantable Body Sensor Networks (BSN). 16--19 . P. Karlsson, B. Lo, and G. Z. Yang. 2014. Inertial sensing simulations using modified motion capture data. In Proceedings of the International Conference on Wearable and Implantable Body Sensor Networks (BSN). 16--19.
- D. Kingma and J. Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). D. Kingma and J. Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
- N. Lane , Y. Xu , H. Lu , S. Hu , T. Choudhury , A. Campbell , and F. Zhao . 2011. Enabling Large-Scale Human Activity Inference on Smartphones Using Community Similarity Networks . In Proceedings of the International Conference on Ubiquitous Computing. ACM, 355--364 . N. Lane, Y. Xu, H. Lu, S. Hu, T. Choudhury, A. Campbell, and F. Zhao. 2011. Enabling Large-Scale Human Activity Inference on Smartphones Using Community Similarity Networks. In Proceedings of the International Conference on Ubiquitous Computing. ACM, 355--364.
- A. Le Guennec , S. Malinowski , and R. Tavenard . 2016. Data Augmentation for Time Series Classification using Convolutional Neural Networks . In ECML/PKDD Workshop on Advanced Analytics and Learning on Temporal Data. A. Le Guennec, S. Malinowski, and R. Tavenard. 2016. Data Augmentation for Time Series Classification using Convolutional Neural Networks. In ECML/PKDD Workshop on Advanced Analytics and Learning on Temporal Data.
- N. Mahmood , N. Ghorbani , N. Troje , G. Pons-Moll , and M. Black . 2019. AMASS: Archive of motion capture as surface shapes . In IEEE International Conference on Computer Vision (ICCV). 5442--5451 . N. Mahmood, N. Ghorbani, N. Troje, G. Pons-Moll, and M. Black. 2019. AMASS: Archive of motion capture as surface shapes. In IEEE International Conference on Computer Vision (ICCV). 5442--5451.
- A. Mathur , T. Zhang , S. Bhattacharya , P. Velickovic , L. Joffe , N. Lane , F. Kawsar , and P. Lió . 2018. Using deep data augmentation training to address software and hardware heterogeneities in wearable and smartphone sensing devices . In IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 200--211 . A. Mathur, T. Zhang, S. Bhattacharya, P. Velickovic, L. Joffe, N. Lane, F. Kawsar, and P. Lió. 2018. Using deep data augmentation training to address software and hardware heterogeneities in wearable and smartphone sensing devices. In IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 200--211.
- V. Nair and G. Hinton . 2010. Rectified linear units improve restricted boltzmann machines . In Proceedings of the international conference on machine learning (ICML). 807--814 . V. Nair and G. Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In Proceedings of the international conference on machine learning (ICML). 807--814.
- F. Ofli , R. Chaudhry , G. Kurillo , R. Vidal , and R. Bajcsy . 2013. Berkeley mhad: A comprehensive multimodal human action database . In IEEE Workshop on Applications of Computer Vision (WACV). IEEE, 53--60 . F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, and R. Bajcsy. 2013. Berkeley mhad: A comprehensive multimodal human action database. In IEEE Workshop on Applications of Computer Vision (WACV). IEEE, 53--60.
- A. Oord , S. Dieleman , H. Zen , K. Simonyan , O. Vinyals , A. Graves , N. Kalchbrenner , A. Senior , and K. Kavukcuoglu . 2016 . Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016). A. Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, and K. Kavukcuoglu. 2016. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016). · arXiv
- D. Pavllo , C. Feichtenhofer , D. Grangier , and M. Auli . 2019. 3D human pose estimation in video with temporal convolutions and semi-supervised training . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 7753--7762 . D. Pavllo, C. Feichtenhofer, D. Grangier, and M. Auli. 2019. 3D human pose estimation in video with temporal convolutions and semi-supervised training. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 7753--7762.
- T. Plötz , C. Chen , N. Hammerla , and G. Abowd . 2012. Automatic synchronization of wearable sensors and video-cameras for ground truth annotation-a practical approach . In Proceedings of the ACM International Symposium on Wearable Computers. IEEE, 100--103 . T. Plötz, C. Chen, N. Hammerla, and G. Abowd. 2012. Automatic synchronization of wearable sensors and video-cameras for ground truth annotation-a practical approach. In Proceedings of the ACM International Symposium on Wearable Computers. IEEE, 100--103.
- J. Redmon , S. Divvala , R. Girshick , and A. Farhadi . 2016. You only look once: Unified, real-time object detection . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 779--788 . J. Redmon, S. Divvala, R. Girshick, and A. Farhadi. 2016. You only look once: Unified, real-time object detection. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 779--788.
- A. Reiss and D. Stricker . 2012. Introducing a new benchmarked dataset for activity monitoring . In Proceedings of the ACM International Symposium on Wearable Computers. IEEE, 108--109 . A. Reiss and D. Stricker. 2012. Introducing a new benchmarked dataset for activity monitoring. In Proceedings of the ACM International Symposium on Wearable Computers. IEEE, 108--109.
- A. Reiss and D. Stricker . 2013. Personalized mobile physical activity recognition . In Proceedings of the ACM International Symposium on Wearable Computers. 25--28 . A. Reiss and D. Stricker. 2013. Personalized mobile physical activity recognition. In Proceedings of the ACM International Symposium on Wearable Computers. 25--28.
- A. Saeed , T. Ozcelebi , and J. Lukkien . 2019. Multi-task Self-Supervised Learning for Human Activity Detection . Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies (IMWUT) 3 , 2 ( 2019 ), 1--30. A. Saeed, T. Ozcelebi, and J. Lukkien. 2019. Multi-task Self-Supervised Learning for Human Activity Detection. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies (IMWUT) 3, 2 (2019), 1--30.
- Z. Shen , W. Wang , X. Lu , J. Shen , H. Ling , T. Xu , and L. Shao . 2019 . Human-Aware Motion Deblurring. In IEEE International Conference on Computer Vision (ICCV). 5572--5581 . Z. Shen, W. Wang, X. Lu, J. Shen, H. Ling, T. Xu, and L. Shao. 2019. Human-Aware Motion Deblurring. In IEEE International Conference on Computer Vision (ICCV). 5572--5581.
- J. Shi , L. Xu , and J. Jia . 2014. Discriminative blur detection features . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2965--2972 . J. Shi, L. Xu, and J. Jia. 2014. Discriminative blur detection features. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2965--2972.
- G. Sigurdsson , G. Varol , X. Wang , I. Laptev , A. Farhadi , and A. Gupta . 2016 . Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding. arXiv preprint arXiv:1604.01753 (2016). G. Sigurdsson, G. Varol, X. Wang, I. Laptev, A. Farhadi, and A. Gupta. 2016. Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding. arXiv preprint arXiv:1604.01753 (2016). · arXiv
- E. Thomaz , I. Essa , and G. Abowd . 2015. A practical approach for recognizing eating moments with wrist-mounted inertial sensing . In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing. 1029--1040 . E. Thomaz, I. Essa, and G. Abowd. 2015. A practical approach for recognizing eating moments with wrist-mounted inertial sensing. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing. 1029--1040.
- C. Tong , S. Tailor , and N. Lane . 2020. Are Accelerometers for Activity Recognition a Dead-End? . In Proceedings of the International Workshop on Mobile Computing Systems and Applications. ACM, 39--44 . C. Tong, S. Tailor, and N. Lane. 2020. Are Accelerometers for Activity Recognition a Dead-End?. In Proceedings of the International Workshop on Mobile Computing Systems and Applications. ACM, 39--44.
- F. Xiao L. Pei L. Chu D. Zou W. Yu Y. Zhu and T. Li. 2020. A Deep Learning Method for Complex Human Activity Recognition Using Virtual Wearable Sensors. arXiv preprint arXiv:2003.01874 (2020). F. Xiao L. Pei L. Chu D. Zou W. Yu Y. Zhu and T. Li. 2020. A Deep Learning Method for Complex Human Activity Recognition Using Virtual Wearable Sensors. arXiv preprint arXiv:2003.01874 (2020). · arXiv
- S. Yao , Y. Zhao , H. Shao , C. Zhang , A. Zhang , S. Hu , D. Liu , S. Liu , Lu Su , and T. Abdelzaher . 2018. Sensegan: Enabling deep learning for internet of things with a semi-supervised framework . Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies (IMWUT) 2 , 3 ( 2018 ), 1--21. S. Yao, Y. Zhao, H. Shao, C. Zhang, A. Zhang, S. Hu, D. Liu, S. Liu, Lu Su, and T. Abdelzaher. 2018. Sensegan: Enabling deep learning for internet of things with a semi-supervised framework. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies (IMWUT) 2, 3 (2018), 1--21.
- A. Young , M. Ling , and D. Arvind . 2011. IMUSim: A simulation environment for inertial sensing algorithm design and evaluation . In Proceedings of the International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 199--210 . A. Young, M. Ling, and D. Arvind. 2011. IMUSim: A simulation environment for inertial sensing algorithm design and evaluation. In Proceedings of the International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 199--210.
- J. Yu and R. Ramamoorthi . 2019. Robust Video Stabilization by Optimization in CNN Weight Space . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3800--3808 . J. Yu and R. Ramamoorthi. 2019. Robust Video Stabilization by Optimization in CNN Weight Space. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3800--3808.
- M. Zhang and A. A. Sawchuk . 2012. USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors . In Proceedings of the International Conference on Ubiquitous Computing. M. Zhang and A. A. Sawchuk. 2012. USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors. In Proceedings of the International Conference on Ubiquitous Computing.
- Q. Zhang and R. Pless . 2004. Extrinsic calibration of a camera and laser range finder (improves camera calibration) . In IEEE International Conference on Intelligent Robots and Systems (IROS). IEEE. Q. Zhang and R. Pless. 2004. Extrinsic calibration of a camera and laser range finder (improves camera calibration). In IEEE International Conference on Intelligent Robots and Systems (IROS). IEEE.
Cited by
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463506 · Cited by 150
Self-citationAssessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
Self-citationImproving Deep Learning for HAR with Shallow LSTMs
Bock, M., Hölzemann, A., Moeller, M., & Van Laerhoven, K. (2021) · 2021 International Symposium on Wearable Computers · doi:10.1145/3460421.3480419 · Cited by 74
Towards Generalized mmWave-based Human Pose Estimation through Signal Augmentation
Xue, H., Cao, Q., Miao, C., Ju, Y., Hu, H., Zhang, A., & Su, L. (2023) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3570361.3613302 · Cited by 95
Hong, Z., Li, Z., Zhong, S., Lyu, W., Wang, H., Ding, Y., He, T., & Zhang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659597 · Cited by 67
IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition
Leng, Z., Bhattacharjee, A., Rajasekhar, H., Zhang, L., Bruda, E., Kwon, H., & Plötz, T. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3678545 · Cited by 61
Self-citationA perspective on human activity recognition from inertial motion data
Gomaa, W., & Khamis, M. A. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08863-9 · Cited by 54
Practically Adopting Human Activity Recognition
Xu, H., Zhou, P., Tan, R., & Li, M. (2023) · Proceedings of the 29th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3570361.3613299 · Cited by 55
SAMoSA: Sensing Activities with Motion and Subsampled Audio
Mollyn, V., Ahuja, K., Verma, D., Harrison, C., & Goel, M. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550284 · Cited by 82
Cross-Domain HAR: Few-Shot Transfer Learning for Human Activity Recognition
Thukral, M., Haresamudram, H., & Plötz, T. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3704921 · Cited by 71
Self-citationCross-Domain HAR: Few Shot Transfer Learning for Human Activity Recognition
Thukral, M., Haresamudram, H., & Ploetz, T. (2023) · arXiv · doi:10.48550/arxiv.2310.14390 · Cited by 45
Self-citationTransfer Learning in Sensor-Based Human Activity Recognition: A Survey
Dhekane, S. G., & Ploetz, T. (2025) · ACM Computing Surveys · doi:10.1145/3717608 · Cited by 42
Self-citationZero-Shot Learning for IMU-Based Activity Recognition Using Video Embeddings
Tong, C., Ge, J., & Lane, N. D. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494995 · Cited by 40
Self-citationIMU2Doppler: Cross-Modal Domain Adaptation for Doppler-based Activity Recognition Using IMU Data
Bhalla, S., Goel, M., & Khurana, R. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494994 · Cited by 41
Xia, S., Chu, L., Pei, L., Zhang, Z., Yu, W., & Qiu, R. C. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3111996 · Cited by 40
Liu, Y., Zhang, S., & Gowda, M. (2021) · Proceedings of the International Conference on Internet-of-Things Design and Implementation · doi:10.1145/3450268.3453537 · Cited by 39
Leng, Z., Kwon, H., & Ploetz, T. (2023) · Proceedings of the 2023 International Symposium on Wearable Computers · doi:10.1145/3594738.3611361 · Cited by 39
Self-citationMiao, S., Chen, L., Hu, R., & Luo, Y. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550331 · Cited by 36
Comparing Sampling Strategies for Tackling Imbalanced Data in Human Activity Recognition
Alharbi, F., Ouarbya, L., & Ward, J. A. (2022) · Sensors · doi:10.3390/s22041373 · Cited by 47
“An important part of this is solving the class imbalance problem [13].”
BackgroundCiliberto, M., Fortes Rey, V., Calatroni, A., Lukowicz, P., & Roggen, D. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.792065 · Cited by 35
“In recent years, there has been a growing interest in the combination of data obtained from video-based systems together with the time-series data originating from on-body sensors Rey et al. (2019); Kwon et al. (2020); Fortes Rey et al. (2021).”
BackgroundPlÖtz, T. (2022) · ACM Computing Surveys · doi:10.1145/3459666 · Cited by 34
Self-citationZhang, Y. L., Xia, S., Chu, L., Yang, J., Wu, Q., & Pei, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00185 · Cited by 46
SenseCollect: We Need Efficient Ways to Collect On-body Sensor-based Human Activity Data!
Chen, W., Lin, S., Thompson, E., & Stankovic, J. A. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478119 · Cited by 51
Learning on the Rings: Self-Supervised 3D Finger Motion Tracking Using Wearable Sensors
Zhou, H., Lu, T., Liu, Y., Zhang, S., & Gowda, M. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534587 · Cited by 42
AdaSpring: Context-adaptive and Runtime-evolutionary Deep Model Compression for Mobile Applications
Liu, S., Guo, B., Ma, K., Yu, Z., & Du, J. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3448125 · Cited by 47
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33
Self-citationKwon, H., Abowd, G. D., & Plötz, T. (2021) · Sensors · doi:10.3390/s21248337 · Cited by 30
Self-citationIn-depth analysis of design & development for sensor-based human activity recognition system
Choudhury, N. A., & Soni, B. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16423-5 · Cited by 30
Detecting and Correcting IMU Movements During Joint Angle Estimation
Yi, C., Rho, S., Wei, B., Yang, C., Ding, Z., Chen, Z., & Jiang, F. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3167771 · Cited by 36
Co-simulation of human digital twins and wearable inertial sensors to analyse gait event estimation
Uhlenberg, L., Derungs, A., & Amft, O. (2023) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2023.1104000 · Cited by 36
Synthetic Smartwatch IMU Data Generation from In-the-wild ASL Videos
Santhalingam, P. S., Pathak, P., Rangwala, H., & Kosecka, J. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3596261 · Cited by 28
SignRing: Continuous American Sign Language Recognition Using IMU Rings and Virtual IMU Data
Li, J., Huang, L., Shah, S., Jones, S. J., Jin, Y., Wang, D., Russell, A., Choi, S., Gao, Y., Yuan, J., et al. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610881 · Cited by 44
Self-citationYi, X., Zhou, Y., & Xu, F. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657436 · Cited by 30
“Virtual IMU measurement generation has also been explored in other tasks such as human action recognition from videos [Kwon et al. 2020; Rey et al. 2019] or motion sequences [Takeda et al. 2018; Xiao et al. 2021].”
MethodInvestigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom56429.2023.10099197 · Cited by 27
Self-citationSingh, A., Bevilacqua, A., Nguyen, T. L., Hu, F., McGuinness, K., O’Reilly, M., Whelan, D. F., Caulfield, B., & Ifrim, G. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00895-4 · Cited by 32
Human Activity Recognition Using Machine Learning Algorithms Based on IMU Data
Nia, N. G., Kaplanoğlu, E., Nasab, A., & Qin, H. H. (2023) · International Conference on Bio-engineering for Smart Technologies (BioSMART) · doi:10.1109/biosmart58455.2023.10162095 · Cited by 32
Optimizing Sensor Position with Virtual Sensors in Human Activity Recognition System Design
Xia, C., & Sugiura, Y. (2021) · Sensors · doi:10.3390/s21206893 · Cited by 29
Content-Aware Adaptive Device–Cloud Collaborative Inference for Object Detection
Hu, Y., Li, Z., Chen, Y., Cheng, Y., Cao, Z., & Liu, J. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3279579 · Cited by 30
“I NTELLIGENT applications based on deep neural networks (DNNs) are being widely deployed on Internet of Things (IoT) devices to provide people with various intelligent services in all aspects of life [1], [2].”
BackgroundI Am an Earphone and I Can Hear My User’s Face: Facial Landmark Tracking Using Smart Earphones
Zhang, S., Lu, T., Zhou, H., Liu, Y., Liu, R., & Gowda, M. (2023) · ACM Transactions on Internet of Things · doi:10.1145/3614438 · Cited by 32
Invariant Feature Learning for Sensor-based Human Activity Recognition
Hao, Y., Zheng, R., & Wang, B. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3064252 · Cited by 29
“Although deep learning has seen many successes in this field, training deep models often requires a large amount of sensory data that is not always available [1].”
BackgroundXia, C., & Sugiura, Y. (2022) · Proceedings of the 2022 ACM International Symposium on Wearable Computers · doi:10.1145/3544794.3558460 · Cited by 22
Arakawa, R., Yakura, H., Mollyn, V., Nie, S., Russell, E. R., DeMeo, D. P., Reddy, H. A., Maytin, A. K., Carroll, B. T., Lehman, J. F., et al. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3569504 · Cited by 34
ConvBoost: Boosting ConvNets for Sensor-based Activity Recognition
Shao, S., Guan, Y., Zhai, B., Missier, P., & Plötz, T. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3596234 · Cited by 30
Self-citationXia, C., Saito, A., & Sugiura, Y. (2022) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2022.113463 · Cited by 19
Xia, C., Fang, X., Arakawa, R., & Sugiura, Y. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534576 · Cited by 23
Chen, Y., Li, J., Blasch, E., & Qu, Q. (2025) · Applied Sciences · doi:10.3390/app15073434 · Cited by 34
“…have demonstrated that the fusion of wearable sensors with environmental sensors and virtual sensor data, e.g., from videos, simulations, or digital twins, enhances the robustness of HAR systems, particularly in real-world settings with diverse activities and environmental conditions [78–80].”
Deng, K., Zhao, D. Y., Zhang, Z., Wang, S., Zheng, W., & Ma, H. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3325399 · Cited by 21
Fortes Rey, V., Garewal, K. K., & Lukowicz, P. (2021) · Applied Sciences · doi:10.3390/app11073094 · Cited by 17
“Recent work that follows this approach is [38], which uses off the shelf methods to predict 3D human poses for monocular images and then”
BackgroundPhysiQ: Off-site Quality Assessment of Exercise in Physical Therapy
Wang, H. D., & Ma, M. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3570349 · Cited by 22
If only we had more data!: Sensor-Based Human Activity Recognition in Challenging Scenarios
Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops) · doi:10.1109/percomworkshops56833.2023.10150267 · Cited by 16
Self-citationTechnology for measuring freezing of gait: Current state of the art and recommendations
Mancini, M., McKay, J. L., Cockx, H., D’Cruz, N., Esper, C. D., Filtjens, B., Heimler, B., MacKinnon, C. D., Palmerini, L., Roerdink, M., et al. (2025) · Journal of Parkinson s Disease · doi:10.1177/1877718x241301065 · Cited by 29
AIGC for RF-Based Human Activity Sensing
Wang, Z., Yang, C., & Mao, S. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3482256 · Cited by 15
Beyond Fine-Tuning: Efficient and Effective Fed-Tuning for Mobile/Web Users
Liu, B., Cai, Y., Bi, H., Zhang, Z., Li, D., Guo, Y., & Chen, X. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583212 · Cited by 17
SignQuery: A Natural User Interface and Search Engine for Sign Languages with Wearable Sensors
Zhou, H., Lu, T., Mckinnie, K., Palagano, J., DeHaan, K., & Gowda, M. (2023) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3570361.3613286 · Cited by 16
Sign Language Recognition With Self-Learning Fusion Model
Vu, H. N., Hoang, T., Tran, C., & Pham, C. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3314728 · Cited by 13
Patidar, P., Goel, M., & Agarwal, Y. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610907 · Cited by 20
Clustering of Human Activities from Wearables by Adopting Nearest Neighbors
Ahmed, A., Haresamudram, H., & Plötz, T. (2022) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3544794.3558477 · Cited by 14
Self-citationSensor Data Augmentation from Skeleton Pose Sequences for Improving Human Activity Recognition
Zolfaghari, P. S., Rey, V. F., Ray, L. S. S., Kim, H., Suh, S., & Lukowicz, P. (2024) · International Conference on Activity and Behavior Computing (ABC) · doi:10.1109/abc61795.2024.10652200 · Cited by 11
Uhlenberg, L., Haeusler, L. O., & Amft, O. (2024) · IEEE Access · doi:10.1109/access.2024.3513477 · Cited by 16
An Examination of Wearable Sensors and Video Data Capture for Human Exercise Classification
Singh, A., Bevilacqua, A., Aderinola, T. B., Nguyen, T. L., Whelan, D. F., O’Reilly, M., Caulfield, B., & Ifrim, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43427-3_19 · Cited by 10
Let's Grab a Drink: Teacher-Student Learning for Fluid Intake Monitoring using Smart Earphones
Zhang, S., Liu, Y., & Gowda, M. (2022) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi54339.2022.00014 · Cited by 12
“earphone VPU sensors, or wearable devices [56].”
BackgroundInterpersonal Distance Tracking with mmWave Radar and IMUs
Dai, Y., Shuai, X., Tan, R., & Xing, G. (2023) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/3583120.3586958 · Cited by 10
Detecting Freezing of Gait with Earables Trained from VR Motion Capture Data
Oishi, N., Heimler, B., Pellatt, L., Plotnik, M., & Roggen, D. (2021) · International Symposium on Wearable Computers · doi:10.1145/3460421.3478821 · Cited by 11
“A variety of data sources have been used to simulate wearable IMU data to compensate for the lack of datasets for sensor-based human activity recognition, such as motion capture data [20], RGB videos [13], or depth sensing cameras [2].”
A Framework for Designing Fair Ubiquitous Computing Systems
Zhang, H., Wang, L., Sheng, Y., Xu, X., Mankoff, J. C., & Dey, A. K. (2023) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3594739.3610677 · Cited by 17
Deng, K., Zhao, D. Y., Zheng, W., Ling, Y., Yin, K., & Ma, H. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3502668 · Cited by 13
PressInPose: Integrating Pressure and Inertial Sensors for Full-Body Pose Estimation in Activities
Gao, Y., Zhang, W., Ren, J., Zheng, R., Jin, Y., Wu, D., Shu, L., Xu, X., & Jin, Z. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699773 · Cited by 10
Self-citationCROMOSim: A Deep Learning-Based Cross-Modality Inertial Measurement Simulator
Hao, Y., Lou, X., Wang, B., & Zheng, R. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3230370 · Cited by 14
Wang, T., Li, J., Wang, R., Kara, D., Liu, S., Wertheimer, D., Martin, A. V., Ganti, R., Srivatsa, M., & Abdelzaher, T. (2023) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3625687.3625785 · Cited by 13
Observational and Accelerometer Analysis of Head Movement Patterns in Psychotherapeutic Dialogue
Inoue, M., Irino, T., Furuyama, N., & Hanada, R. (2021) · Sensors · doi:10.3390/s21093162 · Cited by 10
“The IMUs can be simulated by processing video data to some extent [57].”
MethodEnhancing Inertial Hand based HAR through Joint Representation of Language, Pose and Synthetic IMUs
Rey, V. F., Ray, L. S. S., Xia, Q., Wu, K., & Lukowicz, P. (2024) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3675095.3676609 · Cited by 16
Khayami, H., Wang, L., Kim, Y., Lee, B., Conroy, D. E., Lazar, A., Choe, E. K., & Kacorri, H. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3731749 · Cited by 8
MOCLoc: Emerging Online Collaborative Localization Enhanced by Multidimensional Scaling
Zhou, C., Wang, B., Mo, Y., & Zeng, Z. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2021.3110260 · Cited by 9
On the Utility of Virtual On-body Acceleration Data for Fine-grained Human Activity Recognition
Leng, Z., Jain, Y., Kwon, H., & Plötz, T. (2023) · International Symposium on Wearable Computers · doi:10.1145/3594738.3611364 · Cited by 13
Self-citationRay, L. S. S., Xia, Q., Rey, V. F., Wu, K., & Lukowicz, P. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1569205 · Cited by 11
IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognition
Zhou, H., Arakawa, R., Agarwal, Y., & Goel, M. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747695 · Cited by 14
Img2Acoustic: A Cross-Modal Gesture Recognition Method Based on Few-Shot Learning
Zou, Y., Weng, J., Kuang, W., Jiao, Y., Leung, V. C. M., & Wu, K. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3481443 · Cited by 6
Huang, L., & Xia, C. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650806 · Cited by 5
WIMUSim: simulating realistic variabilities in wearable IMUs for human activity recognition
Oishi, N., Birch, P. M., Roggen, D., & Lago, P. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1514933 · Cited by 15
Quaterni-On: Calibration-free Matching of Wearable IMU Data to Joint Estimates of Ambient Cameras
Kempfle, J., & Laerhoven, K. V. (2021) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops51409.2021.9431088 · Cited by 5
CROMOSim: A Deep Learning-based Cross-modality Inertial Measurement Simulator
Hao, Y., Wang, B., & Zheng, R. (2022) · 2022 2nd International Workshop on Cyber-Physical-Human System Design and Implementation (CPHS) · doi:10.1109/cphs56133.2022.9804560 · Cited by 6
Sensor-Based Human Activity and Behavior Computing
Antar, A. D., Ahmed, M., & Ahad, M. A. R. (2021) · Intelligent systems reference library · doi:10.1007/978-3-030-75490-7_6 · Cited by 5
Jia, H., Hu, J., & Hu, W. S. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478082 · Cited by 11
Open Set Mixed-Reality Human Activity Recognition
Zhang, Z., Chu, L., Xia, S., & Pei, L. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685735 · Cited by 5
Xia, C., Peng, Q., Fan, Z., Min, T., Zhang, D., & Wang, C. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3553561 · Cited by 5
Rey, V. F., Rezende, P. M. B., Zhou, B., Suh, S., & Lukowicz, P. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129288 · Cited by 14
Xia, C., Chen, X., Huang, L., Min, T., & Zhang, D. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3548063 · Cited by 5
Oishi, N., Birch, P. M., Roggen, D., & Lago, P. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3661047 · Cited by 9
Keyvanpour, M. R., Mehrmolaei, S., Shojaeddini, S. V., & Esmaeili, F. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16795-8 · Cited by 4
Enhancing the Applicability of Sign Language Translation
Li, J., Xu, J., Liu, Y., Xu, W., & Li, Z. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3350111 · Cited by 6
Open-Source Data Collection for Activity Studies at Scale
Hoelzemann, A., Pithan, J. S., & Laerhoven, K. V. (2022) · Smart innovation, systems and technologies · doi:10.1007/978-981-19-0361-8_2 · Cited by 6
Physical Exercise Classification from Body Keypoints Using Machine Learning Techniques
Rahman, A., Saji, A., Teresa, A., Nair, D. R., & Saritha, S. (2024) · International Conference on Applied Artificial Intelligence and Computing (ICAAIC) · doi:10.1109/icaaic60222.2024.10575612 · Cited by 4
Wonderwall: A Virtual-to-Real Foundation Model for IMU-based HAR
Miao, S., & Chen, L. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3789688 · Cited by 9
Video2mmPoint: Synthesizing mmWave Point Cloud Data From Videos for Gait Recognition
Fan, Y., Wang, Y., Zheng, H., & Shi, Z. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3483835 · Cited by 4
USpeech: Ultrasound-Enhanced Speech with Minimal Human Effort via Cross-Modal Synthesis
Yu, L. J.-T., Zhao, R., Ji, S., Ngai, E. C. ‐., & Wu, C. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729462 · Cited by 5
Matching Skeleton-based Activity Representations with Heterogeneous Signals for HAR
Li, S., Zhang, J., Fu, X., Zhang, X., Shang, J., & Gupta, R. K. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722089 · Cited by 5
Ray, L. S. S., Krupp, L., Rey, V. F., Zhou, B., Suh, S., & Lukowicz, P. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3732001 · Cited by 7
Zhao, C., Li, B., & Guo, K. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2023662 · Cited by 3
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3677562 · Cited by 8
Self-citationFrom Vision to Motion: Translating Large-Scale Knowledge for Data-Scarce IMU Applications
Yoon, H., Cha, H., Nguyen, H. C., Gong, T., & Lee, S.-J. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3556998 · Cited by 10
Metadata
- Authors
- Kwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Plötz, T.
- Affiliations
- Georgia Institute of Technology (US)
- University of Oxford (GB)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2020-09-04
- Volume
- 4
- Issue
- 3
- Pages
- 1-29
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3083323811
- Cited by
- 152
- References
- 49
- Citations by year
- 2026: 20 · 2025: 29 · 2024: 24 · 2023: 32 · 2022: 23 · 2021: 24
- FWCI
- 7.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Funders
- Engineering and Physical Sciences Research Council (1892895)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Keywords
- human activity recognition, on-body sensors, inertial measurement unit, automatic annotation, accelerometry, wearable sensors, labeled data scarcity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.