Real-time Arm Skeleton Tracking and Gesture Inference Tolerant to Missing Wearable Sensors
The DOI matches its Crossref record; 57 of the 60 references it cites were found in a registry or an index.
Abstract
This paper presents ArmTroi, a wearable system for understanding and analyzing the detailed arm motions of people primarily by using the motion sensors from wrist-worn wearable devices. ArmTroi can achieve real-time 3D arm skeleton tracking and reliable gesture inference tolerant to missing wearable sensors for enabling numerous useful application designs. We have coped with two major challenges through ArmTroi. First, the skeleton of each arm is determined from the locations of the elbow and wrist, whereas a wearable device only senses a single point from the wrist. We find that the potential solution space is huge. This underconstrained nature fundamentally challenges the achievement of accurate and real-time arm skeleton tracking. Second, wearable sensors may not reliably provide sensory data. For example, devices are not worn by the user, yet the learning tools for gesture inference, such as deep learning, typically have static network structures, which require nontrivial network adaptation to match the input's varying availability and ensure reliable gesture inference. We propose effective techniques to address above challenges, and all computations can be conducted on the user's smartphone. ArmTroi is thus a fully lightweight and portable system. We develop a prototype and extensive evaluation shows the efficacy of the ArmTroi design.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the available devices are an arbitrary subset of the total devices, which is unpredictable and would severely impact the recognition performance of existing methods.”
From Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition (2023) · cites this paper as [45]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
(2014) · Cited by 33,419
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The attention technique is widely used in the fields of natural language generation and visual object recognition [45].”
MethodBidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 8×
“Its output is yr = (y 0 r , · · · ,y T−1 r ), and each ytr = o t r ◦ fy (c t r ), where ctr = f t r ◦ c t−1 r + i t r ◦ fc (W c r x t r +W y r y t−1 r + b c r ) is the cell in an LSTM model; otr , f t r and i t r are gates in an LSTM model;W c r and W y r are the weights; b c r is a bias vector; fy and fc are the acti…”
MethodInfluentialEffective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382 · cited 2×
“We introduce an attention-based design to achieve a virtual network adaptation to address this possible missing input data issue, where attention [27] is a novel technique for adjusting certain parameters of a network (by multiplying a weighting vector where each weight can vary) to enhance the output on the basis of…”
MethodShow, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · cited 5×
“To reduce computation, fatt (·) is typically realized as a single-layer multilayer perceptron, such as tanh(·) and ReLu(·) [1, 53]; however, it still follows the same principle as a complete neural network, i.”
BackgroundMethodInfluentialRealtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539 · cited 1×
“Recently, people can utilize cameras to track user’s 2D upper limbs or even the whole body with errors of about 2 cm to enable person re-identification, video re-targeting and robot teaching applications [3, 56].”
BackgroundRecurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 2×
“With the aforementioned inputs, we propose to first apply a recurrent neural network (RNN) to extract the input’s individual dynamic motion features [30] and then gradually concatenate them with additional RNNs for further extracting characteristics from an aggregated view, which are finally used for the gesture infer…”
BackgroundMethod(2011) · Cited by 2,752
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662 · cited 1×
“Deep learning is widely applied in applications [6, 9, 14, 16, 24, 50, 52] without using handcrafted features [2, 22].”
BackgroundA Neural Attention Model for Abstractive Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1044 · Cited by 2,656 · cited 1×
“Typical applications include language translation [1], news summarizer [37], and picture caption generation [53], mostly using textual contents or images as inputs to generate target outputs.”
BackgroundMicrosoft Kinect Sensor and Its Effect
Zhang, Z. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.24 · Cited by 2,487 · cited 1×
“Meanwhile, 3D recovery is achieved using depth cameras [55] or VICON [43] for the applications, such as the sport analysis with 2.”
MethodHierarchical recurrent neural network for skeleton based action recognition
Du, Y., Wang, W., & Wang, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298714 · Cited by 1,895 · cited 1×
“, video [7]), wearable sensory data are not reliably available (e.”
BackgroundExtensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Cernocky, J., & Khudanpur, S. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947611 · Cited by 1,568
Gradient Flow in Recurrent Nets: The Difficulty of Learning LongTerm Dependencies
(2009) · A Field Guide to Dynamical Recurrent Networks · doi:10.1109/9780470544037.ch14 · Cited by 1,246
Sigal, L., Balan, A. O., & Black, M. J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0273-6 · Cited by 1,164
Whole-home gesture recognition using wireless signals
Pu, Q., Gupta, S., Gollakota, S., & Patel, S. (2013) · Proceedings of the 19th annual international conference on Mobile computing & networking - MobiCom '13 · doi:10.1145/2500423.2500436 · Cited by 1,109 · cited 4×
“In the wearable computing market, many novel HCI designs have emerged recently (e.g., smart home devices andmotion games [51]), and user arms’ gestures are the key inputs of these systems.”
BackgroundInfluentialDeep Learning of Representations: Looking Forward
Bengio, Y. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39593-2_1 · Cited by 513 · cited 1×
“Deep learning is widely applied in applications [6, 9, 14, 16, 24, 50, 52] without using handcrafted features [2, 22].”
BackgroundTowards wearable cognitive assistance
Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., & Satyanarayanan, M. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594383 · Cited by 476 · cited 1×
“The ArmTroi design does not depend on the ambient infrastructure support, such as off-loading expensive computations to clouds or edges [13, 57], due to limitations arising from restricted service coverage, system costs, and privacy concerns.”
BackgroundDeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460664 · Cited by 450 · cited 1×
“, resource optimization [10, 15, 19] and network compression [21, 25, 54].”
BackgroundAccelerometer-based transportation mode detection on smartphones
Hemminki, S., Nurmi, P., & Tarkoma, S. (2013) · Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2517351.2517367 · Cited by 435 · cited 1×
“Deep learning is widely applied in applications [6, 9, 14, 16, 24, 50, 52] without using handcrafted features [2, 22].”
BackgroundZhao, M., Tian, Y., Zhao, H., Alsheikh, M. A., Li, T., Hristov, R., Kabelac, Z., Katabi, D., & Torralba, A. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230579 · Cited by 379 · cited 2×
“Recent studies, like [56], also propose to use wireless signals and deep learning to enable the through-the-wall tracking with the error of 7.”
BackgroundHan, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 367 · cited 1×
“, resource optimization [10, 15, 19] and network compression [21, 25, 54].”
BackgroundHow long to wait?: predicting bus arrival time with mobile phone based participatory sensing
Zhou, P., Zheng, Y., & Li, M. (2012) · Proceedings of the 10th international conference on Mobile systems, applications, and services · doi:10.1145/2307636.2307671 · Cited by 348
DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications
Huynh, L. N., Lee, Y., & Balan, R. K. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081360 · Cited by 329 · cited 1×
“, resource optimization [10, 15, 19] and network compression [21, 25, 54].”
BackgroundRecognizing Detailed Human Context in the Wild from Smartphones and Smartwatches
Vaizman, Y., Ellis, K., & Lanckriet, G. (2017) · IEEE Pervasive Computing · doi:10.1109/mprv.2017.3971131 · Cited by 324
Ambulatory measurement of shoulder and elbow kinematics through inertial and magnetic sensors
Cutti, A. G., Giovanardi, A., Rocchi, L., Davalli, A., & Sacchetti, R. (2008) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-007-0296-5 · Cited by 311 · cited 1×
“Existing works [4, 8] have focused on upper limbs, but they also require multiple sensors on the arm.”
BackgroundA Survey of Applications and Human Motion Recognition with Microsoft Kinect
Lun, R., & Zhao, W. (2015) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001415550083 · Cited by 300 · cited 1×
“The ArmTroi design can provide a lightweight way to obtain such desired inputs with a substantially extended service coverage and decreased system cost, compared with cameras or depth sensors adopted in existing solutions [26].”
BackgroundA practical approach for recognizing eating moments with wrist-mounted inertial sensing
Thomaz, E., Essa, I., & Abowd, G. D. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807545 · Cited by 299 · cited 1×
“Detecting meaningful hand gestures can prompt a healthier lifestyle [42, 47], e.”
BackgroundShoulder and Elbow Joint Angle Tracking With Inertial Sensors
El-Gohary, M., & McNames, J. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2208750 · Cited by 264 · cited 1×
“Existing works [4, 8] have focused on upper limbs, but they also require multiple sensors on the arm.”
BackgroundOn-Demand Deep Model Compression for Mobile Devices: A Usage-Driven Model Selection Framework
Liu, S., Lin, Y., Zhou, Z., Nan, K., Liu, H., & Du, J. (2018) · Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3210240.3210337 · Cited by 217 · cited 2×
“, resource optimization [10, 15, 19] and network compression [21, 25, 54].”
BackgroundMotion reconstruction using sparse accelerometer data
Tautges, J., Zinke, A., Krüger, B., Baumann, J., Weber, A., Helten, T., Müller, M., Seidel, H.-P., & Eberhardt, B. (2011) · ACM Transactions on Graphics · doi:10.1145/1966394.1966397 · Cited by 197 · cited 1×
“In the literature, the studies [36, 46] leverage multiple sensors to recover body pose, but performance highly depends on the similarity of testing and training data due to methodology limitation [41].”
BackgroundYao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/3131672.3131675 · Cited by 188 · cited 2×
“, resource optimization [10, 15, 19] and network compression [21, 25, 54].”
BackgroundI am a Smartwatch and I can Track my User's Arm
Shen, S., Wang, H., & Roy Choudhury, R. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906407 · Cited by 184 · cited 10×
“, a t-time activity requires around 10 × t times to recover even on a desktop PC [41], which is due to the inherent hardness problem, and limits the solution to an off-line analysis.”
InfluentialFEMO: A Platform for Free-weight Exercise Monitoring with RFIDs
Ding, H., Shangguan, L., Yang, Z., Han, J., Zhou, Z., Yang, P., Xi, W., & Zhao, J. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809708 · Cited by 183 · cited 2×
“Many recent designs propose to use wearables to facilitate fitness[6, 12] like Figure 17.”
BackgroundPD Disease State Assessment in Naturalistic Environments Using Deep Learning
Hammerla, N., Fisher, J., Andras, P., Rochester, L., Walker, R., & Ploetz, T. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9484 · Cited by 179 · cited 2×
“, elderly care [50], e-health [14], and human-computer interaction (HCI) [33], in the era of smart cities and Internet of things (IoT).”
BackgroundModeling Missing Data in Clinical Time Series with RNNs
Lipton, Z. C., Kale, D. C., & Wetzel, R. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04130 · Cited by 159
A-Wristocracy: Deep learning on wrist-worn sensing for recognition of user complex activities
Vepakomma, P., De, D., Das, S. K., & Bhansali, S. (2015) · 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2015.7299406 · Cited by 136 · cited 2×
“, elderly care [50], e-health [14], and human-computer interaction (HCI) [33], in the era of smart cities and Internet of things (IoT).”
BackgroundMathur, A., Lane, N. D., Bhattacharya, S., Boran, A., Forlivesi, C., & Kawsar, F. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081359 · Cited by 128 · cited 1×
“Parallel to the application designs, numerous network improvement designs are also available [29], e.”
MethodClosing the Gaps in Inertial Motion Tracking
Shen, S., Gowda, M., & Roy Choudhury, R. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241582 · Cited by 123 · cited 5×
“Figure 11(a) shows that MUSE can achieve a slightly lower tracking error than ArmTroi, where the median errors of MUSE and ArmTroi are 9.69 cm and 10.53 cm, respectively.”
BackgroundMethodInfluentialVaizman, Y., Weibel, N., & Lanckriet, G. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161192 · Cited by 122
Towards detection of bad habits by fusing smartphone and smartwatch sensors
Shoaib, M., Bosch, S., Scholten, H., Havinga, P. J. M., & Incel, O. D. (2015) · 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops) · doi:10.1109/percomw.2015.7134104 · Cited by 114 · cited 2×
“Training separate networks for each combination of missing inputs [11, 42] is nonscalable and also storage cost inefficient [49].”
BackgroundBody Posture Identification using Hidden Markov Model with a Wearable Sensor Network
Quwaider, M., & Biswas, S. (2008) · Proceedings of the 3rd International ICST Conference on Body Area Networks · doi:10.4108/icst.bodynets2008.2932 · Cited by 107 · cited 2×
“Before we present the design details, we note that the speedup for HMM has been studied in various related areas [31, 34], but to our knowledge, the unique challenges and opportunities in ArmTroi have not yet been explored (§7).”
MethodFitCoach: Virtual fitness coach empowered by wearable mobile devices
Guo, X., Liu, J., & Chen, Y. (2017) · IEEE INFOCOM 2017 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2017.8057208 · Cited by 98 · cited 1×
“Many recent designs propose to use wearables to facilitate fitness[6, 12] like Figure 17.”
BackgroundFang, B., Lane, N. D., Zhang, M., Boran, A., & Kawsar, F. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906411 · Cited by 93 · cited 1×
“Deep learning is widely applied in applications [6, 9, 14, 16, 24, 50, 52] without using handcrafted features [2, 22].”
BackgroundMulti-Sensor Fusion for Enhanced Contextual Awareness of Everyday Activities with Ubiquitous Devices
Guiry, J., Van de Ven, P., & Nelson, J. (2014) · Sensors · doi:10.3390/s140305687 · Cited by 91 · cited 1×
“Training separate networks for each combination of missing inputs [11, 42] is nonscalable and also storage cost inefficient [49].”
BackgroundLasagna: towards deep hierarchical understanding and searching over mobile sensing data
Liu, C., Zhang, L., Liu, Z., Liu, K., Li, X., & Liu, Y. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973752 · Cited by 63 · cited 3×
“Lasagna [24] recently observes that many human activities have layered semantic meanings.”
BackgroundSelf-citationHierarchical Part-Based Human Body Pose Estimation
Navaratnam, R., Thayananthan, A., Torr, P. H. S., & Cipolla, R. (2005) · British Machine Vision Conference (BMVC) · doi:10.5244/c.19.47 · Cited by 58 · cited 2×
“For example, image data can be projected from 3D to 2D for activity recognition to accelerate HMM search [31], and words’ correlation can be used for speech recognition [5].”
MethodGeorgiev, P., Lane, N. D., Rachuri, K. K., & Mascolo, C. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973777 · Cited by 58 · cited 1×
“, resource optimization [10, 15, 19] and network compression [21, 25, 54].”
BackgroundUpper limb joint angle tracking with inertial sensors
El-Gohary, M., Holmstrom, L., Huisinga, J., King, E., McNames, J., & Horak, F. (2011) · 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2011.6091362 · Cited by 56
Deshmukh, N., Ganapathiraju, A., & Picone, J. (1999) · IEEE Signal Processing Magazine · doi:10.1109/79.790985 · Cited by 50 · cited 1×
“For example, image data can be projected from 3D to 2D for activity recognition to accelerate HMM search [31], and words’ correlation can be used for speech recognition [5].”
MethodMotion reconstruction using very few accelerometers and ground contacts
Riaz, Q., Tao, G., Krüger, B., & Weber⋆, A. (2015) · Graphical Models · doi:10.1016/j.gmod.2015.04.001 · Cited by 44 · cited 1×
“In the literature, the studies [36, 46] leverage multiple sensors to recover body pose, but performance highly depends on the similarity of testing and training data due to methodology limitation [41].”
BackgroundVu, T. H., Misra, A., Roy, Q., Choo, K. T. W., & Lee, Y. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3191771 · Cited by 41
Novel neural network based fusion for multistream ASR
Mallidi, S. H., & Heřmanský, H. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472765 · Cited by 29 · cited 1×
“Some existing work has studied the missing input data issue using domain knowledge, such as the joint utilization of video and audio for speech classification [32], input selection for speech recognition with the neural network trained with the input stream dropout [28], and clinical diagnosis [23].”
BackgroundInvestigation of upper limb movement during badminton smash
Shan, C. Z., Su, E. L. M., Rahman, H. B. A., & Fai, Y. C. (2015) · Asian Control Conference (ASCC) · doi:10.1109/ascc.2015.7244605 · Cited by 24 · cited 1×
“In certain more sophisticated scenarios, such as sport training or fitness [39], full arm skeleton tracking is also required, such as in basketball shooting, weight training, and golf swing analysis.”
BackgroundXiong, S., Zhu, S., Ji, Y., Jiang, B., Tian, X., Zheng, X., & Wang, X. (2017) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081343 · Cited by 17 · cited 1×
“Deep learning is widely applied in applications [6, 9, 14, 16, 24, 50, 52] without using handcrafted features [2, 22].”
BackgroundA Framework for 3D Spatial Gesture Design and Modeling Using a Wearable Input Device
Kwon, D. Y., & Groß, M. H. (2007) · Proceedings · doi:10.1109/iswc.2007.4373771 · Cited by 14 · cited 2×
“With regard to techniques, HMM has long been applied to infer user’s pose [20].”
Method
Research works printed but not linked: 9
- Bahdanau Dzmitry, 2015, Proc. of ICLR .
- Du Yong, 2015, Proc. of IEEE CVPR .
- Hammerla Nils Yannick, 2015, Proc. of AAAI .
- Ngiam Jiquan, 2011, Proc. of ICML .
- 10.5555/1460257.1460283 · doi:10.5555/1460257.1460283
- Nancy Berryman Reese and William D Bandy. 2016. Joint Range of Motion and Muscle Length Testing-E-Book .Elsevier Health Sciences. Nancy Berryman Reese and William D Bandy. 2016. Joint Range of Motion and Muscle Length Testing-E-Book .Elsevier Health Sciences.
- Shan Chew Zhen, 2015, Proc. of IEEE ASCC .
- Sutskever Ilya, 2014, Proc. of NIPS .
- Xu Kelvin, 2015, Proc. of ICML .
Cited by
Xu, H., Zhou, P., Tan, R., Li, M., & Shen, G. (2021) · Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3485730.3485937 · Cited by 150
“, accelerometer, gyroscope, and magnetometer), which are widely used in various applications including estimating the attitudes ofmobile devices [34, 59], tracking users’ arm [24, 35], and implementing secure text pin [3].”
BackgroundAdversarial Attacks and Defenses on Cyber–Physical Systems: A Survey
Li, J., Liu, Y., Chen, T., Xiao, Z., Li, Z., & Wang, J. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2975654 · Cited by 95
“4) Other Sensors: In addition to the three types of sensors stated above, some other sensors have also been utilized in the CPS and IoT systems, e.g., the inertial measurement unit (IMU) sensors for smart health [41] and the activity recognition [31], [49] applications.”
MethodSelf-citationYin, Y., Xie, L., Jiang, Z., Xiao, F., Cao, J., & Lu, S. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3357591 · Cited by 108
“…walking upstairs and downstairs, jogging, watching TV, eating, washing dishes, shaking hands, making a call etc; a series of activities in a specific scenario (e.g., activities in drinking [106] or toothbrushing [52]); and the vital sign changes [89] like breathing, heartbeat-ing and coughs.”
InfluentialArtificial Intelligence of Things: A Survey
Siam, M. S. I., Ahn, H., Liu, L., Alam, S., Shen, H., Cao, Z., Shroff, N. B., Krishnamachari, B., Srivastava, M. B., & Zhang, M. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3690639 · Cited by 123
On-Device Deep Learning for Mobile and Wearable Sensing Applications: A Review
İncel, Ö. D., & Bursa, S. Ö. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3240854 · Cited by 110
Metadata
- Authors
- Liu, Y., Li, Z., Liu, Z., & Wu, K.
- Affiliations
- City University of Hong Kong (HK)
- Shenzhen University (CN)
- Venue
- Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services
- Publisher
- ACM
- Published
- 2019-06-12
- Pages
- 287-299
- OpenAlex
- W2953033606
- Cited by
- 71
- References
- 60
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 12 · 2023: 15 · 2022: 12 · 2021: 11 · 2020: 7 · 2019: 2
- FWCI
- 6.48
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Mobile Systems, Applications, and Services (publishedVersion)
- Funders
- ECS grant (CityU 21203516)
- NSFC Grant (No.61802261 and No.61872248)
- Guangdong NSF (2017A030312008)
- Fok Ying-Tong Education Foundation for Young Teachers in the Higher Education Institutions of China (No.161064)
- NSF Grant of Shenzhen University (No.2018061)
- GRF grant (CityU 11217817)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- wearable sensors, missing sensor data, wrist-worn devices, real-time tracking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.