Deep Learning for Sensor-based Human Activity Recognition
The DOI matches its Crossref record; 151 of the 151 references it cites were found in a registry or an index.
Abstract
The vast proliferation of sensor devices and Internet of Things enables the applications of sensor-based activity recognition. However, there exist substantial challenges that could influence the performance of the recognition system in practical scenarios. Recently, as deep learning has demonstrated its effectiveness in many areas, plenty of deep methods have been investigated to address the challenges in activity recognition. In this study, we present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets that can be used for evaluation in different challenge tasks. We then propose a new taxonomy to structure the deep methods by challenges. Challenges and challenge-related deep methods are summarized and analyzed to form an overview of the current research progress. At the end of this work, we discuss the open issues and provide some insights for future directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This renders activity labeling difficult, reducing the number of available labels [8,23,30].”
From Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition (2023) · cites this paper as [8]
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“Before taking a closer look at the factors that cause distribution discrepancy in sensory data, we briefly introduce transfer learning [102].”
BackgroundGreff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955 · cited 19×
“A multi-label RNN was created with each RNN cell responding to activity recognition of one occupant.”
BackgroundMethodInfluentialProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“eep hybrid model to explore different views of temporal dynamics is another attractive trend in the human activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted…”
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662 · cited 1×
“data facilitates recognition and which part deteriorates that. 1.2 Deep Learning in Human Activity Recognition. Numerous previous works adopted machine learning methods in human activity recognition [79]. They highly rely on feature extraction techniques including time-frequency transformation [62], statistical approa…”
MethodInfluentialWhy Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,631
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 1×
“ontributions. Hundreds of deep learning methods have been explored for human activity recognition in recent years. Very few works aim at giving a comprehensive review of current progress. Wang et al. [154] surveyed a number of deep learning methods for sensor-based human activity recognition. Nweke et al. [104] presen…”
BackgroundA symbolic representation of time series, with implications for streaming algorithms
Lin, J., Keogh, E., Lonardi, S., & Chiu, B. (2003) · Proceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery · doi:10.1145/882082.882086 · Cited by 1,799 · cited 1×
“ing methods in human activity recognition [79]. They highly rely on feature extraction techniques including time-frequency transformation [62], statistical approaches [21] and symbolic representation [88]. However, the features extracted are carefully engineered and heuristic. There were no universal or systematical f…”
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727 · cited 1×
“Also, deep generative models are more robust against overfitting problems as compared to discriminative models [93].”
BackgroundA tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Disentangled Representation Learning GAN for Pose-Invariant Face Recognition
Tran, L., Yin, X., & Liu, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.141 · Cited by 1,005 · cited 1×
“is to learn features that are scalable to diverse activities. While [102] enlightens us that mid-level attributes can be used to depict activities with a set of characteristics, disentangled features [145] may be another serviceable solution to representing novel activities. •Future activity prediction. Future activit…”
BackgroundNweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930 · cited 1×
“years. Very few works aim at giving a comprehensive review of current progress. Wang et al. [154] surveyed a number of deep learning methods for sensor-based human activity recognition. Nweke et al. [104] presented a survey on mobile and wearable sensor-based activity recognition and categorized the deep learning meth…”
BackgroundConvolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · cited 1×
“el" in CNNs, so we use the term "axis" instead in this paper. A commonly used AF strategy is to design a specific neural network for each univariate time series of each sensing channel [176, 191]. The information representations from all channels are concatenated at last for input into a final classific…”
MethodVisualizing and Understanding Recurrent Networks
Karpathy, A., Johnson, J., & Fei-Fei, L. (2015) · arXiv · doi:10.48550/arxiv.1506.02078 · Cited by 845
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Chen, C., Jafari, R., & Kehtarnavaz, N. (2015) · 2015 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2015.7350781 · Cited by 765
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742
Transition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom
Bachlin, M., Plotnik, M., Roggen, D., Maidan, I., Hausdorff, J. M., Giladi, N., & Troster, G. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036165 · Cited by 693 · cited 1×
“For recognizing human activities, accelerometers can be mounted on various parts of a body, such as the waist [7], arm [173], ankle [10], wrist [61], et al.”
BackgroundHuman Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676 · cited 2×
“correlations of neighboring arranged modalities and thus misses the relations between the nonadjacent modalities. To solve this issue, unlike naturally organizing various data sources, Jiang and Yin [67] assembled signal sequences of different modalities into a novel arrangement where every signal sequence has the cha…”
BackgroundMethodDeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667 · cited 2×
“rated superior performance to individual networks on three benchmark datasets. Aside from the variants of the RNN structure, some researchers also studied different RNN cells. For example, Yao et al. [169] leveraged the Gated Recurrent Units (GRUs) instead of LSTM cells to construct an RNN and applied it to activity r…”
BackgroundIncremental learning from noisy data
Schlimmer, J. C., & Granger, R. H. (1986) · Machine Learning · doi:10.1007/bf00116895 · Cited by 653 · cited 1×
“Figure 6(a) shows the first problem of distribution discrepancy with time in activity recognition called concept drift [127].”
BackgroundDeep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
mHealthDroid: A Novel Framework for Agile Development of Mobile Health Applications
Banos, O., Garcia, R., Holgado-Terriza, J. A., Damas, M., Pomares, H., Rojas, I., Saez, A., & Villalonga, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13105-4_14 · Cited by 583
Towards Environment Independent Device Free Human Activity Recognition
Jiang, W., Miao, C., Ma, F., Yao, S., Wang, Y., Yuan, Y., Xue, H., Song, C., Ma, X., Koutsonikolas, D., et al. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241548 · Cited by 573 · cited 2×
“uilding classification models for device-free activity recognition, very few works focus on how to get equally accurate recognition performance when sensors are configured in the wild. One example is [66], where an adversarial network is incorporated with deep feature extraction models to remove the environment-specif…”
BackgroundZero-Effort Cross-Domain Gesture Recognition with Wi-Fi
Zheng, Y., Zhang, Y., Qian, K., Zhang, G., Liu, Y., Wu, C., & Yang, Z. (2019) · Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3307334.3326081 · Cited by 557 · cited 2×
“omain to update their models. In real activity recognition systems, a one-fits-all model that only requires one-time training and is general enough to fit all scenarios is indispensable. Zheng et al. [192] defined a new Body-coordinate Velocity Profile (BVP) to capture domain-independent features. The features represe…”
BackgroundSelf-citationFusion of Smartphone Motion Sensors for Physical Activity Recognition
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2014) · Sensors · doi:10.3390/s140610146 · Cited by 552
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511 · cited 2×
“st a certain percentage of data in the training set. Another direction of solving the imbalance concern is to modify the model-building strategy instead of directly balancing the training dataset. In [49], Guan and Plötz utilized the F1-score rather than the conventional cross-entropy as the loss function to address t…”
BackgroundMethodDiscovery of activity patterns using topic models
Huynh, T., Fritz, M., & Schiele, B. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409638 · Cited by 442
A deep learning approach to on-node sensor data analytics for mobile or wearable devices
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2633287 · Cited by 439 · cited 2×
“atures and a neural network is a potential plan to achieve real-time activity recognition on a mobile device. In addition to the cascade structure of hand-crafted features and deep learning features, [118] proposed to arranged the deep learning features and hand-crafted features in parallel before fed into a fully-con…”
BackgroundMethodA Semisupervised Recurrent Convolutional Attention Model for Human Activity Recognition
Chen, K., Yao, L., Zhang, D., Wang, X., Chang, X., & Nie, F. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2927224 · Cited by 368 · cited 1×
“[28] applied co-training with multiple classifiers on different modalities of the data.”
BackgroundSelf-citationMaking Sense of Spatio-Temporal Preserving Representations for EEG-Based Human Intention Recognition
Zhang, D., Yao, L., Chen, K., Wang, S., Chang, X., & Liu, Y. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2905157 · Cited by 365 · cited 1×
“RNN is a widely applied deep temporal feature extraction approach in many fields [92, 169].”
BackgroundSelf-citationA survey on heterogeneous transfer learning
Day, O., & Khoshgoftaar, T. M. (2017) · Journal of Big Data · doi:10.1186/s40537-017-0089-0 · Cited by 360 · cited 1×
“We can also categorize the discrepancy into homogeneous discrepancy and heterogeneous discrepancy by character [36].”
BackgroundBarshan, B., & Yuksek, M. C. (2014) · The Computer Journal · doi:10.1093/comjnl/bxt075 · Cited by 346
Analyzing features for activity recognition
Huynh, T., & Schiele, B. (2005) · Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies · doi:10.1145/1107548.1107591 · Cited by 339 · cited 1×
“ity Recognition. Numerous previous works adopted machine learning methods in human activity recognition [79]. They highly rely on feature extraction techniques including time-frequency transformation [62], statistical approaches [21] and symbolic representation [88]. However, the features extracted are carefully engin…”
MethodFeature Learning for Activity Recognition in Ubiquitous Computing
Plötz, T., Hammerla, N., & Olivier, P. (2011) · Newcastle University · doi:10.25405/ncl.34175319 · Cited by 337
InnoHAR: A Deep Neural Network for Complex Human Activity Recognition
Xu, C., Chai, D., He, J., Zhang, X., & Duan, S. (2019) · IEEE Access · doi:10.1109/access.2018.2890675 · Cited by 333 · cited 1×
“activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted the advanced Inception CNN structure for different scales of local temporal feature extraction and took t…”
MethodActivity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection
Zappi, P., Lombriser, C., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., & Tröster, G. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77690-1_2 · Cited by 329 · cited 1×
“s (д). The sampling frequency is usually in the range of tens to hundreds of Hz. For recognizing human activities, accelerometers can be mounted on various parts of a body, such as the waist [7], arm [173], ankle [10], wrist [61], et al. There are three axes in an often-used accelerometer. Therefore, a tri-variate tim…”
BackgroundHa, S., & Choi, S. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727224 · Cited by 307 · cited 2×
“nt sensing modalities (e.g., different sensors, axes, or channels) is also a critical concern since commonly used CNN treats different modalities in the same way. To resolve this concern, Ha and Choi [54] presented a new CNN structure that had specific 1D CNNs for different modalities for learning modality-specific te…”
BackgroundMethodSurvival of patients with severe congestive heart failure treated with oral milrinone
Baim, D. S., Colucci, W. S., Monrad, E. S., Smith, H. S., Wright, R. F., Lanoue, A., Gauthier, D. F., Ransil, B. J., Grossman, W., & Braunwald, E. (1986) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(86)80478-8 · Cited by 303
The MobiAct Dataset: Recognition of Activities of Daily Living using Smartphones
Vavoulas, G., Chatzaki, C., Malliotakis, T., Pediaditis, M., & Tsiknakis, M. (2016) · Proceedings of the International Conference on Information and Communication Technologies for Ageing Well and e-Health · doi:10.5220/0005792401430151 · Cited by 301
Mobile sensor data anonymization
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2019) · Proceedings of the International Conference on Internet of Things Design and Implementation · doi:10.1145/3302505.3310068 · Cited by 298 · cited 1×
“raining process. For example, Iwasawa et al. [65] proposed to integrate an adversarial loss with the standard activity classification loss to minimize the user identification accuracy. The authors of [92] and [91] also adopted the similar idea to prevent privacy leakage. Their experiment results show an effective redu…”
BackgroundA Survey of Deep Learning-Based Human Activity Recognition in Radar
Li, X., He, Y., & Jing, X. (2019) · Remote Sensing · doi:10.3390/rs11091068 · Cited by 290 · cited 2×
“whose transmitters and receivers need to be placed on the opposite sides, radar transmitters and antennas are mounted on the same side of users. Doppler effect is the basis of the radar-based system [84, 134]. Current research mostly adopts spectrograms for representing the Doppler effect and utilizes deep learning me…”
BackgroundMethodInfluentialCan Deep Learning Revolutionize Mobile Sensing?
Lane, N. D., & Georgiev, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699349 · Cited by 282 · cited 1×
“picuous prosperity in modeling high-level abstractions from intricate data [112] in many areas such as computer vision, natural language processing, and speech processing. After early works including [55, 77, 164] examined the effectiveness of deep learning in human activity recognition, related studies sprung up in t…”
BackgroundMultimodal Deep Learning for Activity and Context Recognition
Radu, V., Tong, C., Bhattacharya, S., Lane, N. D., Mascolo, C., Marina, M. K., & Kawsar, F. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161174 · Cited by 281 · cited 1×
“cture not only extracts modality-specific information from various sensors but also allows flexible complexity distribution since the structures of the modality-specific branches can be different. In [115, 116], Radu et al. proposed a fully-connected deep neural network (DNN) architecture to facilitate the intra-modal…”
BackgroundRavi, D., Wong, C., Lo, B., & Yang, G.-Z. (2016) · 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2016.7516235 · Cited by 269 · cited 1×
“Considering deep neural networks are more effective in feature extraction than shallow ones, a combination of human-crafted and deep features is a potential solution to lowering computation cost. In [119], the authors incorporated the spectrogram features with only one CNN layer and two fully-connected layers for huma…”
BackgroundAttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition
Ma, H., Li, W., Zhang, X., Gao, S., & Lu, S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/431 · Cited by 266 · cited 2×
“Xue et al. 2018 [163]; Brophy et al. 2018 [19]; Attetion Mechanism Soft Attention Tang et al. 2016 [142]; Murahari and Plötz 2018 [101]; Zeng et al. 2018 [175]; Shen et al. 2018 [135]; Ma et al. 2019 [90]; Hard Attention Zhang et al. 2018 [187]; Chen et al. 2019 [28]; Chen et al. 2018 [25]; Chen et al. 2019 [27]; 4 FU…”
BackgroundMethodRecognizing independent and joint activities among multiple residents in smart environments
Singla, G., Cook, D. J., & Schmitter-Edgecombe, M. (2010) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-009-0007-1 · Cited by 265
AccelPrint: Imperfections of Accelerometers Make Smartphones Trackable
Dey, S., Roy, N., Xu, W., Choudhury, R. R., & Nelakuditi, S. (2014) · Proceedings 2014 Network and Distributed System Security Symposium · doi:10.14722/ndss.2014.23059 · Cited by 263 · cited 1×
“In fact, owing to the imperfections in the production process, sensor chips show variation in the same conditions [37].”
BackgroundSmartFall: A Smartwatch-Based Fall Detection System Using Deep Learning
Mauldin, T. R., Canby, M. E., Metsis, V., Ngu, A. H. H., & Rivera, C. C. (2018) · Sensors · doi:10.3390/s18103363 · Cited by 253
ARAS Human Activity Datasets in Multiple Homes with Multiple Residents
Alemdar, H. O., İncel, Ö. D., Ertan, H., & Ersoy, C. (2013) · Proceedings of the ICTs for improving Patients Rehabilitation Research Techniques · doi:10.4108/icst.pervasivehealth.2013.252120 · Cited by 245
CNN-based sensor fusion techniques for multimodal human activity recognition
Münzner, S., Schmidt, P., Reiss, A., Hanselmann, M., Stiefelhagen, R., & Dürichen, R. (2017) · Proceedings of the 2017 ACM International Symposium on Wearable Computers · doi:10.1145/3123021.3123046 · Cited by 235 · cited 2×
“odel. Axis-based Fusion (AF). This manner treats signal sources in more detail by handling each sensor axis separately. In such a way, the interference between different sensor axes is gotten rid of. [100] referred this manner to Channel-based late fusion (CB-LF). Nevertheless, the sensor channel may be confused with…”
BackgroundMethodA Convolutional Recurrent Attention Model for Subject-Independent EEG Signal Analysis
Zhang, D., Yao, L., Chen, K., & Monaghan, J. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2906824 · Cited by 211 · cited 1×
“ompute the weights so the whole model is a fully differentiable deterministic mechanism where gradients can be propagated to other parts of the network as well as through the soft attention mechanism [180]. Attention layers is inserted into sequence-to-sequence LSTMs for feature extraction [142]. It is also inserted i…”
BackgroundSelf-citationProceedings of the European Symposium on Artificial Neural Networks
Tang, T. B., & Murray, A. T. (2006) · Cited by 206
Motor Imagery Classification via Temporal Attention Cues of Graph Embedded EEG Signals
Zhang, D., Chen, K., Jian, D., & Yao, L. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2967128 · Cited by 199
Self-citationExploring semi-supervised and active learning for activity recognition
Stikic, M., Van Laerhoven, K., & Schiele, B. (2008) · 2008 12th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2008.4911590 · Cited by 197 · cited 1×
“py means higher uncertainty and better informativeness. Diversity means that the queried samples should be comprehensive, and the information provided by them are non-repetitive and non-redundant. In [140], the authors applied two query strategies. One of them is to select samples with lowest prediction confidence, an…”
MethodLSTM Networks for Mobile Human Activity Recognition
Chen, Y., Zhong, K., Zhang, J., Sun, Q., & Zhao, X. (2016) · Proceedings of the 2016 International Conference on Artificial Intelligence: Technologies and Applications · doi:10.2991/icaita-16.2016.13 · Cited by 197 · cited 1×
“g sequential data [70]. As the sensor signals are continuous streaming data, a sliding window is generally used to segment the raw data to individual pieces, each of which is the input of an RNN cell [30]. A typical LSTM-based structure for temporal feature extraction is illustrated in Figure 1 (b). The length and mov…”
MethodZeng, M., Gao, H., Yu, T., Mengshoel, O. J., Langseth, H., Lane, I., & Liu, X. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267286 · Cited by 185
Deep Transfer Learning for Cross-domain Activity Recognition
Wang, J., Zheng, V. W., Chen, Y., & Huang, M. (2018) · International Conference on Crowd Science and Engineering (ICCSE) · doi:10.1145/3265689.3265705 · Cited by 183 · cited 2×
“only discriminative for classification but also able to reserve the inherent structures of the sensory data. The stochastic feature extraction model is based on a generative autoencoder. Wang et al. [155] further posed a question about how to select the best source positions for transfer when there are multiple source…”
BackgroundMulti-modal Convolutional Neural Networks for Activity Recognition
Ha, S., Yun, J.-M., & Choi, S. (2015) · 2015 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.525 · Cited by 180 · cited 2×
“2018. Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities 111:11 intermediate layer was used to feed the final softmax classifier. In contrast, Ha et al. [55] proposed to vertically stack all signal sequences to form a 2D matrix and directly applied 2D-CNNs to simultaneous…”
BackgroundMethodDeep Convolutional Neural Networks for Human Activity Recognition with Smartphone Sensors
Ronao, C. A., & Cho, S.-B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-26561-2_6 · Cited by 176 · cited 1×
“sor signals so that local temporal dependencies can be captured. Some works employed one-dimensional (1D) convolutions on the individual univariate time series signals for temporal feature extraction [37, 46, 125, 126, 164]. When there were multiple sensors or multiple axes, multivariate time series would be yielded,…”
MethodProtecting sensory data against sensitive inferences
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2018) · Spiral (Imperial College London) · Cited by 166
Open-set human activity recognition based on micro-Doppler signatures
Yang, Y., Hou, C., Lang, Y., Guan, D., Huang, D., & Xu, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.030 · Cited by 164 · cited 3×
“et al. 2018 [72]; Zheng et al. 2019 [192]; Gjoreski et al. 2019 [43] Time Concept Drift Tao et al. 2016 [143]; Gudur et al.2019 [50] Concept Evolution Nair et al. 2019 [102] Open-Set Yang et al. 2019 [165] Sensor Instance Mathur et al. 2018 [93] Type and Position Morales et al. 2016 [99]; Khan et al. Layout and Enviri…”
BackgroundMethodInfluentialConvolutional Relational Machine for Group Activity Recognition
Azar, S. M., Atigh, M. G., Nickabadi, A., & Alahi, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00808 · Cited by 158 · cited 1×
“018. arXiv:2001.07416v1 [cs.HC] 21 Jan 2020 111:2 K. Chen et al. video-based systems and sensor-based systems. Video-based systems use cameras to take images or videos to recognize people’s behaviors [8]. Sensor-based systems utilize on-body or ambient sensors to dead reckon people’s motion details or log their activi…”
BackgroundA Hybrid Deep Learning Model for Human Activity Recognition Using Multimodal Body Sensing Data
Gumaei, A., Hassan, M. M., Alelaiwi, A., & Alsalman, H. (2019) · IEEE Access · doi:10.1109/access.2019.2927134 · Cited by 157 · cited 1×
“ed an Autoencoder to first enhance feature extractions and then applied the cascade CNN-LSTM to extract local and global features for WiFi-based activity recognition. On the other hand, Gumaei et al. [51] proposed a hybrid model of different types of recurrent units (SRUs and GRUs) for handling different aspects of te…”
MethodSoleimani, E., & Nazerfard, E. (2019) · Neurocomputing · doi:10.48550/arxiv.1903.12489 · Cited by 157
Protecting Sensory Data against Sensitive Inferences
Malekzadeh, M., Clegg, R. G., Cavallaro, A., & Haddadi, H. (2018) · Proceedings of the 1st Workshop on Privacy by Design in Distributed Systems · doi:10.1145/3195258.3195260 · Cited by 154 · cited 1×
“rocess. For example, Iwasawa et al. [65] proposed to integrate an adversarial loss with the standard activity classification loss to minimize the user identification accuracy. The authors of [92] and [91] also adopted the similar idea to prevent privacy leakage. Their experiment results show an effective reduction of…”
BackgroundTowards multimodal deep learning for activity recognition on mobile devices
Radu, V., Lane, N. D., Bhattacharya, S., Mascolo, C., Marina, M. K., & Kawsar, F. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct · doi:10.1145/2968219.2971461 · Cited by 147 · cited 1×
“cture not only extracts modality-specific information from various sensors but also allows flexible complexity distribution since the structures of the modality-specific branches can be different. In [115, 116], Radu et al. proposed a fully-connected deep neural network (DNN) architecture to facilitate the intra-modal…”
BackgroundSensing Fine-Grained Hand Activity with Smartwatches
Laput, G., & Harrison, C. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300568 · Cited by 147 · cited 2×
“signals and constructed a time-frequency-spectral image. Then, CNN is utilized to handle the image for recognizing simple daily activities like walking and standing. More recently, Laput and Harrison [78] developed a fine-grained hand activity sensing system through the combination of the time-frequency-spectral featu…”
MethodInfluentialMultioccupant Activity Recognition in Pervasive Smart Home Environments
Benmansour, A., Bouchachia, A., & Feham, M. (2015) · ACM Computing Surveys · doi:10.1145/2835372 · Cited by 138 · cited 1×
“one occupant is eating while the other one is watching TV and collaborative activity where multiple occupants collaborate together to perform the same activity such as two subjects play table tennis [16]. For the parallel activity recognition, when only wearable-sensors are used, it can be divided into multiple single…”
BackgroundAction Classification in Soccer Videos with Long Short-Term Memory Recurrent Neural Networks
Baccouche, M., Mamalet, F., Wolf, C., García, C., & Baskurt, A. M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15822-3_20 · Cited by 137 · cited 1×
“iction. In some common behavior tasks, the activities are usually in a certain order. Therefore, modeling the temporal dependencies across activities is beneficial to predict future predictions.LSTMs [9] are suitable for such tasks. But for long-span activities, LSTMs cannot contain such long dependencies. In this cas…”
BackgroundA-Wristocracy: Deep learning on wrist-worn sensing for recognition of user complex activities
Vepakomma, P., De, D., Das, S. K., & Bhansali, S. (2015) · 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2015.7299406 · Cited by 136 · cited 2×
“mean/variance [142] -simple -coarse -unsatisfactory performance”
BackgroundBinarized-BLSTM-RNN based Human Activity Recognition
Edel, M., & Köppe, E. (2016) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin.2016.7743581 · Cited by 134 · cited 1×
“e to that of the full-precision counterpart and ∼9×acceleration on J. ACM, Vol. 37, No. 4, Article 111. Publication date: August 2018. 111:26 K. Chen et al. CPUs and ∼11×memory saving. Edel and Köppe [38] also studied the quantization of network for constructing a lightweight and fast deep learning model. Their Binari…”
BackgroundPeng (2018) · doi:10.1145/3214277 · Cited by 134 · cited 1×
“st 2018. Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities 111:23 techniques to this area is still underexplored. One of the few deep learning works is [107] where the authors developed a multi-task learning approach to recognize both simple and composite activities simu…”
BackgroundHuman Activity Recognition Based on Wearable Sensor Data: A Standardization of the State-of-the-ArtPreprint
Jordão, A., Nazare, A. C., Sena, J., & Schwartz, W. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05226 · Cited by 133
Locomotion Activity Recognition Using Stacked Denoising Autoencoders
Gu, F., Khoshelham, K., Valaee, S., Shang, J., & Zhang, R. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2823084 · Cited by 132 · cited 3×
“lötz et al. proposed to use autoencoders for unsupervised feature learning as an alternative to Principal Component Analysis (PCA) for activity recognition in ubiquitous computing. And the authors in [33, 47, 177] employed the variants of autoencoders such as stacked autoencoders [33], stacked denoising autoencoders […”
BackgroundMethodYao, R., Lin, G., Shi, Q., & Ranasinghe, D. C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.024 · Cited by 126 · cited 1×
“f the classifier is less than a threshold. Different from the hierarchical framework, some researchers explored to directly assign a label for each time-step instead of predicting a window as a whole [168, 190]. Inspired by semantic segmentation in the computer vision community, the authors employed fully connected ne…”
MethodDeep Activity Recognition Models with Triaxial Accelerometers
Alsheikh, M. A., Selim, A., Niyato, D., Doyle, L., Lin, S., & Tan, H.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.04664 · Cited by 126
Proceedings of International Conference on Communications (ICC 2009)
Ghimire, B., Auer, G., & Haas, H. (2009) · Cited by 116
Activity Recognition with Evolving Data Streams: A Review
Abdallah, Z. S., Gaber, M. M., Srinivasan, B., & Krishnaswamy, S. P. (2018) · ACM Computing Surveys · doi:10.1145/3158645 · Cited by 108 · cited 1×
“tion called concept drift [132]. It denotes the distribution shift between the training domain and the test domain (or the source domain and the target domain). Concept drift can be abrupt or gradual [1]. To accommodate the drift, deep learning models should incorporate incremental training to continuously learn new c…”
BackgroundIs ontology-based activity recognition really effective?
Riboni, D., Pareschi, L., Radaelli, L., & Bettini, C. (2011) · 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops) · doi:10.1109/percomw.2011.5766927 · Cited by 104 · cited 1×
“earning to infer true labels is to seek other knowledge, which leads us to a popular method, deep unsupervised transfer learning [15]. Another way is to resort to data-driven methods such as ontology [122]. •Identifyingnewactivities.Identifying novel activities that have never been seen by the models is a big challeng…”
BackgroundPrivacy-Preserving Collaborative Deep Learning with Application to Human Activity Recognition
Lyu, L., He, X., Law, Y. W., & Palaniswami, M. S. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132990 · Cited by 97 · cited 1×
“ue. For example, Lyu et al. proposed to tailor two kinds of data perturbation mechanisms: Random Projection and repeated Gompertz to achieve a better tradeoff between privacy and recognition accuracy [89]. Recently, differential privacy has gained increasing research attention due to its strong theoretical privacy gua…”
BackgroundCross-position activity recognition with stratified transfer learning
Chen, Y., Wang, J., Huang, M., & Yu, H. (2019) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2019.04.004 · Cited by 96 · cited 1×
“[31] assumed that data samples of the same activities are aggregated in the distribution space even when they are from different sensors.”
BackgroundDeep Neural Network based Human Activity Recognition for the Order Picking Process
Grzeszick, R., Lenk, J. M., Rueda, F. M., Fink, G. A., Feldhorst, S., & ten Hompel, M. (2017) · Proceedings of the 4th International Workshop on Sensor-based Activity Recognition and Interaction · doi:10.1145/3134230.3134231 · Cited by 93 · cited 3×
“with featured characteristics. In contrast, augmenting new samples to the class with a minority number of samples could not only keep all originalsamplesbutalsoenhancemodels’robustness.Grzeszicketal.[46]utilizedtwoaugmentation methods, Gaussian noises perturbation and interpolation, to tackle the problem of class imba…”
BackgroundMethodInfluentialWang, J., Chen, Y., Gu, Y., Xiao, Y., & Pan, H. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489106 · Cited by 92 · cited 2×
“; Zeng et al. 2017 [177]; Bai et al. 2019 [11] Semi-Supervised Co-training Chen et al. 2019 [28] Active Learning Hossain et al. 2018 [59]; Hossain and Roy 2019 [60] Synthesizing Data Wang et al. 2018 [153]; Zhang et al. 2019 [188] tend to predict the class with the majority number of training samples while ignoring th…”
BackgroundSemi-supervised convolutional neural networks for human activity recognition
Zeng, M., Yu, T., Wang, X., Nguyen, L. T., Mengshoel, O. J., & Lane, I. (2017) · 2017 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2017.8257967 · Cited by 85 · cited 2×
“lötz et al. proposed to use autoencoders for unsupervised feature learning as an alternative to Principal Component Analysis (PCA) for activity recognition in ubiquitous computing. And the authors in [33, 47, 177] employed the variants of autoencoders such as stacked autoencoders [33], stacked denoising autoencoders […”
BackgroundMethodSlice&Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers
Pham, C., & Olivier, P. L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-05408-2_4 · Cited by 84
Guo, H., Chen, L., Peng, L., & Chen, G. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971708 · Cited by 83 · cited 2×
“y blending the recognition results from each modality as well. A range of ensemble approaches have been developed for fusing recognition results to yield an overall inference. For example, Guo et al. [52] proposed to use MLPs to create a base classifier for each sensing modality and incorporate all classifiers by assi…”
BackgroundMethodMulticolumn bidirectional long short-term memory for mobile devices-based human activity recognition
Tao, D., Wen, Y., & Hong, R. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2561962 · Cited by 83 · cited 2×
“al. 2017 [94]; Saeedi et al. 2017 [130]; Morales et al. 2016 [99]; Jiang et al. 2018 [66]; Khan et al. 2018 [72]; Zheng et al. 2019 [192]; Gjoreski et al. 2019 [43] Time Concept Drift Tao et al. 2016 [143]; Gudur et al.2019 [50] Concept Evolution Nair et al. 2019 [102] Open-Set Yang et al. 2019 [165] Sensor Instance M…”
BackgroundPush the Limit of Acoustic Gesture Recognition
Wang, Y., Shen, J., & Zheng, Y. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155402 · Cited by 80 · cited 2×
“[147] developed a classifier with a CNN and an LSTM to automatically extract complicated features from the acoustic data and perform gesture recognition.”
BackgroundMethod3D gesture classification with convolutional neural networks
Duffner, S., Berlemont, S., Lefebvre, G., & García, C. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854641 · Cited by 79 · cited 2×
“eters. The most popular approach of SFF is to organize the raw sensing sequences into a 2D matrix by stacking along the modality dimension, and then to apply a 2D-CNN to the 2D matrix with 1D filters [37, 164, 174]. As a result, the architecture is equivalent to applying identical 1D-CNNs to different univariate time…”
MethodA Graph-Based Hierarchical Attention Model for Movement Intention Detection from EEG Signals
Zhang, D., Yao, L., Chen, K., Wang, S., Haghighi, P. D., & Sullivan, C. M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2943362 · Cited by 76 · cited 1×
“s are assumed to be more tightly related to the recognition task and show greater influence over the models’ decisions [133]. Some works employed attention mechanism to interpret deep model behaviors [178, 181, 183]. Back to human activity recognition, attention mechanism not only highlights the most distinguishable m…”
BackgroundSelf-citationAkbari, A., & Jafari, R. (2019) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/3302506.3310391 · Cited by 73 · cited 2×
“nstance, KL divergence is minimized between the parameters of CNNs which are trained by the old data and the new data, respectively in [72]. In order to address the issue mentioned, Akbari and Jafari [2] designed stochastic features that are not only discriminative for classification but also able to reserve the inher…”
BackgroundA Novel Distribution-Embedded Neural Network for Sensor-Based Activity Recognition
Qian, H., Pan, S. J., Da, B., & Miao, C. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/779 · Cited by 73 · cited 1×
“[114] managed to develop a Distribution-Embedded Deep Neural Network (DDNN) to integrate the statistical feature extraction process into an end-to-end for activity”
MethodDeActive: Scaling Activity Recognition with Active Deep Learning
Hossain, H. M. S., Khan, M. A., & Roy, N. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3214269 · Cited by 72 · cited 2×
“et al. 2011 [111]; Chikhaoui and Gouineau [33]; Gu et al. 2018 [47]; Zeng et al. 2017 [177]; Bai et al. 2019 [11] Semi-Supervised Co-training Chen et al. 2019 [28] Active Learning Hossain et al. 2018 [59]; Hossain and Roy 2019 [60] Synthesizing Data Wang et al. 2018 [153]; Zhang et al. 2019 [188] tend to predict the c…”
BackgroundMathur, A., Zhang, T., Bhattacharya, S., Velickovic, P., Joffe, L., Lane, N. D., Kawsar, F., & Lio, P. (2018) · 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2018.00048 · Cited by 70 · cited 1×
“and other not systematic but as effective solutions [64, 93].”
BackgroundIto, C., Cao, X., Shuzo, M., & Maeda, E. (2018) · UbiComp/ISWC Adjunct · doi:10.1145/3267305.3267517 · Cited by 68 · cited 2×
“nd concatenate all the features before feeding a fully-connected layer. In the studies of applying deep learning to hand-crafted features, the axis-specific process is a requirement. For instance, in [64], temporal features of acceleration and gyro signals are first represented by FFT spectrogram images and then verti…”
BackgroundInfluentialTagFree Activity Identification with RFIDs
Fan, X., Gong, W., & Liu, J. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3191739 · Cited by 67 · cited 2×
“[42] proposed to develop time-angle spectrum frames for representing the spectral power variations along time in different spatial angles of the RFID signals.”
BackgroundLearning from less for better: semi-supervised activity recognition via shared structure discovery
Yao, L., Nie, F., Sheng, Q. Z., Gu, T., Li, X., & Wang, S. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2971648.2971701 · Cited by 65 · cited 1×
“Semi-supervised learning has shown a growing trend in activity recognition because of the difficulty in obtaining labeled data [156].”
BackgroundSelf-citationDeep Dilated Convolution on Multimodality Time Series for Human Activity Recognition
Xi, R., Hou, M., Fu, M., Qu, H., & Liu, D. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489540 · Cited by 65 · cited 1×
“could explore is inadequate as well. Furthermore, if a large time scale is desirable, a pooling operation would be commonly used between two CNN layers, which would cause information loss. Xi et al. [160] applied a deep dilated CNN to time series for solving the issues. The dilated CNN uses dilated convolution kernels…”
MethodDistributionally Robust Semi-Supervised Learning for People-Centric Sensing
Chen, K., Yao, L., Zhang, D., Chang, X., Long, G., & Wang, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013321 · Cited by 57 · cited 2×
“ognition that are introduced in this section. Table 3. Deep Learning Works for Heterogeneity in Activity Recognition Heterogeneity Subclass References User - Rokni et al. 2018 [124]; Chen et al. 2019 [26]; Soleimani and Nazerfard et al. 2019 [139]; Wooet al. 2016 [158]; Matsui et al. 2017 [94]; Saeedi et al. 2017 [130…”
BackgroundSelf-citationIshimaru, S., Hoshika, K., Kunze, K. S., Kise, K., & Dengel, A. R. (2017) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3123024.3129271 · Cited by 53 · cited 2×
“has two conventional LSTM layers for extracting temporal dynamics from both forward and backward directions is an important variant of the RNN in various domains including human activity recognition [63]. In addition, Guan J. ACM, Vol. 37, No. 4, Article 111. Publication date: August 2018. Deep Learning for Sensor-bas…”
BackgroundInfluentialDFTerNet: Towards 2-bit Dynamic Fusion Networks for Accurate Human Activity Recognition
Yang, Z., Raymond, O. I., Zhang, C., Wan, Y., & Long, J. (2018) · IEEE Access · doi:10.1109/access.2018.2873315 · Cited by 51 · cited 1×
“y-accumulate operations (require hundreds of logic gates at least) can be replaced by popcount-XNOR operations (only require a single logic gate), which are especially well suited for FPGAs and ASICs [166]. In [166], Yang et al. explored a 2-bit CNN with weights and activations constrained to {-0.5, 0, 0.5} for effici…”
MethodInfluentialAdversarial Variational Embedding for Robust Semi-supervised Learning
Zhang, X., Yao, L., & Yuan, F. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330966 · Cited by 49 · cited 2×
“iers for prediction with original data. We should note that although this work uses deep generative networks, the generation process depends on labels so the process is not unsupervised. Zhang et al. [188] proposed to use semi-supervised GAN for activity recognition. Different from regular GAN, the discriminator in se…”
BackgroundSelf-citationSequence-to-Sequence Model with Attention for Time Series Classification
Tang, Y., Xu, J., Matsumoto, K., & Ono, C. (2016) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2016.0078 · Cited by 48 · cited 2×
“Sensory Data Method Subclass References Traditional - Li et al. 2015 [85]; Nutter et al. 2018 [103]; Xue et al. 2018 [163]; Brophy et al. 2018 [19]; Attetion Mechanism Soft Attention Tang et al. 2016 [142]; Murahari and Plötz 2018 [101]; Zeng et al. 2018 [175]; Shen et al. 2018 [135]; Ma et al. 2019 [90]; Hard Attenti…”
BackgroundUser adaptation of convolutional neural network for human activity recognition
Matsui, S., Inoue, N., Akagi, Y., Nagino, G., & Shinoda, K. (2017) · 2017 25th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2017.8081308 · Cited by 46 · cited 2×
“ty in Activity Recognition Heterogeneity Subclass References User - Rokni et al. 2018 [124]; Chen et al. 2019 [26]; Soleimani and Nazerfard et al. 2019 [139]; Wooet al. 2016 [158]; Matsui et al. 2017 [94]; Saeedi et al. 2017 [130]; Morales et al. 2016 [99]; Jiang et al. 2018 [66]; Khan et al. 2018 [72]; Zheng et al. 2…”
BackgroundMethodMulti-agent Attentional Activity Recognition
Chen, K., Yao, L., Zhang, D., Guo, B., & Yu, Z. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/186 · Cited by 46 · cited 2×
“ahari and Plötz 2018 [101]; Zeng et al. 2018 [175]; Shen et al. 2018 [135]; Ma et al. 2019 [90]; Hard Attention Zhang et al. 2018 [187]; Chen et al. 2019 [28]; Chen et al. 2018 [25]; Chen et al. 2019 [27]; 4 FUTURE RESEARCH DIRECTION To develop full potential of deep learning in human activity recognition, some future…”
BackgroundSelf-citationChikhaoui, B., & Gouineau, F. (2017) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2017.97 · Cited by 44 · cited 2×
“ity in Activity Recognition Training Fashion Learning Approach References Unsupervised Pretraining Alsheikh et al. 2016 [6]; Hammerla et al. 2015 [56]; Plötz et al. 2011 [111]; Chikhaoui and Gouineau [33]; Gu et al. 2018 [47]; Zeng et al. 2017 [177]; Bai et al. 2019 [11] Semi-Supervised Co-training Chen et al. 2019 [2…”
BackgroundMethodDeep Auto-Set: A Deep Auto-Encoder-Set Network for Activity Recognition Using Wearables
Varamin, A. A., Abbasnejad, E., Shi, Q., Ranasinghe, D. C., & Rezatofighi, H. (2018) · Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services · doi:10.1145/3286978.3287024 · Cited by 44 · cited 1×
“to predict a label for each time step. Therefore, the FCNs could not only use the information of the corresponding time step itself but also utilize the information of its neighboring time steps. In [148], Varamin et al. designed a multi-label architecture to simultaneously predict the number of ongoing activities and…”
BackgroundOn heterogeneity in mobile sensing applications aiming at representative data collection
Blunck, H., Bouvin, N. O., Franke, T., Grønbæk, K., Kjærgaard, M. B., Lukowicz, P., & Wüstenberg, M. (2013) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2494091.2499576 · Cited by 43 · cited 1×
“sible. In fact, owing to the imperfections in the production process, sensor chips show variation in the same conditions [35]. Also, the performance of devices differs in different software platforms [18]. For example, APIs, resolutions, and other factors are all influential to the performance of sensors. There have b…”
BackgroundChen, K., Yao, L., Wang, X., Zhang, D., Gu, T., Yu, Z., & Yang, Z. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489767 · Cited by 43
Self-citationAdversarial Multi-view Networks for Activity Recognition
Bai, L., Yao, L., Wang, X., Kanhere, S. S., Guo, B., & Yu, Z. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397323 · Cited by 40
Self-citationIwasawa, Y., Nakayama, K., Yairi, I. E., & Matsuo, Y. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/268 · Cited by 38 · cited 2×
“s age through the time series sensor data. Specifically, for the deep learning technique, its black-box characteristic may be at the risk of revealing user-discriminative features unintentionally. In [65], the authors investigated the privacy issue of using CNN features for human activity recognition. Their empirical…”
BackgroundMethodDeep Dilation on Multimodality Time Series for Human Activity Recognition
Xi, R., Li, M., Hou, M., Fu, M., Qu, H., Liu, D., & Haruna, C. R. (2018) · IEEE Access · doi:10.1109/access.2018.2870841 · Cited by 36 · cited 1×
“N to extract elaborated correlations of individual sensing axes. Dilated convolution is another solution to exploiting nonadjacent modalities without information loss and extra computational expenses [161]. In addition to wearable sensors, RFID-based activity recognition requires the fusion of multiple RFID signals as…”
BackgroundAlani, A. A., Cosma, G., & Taherkhani, A. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207697 · Cited by 36 · cited 2×
“Data level re-sampling [5] -simple balancing process -free of noises -decrease the amount of sample -may miss featured samples”
BackgroundHierarchical Signal Segmentation and Classification for Accurate Activity Recognition
Akbari, A., Wu, J., Grimsley, R., & Jafari, R. (2018) · UbiComp/ISWC Adjunct · doi:10.1145/3267305.3267528 · Cited by 35
Active Deep Learning for Activity Recognition with Context Aware Annotator Selection
Hossain, H. M. S., & Roy, N. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330688 · Cited by 35 · cited 4×
“ids of the clusters, in this work, the neighboring samples are also queried. The experiments show that the proposed method can achieve the optimal results by labeling 10% of the data. Hossain and Roy [60] further investigated two problems of deep active learning and human activity recognition. The first problem is tha…”
BackgroundMethodInfluentialActiveHARNet: Towards On-Device Deep Bayesian Active Learning for Human Activity RecognitionPreprint
Gudur, G. K., Sundaramoorthy, P., & Umaashankar, V. (2019) · EMDL '19 · doi:10.48550/arxiv.1906.00108 · Cited by 34
Abedin, A., Rezatofighi, S. H., Shi, Q., & Ranasinghe, D. C. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/801 · Cited by 29 · cited 1×
“readings due to hardware issues making the sensor data temporally sparse that requires a specific structure of neural network to resolve [2].”
BackgroundSelf-Gated Recurrent Neural Networks for Human Activity Recognition on Wearable Devices
Vu, T. H., Dang, A., Dung, L., & Wang, J. (2017) · Thematic Workshops of ACM Multimedia · doi:10.1145/3126686.3126764 · Cited by 28 · cited 1×
“ease recognition accuracy with only a small gain of computational consumption. Optimizing basic neural network cells and structure is another intuitive scheme of decreasing computation complexity. In [151], Vu et al. used a self-gated recurrent neural network (SGRNN) cell to not only decline the complexity of a standa…”
BackgroundCross-dataset deep transfer learning for activity recognition
Gjoreski, M., Kalabakov, S., Luštrek, M., Gams, M., & Gjoreski, H. (2019) · Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers · doi:10.1145/3341162.3344865 · Cited by 28 · cited 2×
“on is pragmatic since the smart devices can be placed in diverse positions such as in the hand, in a pocket, or on the nose (e.g., goggles), and inappropriate selection may lead to negative transfer. [43] proves that the similarity between domains in transfer learning is determinative. [155] suggests that higher simil…”
BackgroundMotion2Vector: unsupervised learning in human activity recognition using wrist-sensing data
Bai, L., Yeung, C., Efstratiou, C., & Chikomo, M. (2019) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3341162.3349335 · Cited by 27 · cited 2×
“denoising autoencoders [47], and CNN autoencoders [177] to combine automatic feature learning and dimensionality reduction in one integrated neural network for activity recognition. In a recent work [11], Bai et al. proposed a method called Motion2Vector to convert a time period of activity data into a movement vector…”
BackgroundMethodDesign of Novel Deep Learning Models for Real-time Human Activity Recognition with Mobile Phones
Nutter, M., Crawford, C. H., & Ortiz, J. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489319 · Cited by 25 · cited 2×
“s’ prediction of activities. Table 4. Deep Learning Works for Interpretability of Deep Learning Models in Sensory Data Method Subclass References Traditional - Li et al. 2015 [85]; Nutter et al. 2018 [103]; Xue et al. 2018 [163]; Brophy et al. 2018 [19]; Attetion Mechanism Soft Attention Tang et al. 2016 [142]; Muraha…”
BackgroundLabelForest: Non-Parametric Semi-Supervised Learning for Activity Recognition
Ma, Y., & Ghasemzadeh, H. G. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014520 · Cited by 24 · cited 1×
“Some works have explored to promote classic semi-supervised learning methods on activity recognition, such as manifold learning [86, 112].”
BackgroundZhang, D., Yao, L.-N., Chen, K.-X., & Wang, S. (2018) · International Conference on Information and Knowledge Management · doi:10.1145/3269206.3269259 · Cited by 22
Self-citationConfidence-based Deep Multimodal Fusion for Activity Recognition
Choi, J. H., & Lee, J. (2018) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3267305.3267522 · Cited by 22 · cited 1×
“attened and stacked into a new 2D matrix before being fed into a merge CNN for further extracting the interactions among different sensors. A more advanced fusion approach was proposed by Choi et al. [34] to efficiently fuse different modalities by regulating the level of contribution of each sensor. The authors desig…”
MethodCross-position Activity Recognition with Stratified Transfer LearningPreprint
Chen, Y., Wang, J., Huang, M., & Yu, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09776 · Cited by 22 · cited 1×
“[31] assumed that data samples of the same activities are aggregated in the distribution space even when they are from different sensors.”
BackgroundYuki, Y., Nozaki, J., Hiroi, K., Kaji, K., & Kawaguchi, N. (2018) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3267305.3267533 · Cited by 17 · cited 2×
“[159] employed a dual-stream ConvLSTM network with one stream handling smaller time length and the other one handling more substantial time length to analyze more complex temporal hierarchies.”
BackgroundMethodDistribution-Based Semi-Supervised Learning for Activity Recognition
Qian, H., Pan, S. J., & Miao, C. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017699 · Cited by 17 · cited 1×
“Some works have explored to promote classic semi-supervised learning methods on activity recognition, such as manifold learning [86, 112].”
BackgroundKwon, Y., Kang, K., & Bae, C. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280494 · Cited by 16 · cited 1×
“o. 4, Article 111. Publication date: August 2018. Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities 111:27 contribute to identifying certain activities [76]. For example, lying is distinguishable when people are horizontal (magnetism), and ascending stairs can be recogni…”
BackgroundMulti-Resident Activity Monitoring in Smart Homes: A Case Study
Tran, S. N., Zhang, Q., Smallbon, V., & Karunanithi, M. (2018) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2018.8480132 · Cited by 16 · cited 1×
“up activity. Pretty high accuracy of nearly 100% was achieved. However, most targeting scenarios that two occupants performed the same activity together were constrained. On the contrary, Tran et al. [146] did not restrain the occupants to act together. It aimed at recognizing activities for each occupant separately.…”
MethodRecognition of multiple overlapping activities using compositional CNN-LSTM model
Okita, T., & Inoue, S. (2017) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3123024.3123095 · Cited by 15 · cited 1×
“rises. To resolve this issue, the authors further proposed to use a single neuron with the siдmoid activation to make binary classification (performed or not) for each activity [87]. Okita and Inoue [105] also targeted the concurrent activity recognition and suggested a multi-layer LSTM framework to make classificatio…”
MethodShen, Y., He, K., & Zhang, W.-Q. (2018) · IEEE International Symposium on Signal Processing and Information Technology · doi:10.1109/isspit.2018.8642767 · Cited by 14 · cited 3×
“ies for learning modality-specific temporal characteristics. With the development of the CNNs, other kinds of CNN variants are also considered for effectively embedding temporal features. Shen et al. [135] utilized the gated CNN for daily activity recognition from audio signals and showed superior accuracy to the naiv…”
BackgroundMethodInfluentialPrototype Similarity Learning for Activity Recognition
Bai, L., Yao, L., Wang, X., Kanhere, S. S., & Xiao, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-47426-3_50 · Cited by 14 · cited 2×
“Some works employed one-dimensional (1D) convolutions on the individual univariate time series signals for temporal feature extraction [13, 39, 46, 122, 123, 153].”
BackgroundSelf-citationA Multimodal Deep Learning Network for Group Activity Recognition
Rossi, S., Capasso, R., Acampora, G., & Staffa, M. (2018) · IEEE International Joint Conference on Neural Network · doi:10.1109/ijcnn.2018.8489309 · Cited by 12 · cited 1×
“object-use information play vital roles in designing recognition solutions. Although the multi-occupant activity recognition is of great meaning, its deep learning-based research is still limited. In [127], both wearable and ambient sensors were used to recognize group activities of two occupants. The ambient sensors…”
MethodCollective Protection: Preventing Sensitive Inferences via Integrative Transformation
Zhang, D., Yao, L., Chen, K., Long, G., & Wang, S. (2019) · Proceedings · doi:10.1109/icdm.2019.00197 · Cited by 10 · cited 1×
“of private information, such as user identity and gender. In addition, the adversarial loss goes against the end-to-end training process that making it hard to converge stably. Considering this gap, [179] borrowed the idea of image style transformation from the computer vision community to protect all private informat…”
BackgroundSelf-citationCRM Sales Prediction Using Continuous Time-Evolving Classification
Ali, M., & Lee, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11418 · Cited by 10
RNN-Based Personalized Activity Recognition in Multi-person Environment Using RFID
Woo, S., Byun, J., Kim, S., Nguyen, H. M., Im, J., & Kim, D. (2016) · IEEE International Conference on Computer and Information Technology (CIT) · doi:10.1109/cit.2016.16 · Cited by 8 · cited 2×
“ning Works for Heterogeneity in Activity Recognition Heterogeneity Subclass References User - Rokni et al. 2018 [124]; Chen et al. 2019 [26]; Soleimani and Nazerfard et al. 2019 [139]; Wooet al. 2016 [158]; Matsui et al. 2017 [94]; Saeedi et al. 2017 [130]; Morales et al. 2016 [99]; Jiang et al. 2018 [66]; Khan et al.…”
Predicting Complex Activities from Ongoing Multivariate Time Series
Cheng, W., Erfani, S., Zhang, R., & Ramamohanarao, K. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/461 · Cited by 8 · cited 1×
“classification. In such a way, the priori of simple activities being the components of a composite activity is utilized by the shared deep feature extractor. Different from the joint learning manner, [32] infers a sequence of simple activities and its corresponding composite activity by using two conditional probabili…”
MethodPires, I. M., Pombo, N., Garcia, N. M., & Flórez-Revuelta, F. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/859 · Cited by 8 · cited 1×
“s, including two smartphones and one on-node unit. The results revealed milliseconds to tens of milliseconds computational time of one prediction suggesting the possibility of real-time applications. [110] also demonstrates the combination of hand-crafted features and a neural network is a potential plan to achieve re…”
BackgroundAttriNet: learning mid-level features for human activity recognition with deep belief networks
Nair, H., Tan, C. S., Zeng, M., Mengshoel, O. J., & Shen, J. P. (2019) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3341162.3345600 · Cited by 7 · cited 3×
“]; Jiang et al. 2018 [66]; Khan et al. 2018 [72]; Zheng et al. 2019 [192]; Gjoreski et al. 2019 [43] Time Concept Drift Tao et al. 2016 [143]; Gudur et al.2019 [50] Concept Evolution Nair et al. 2019 [102] Open-Set Yang et al. 2019 [165] Sensor Instance Mathur et al. 2018 [93] Type and Position Morales et al. 2016 [99…”
BackgroundInfluentialActivity Recognition from Inertial Sensors with Convolutional Neural Networks
Ha, Q.-D., & Tran, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70004-5_20 · Cited by 5 · cited 1×
“vertically stack all signal sequences to form a 2D matrix and directly applied 2D-CNNs to simultaneously capture both local dependencies over time as well as spatial dependencies over modalities. In [53], the authors preprocessed the raw signal sequence of a single modality into a 2D format but by simply reorganizing,…”
MethodLearning to Synthesize and Manipulate Natural Images
Zhu, J.-Y. (2019) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2019.2891309 · Cited by 5 · cited 1×
“and the discriminator mutually improve their performance in generation and discrimination. Variants of GANs has been applied to different fields such as language generation [113] and image generation [193]. The first work about data augmentation with synthesizing sensory data for activity recognition is called Sensory…”
Background
Research works printed but not linked: 37
- Alsheikh Mohammad Abu, 2016, Proceedings of the Workshops at the 30th AAAI Conference on Artificial Intelligence.
- Bengio Yoshua, 2012, Proceedings of ICML Workshop on Unsupervised and Transfer Learning. 17–36
- Brophy Eoin, 2018, Zhengwei Wang, Alan F. Smeaton, and Tomas E. Ward.
- 10.5555/3367032.3367223 · doi:10.5555/3367032.3367223
- Chen Ling, 2020, METIER: A deep multi-task learning based activity and user recognition model using wearable sensors. Proc. ACM Interact., Mob, Wear. Ubiq. Technol., 4, 1
- Dong Mingtao, 2018, Proceedings of the International Conference on Signal and Information Processing, Networking and Computers. Springer, 32–40
- Goodfellow Ian, 2014, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 2672–2680
- Hammerla Nils Yannick, 2015, Proceedings of the 29th AAAI Conference on Artificial Intelligence.
- Hammerla Nils Y., 2016, Proceedings of the 25th International Joint Conference on Artificial Intelligence. 1533–1540
- Karpathy Andrej, 2016, Proceedings of the 4th International Conference on Learning Representations Workshop.
- Al Hafiz Khan Md Abdullah, 2018, Proceedings of the International Conference on Pervasive Computing and Communications. IEEE, 1–9.
- 10.5555/3164150.3164213 · doi:10.5555/3164150.3164213
- Krizhevsky Alex, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1097–1105
- Nicholas, Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications. ACM, 117–122
- Lee Song-Mi, 2017, Proceedings of the IEEE International Conference on Big Data and Smart Computing (BigComp’17)
- Li Fei, 2011, Proceedings of the Workshops at the 25th AAAI Conference on Artificial Intelligence.
- Li Xinyu, Proceedings of the 8th Wireless of the Students, by the Students, and for the Students Workshop (S3@MobiCom’16)
- Li Xinyu, Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. ACM, 164–175
- Li Xinyu, 2017, Burd
- Ordóñez Morales Francisco Javier, 2016, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 92–99
- Vishvak, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 100–103
- Phan NhatHai, 2016, Proceedings of the 30th AAAI Conference on Artificial Intelligence.
- Pouyanfar Samira, 2018, A survey on deep learning: Algorithms, techniques, and applications, Comput. Surv., 51, 92
- Press Ofir, 2017, Language generation with recurrent generative adversarial networks without pre-training. arXiv preprint arXiv:1706.01399 · arXiv
- Qian Hangwei, 2018, Proceedings of the AAAI Conference on Artificial Intelligence.
- Saeedi Ramyar, Proceedings of the IEEE International Conference on Big Data. IEEE, 473–479
- Serrano Sofia, Proceedings of the 57th Conference of the Association for Computational Linguistics (ACL’19)
- van Kasteren Tim L. M., 2011, Kröse
- Xue Li, 2018, Understanding and improving deep neural network for activity recognition. arXiv preprint arXiv:1805.07020 · arXiv
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
- Zebin Tahmina, Proceedings of the IEEE Conference on Sensors (SENSORS’16)
- Zhang Dalin, 2018, Proceedings of the AAAI Conference on Artificial Intelligence, 32
- Zhang Mi, Proceedings of the ACM Conference on Ubiquitous Computing. ACM, 1036–1043
- 10.5555/3304889.3305093 · doi:10.5555/3304889.3305093
- Zhang Yanyi, Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN’17)
- Zhang Yong, 2018, Human activity recognition based on time series analysis using U-Net. arXiv preprint arXiv:1809.08113 · arXiv
- Zheng Yi, Proceedings of the International Conference on Web-age Information Management. Springer, 298–310
Cited by
Integrated Sensing and Communications: Toward Dual-Functional Wireless Networks for 6G and Beyond
Liu, F., Cui, Y., Masouros, C., Xu, J., Han, T. X., Eldar, Y. C., & Buzzi, S. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3156632 · Cited by 3,857
“, indoor human activity recognition [58] (∼1 cm), autonomous robots and manufacturing [59] (∼5 mm).”
BackgroundQiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
Remote patient monitoring using artificial intelligence: Current state, applications, and challenges
Shaik, T., Tao, X., Higgins, N., Li, L., Gururajan, R., Zhou, X., & Acharya, U. R. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1485 · Cited by 515
“Feature extraction is one of the key steps RPM systems perform in analyzing human vital signs and activity recognition (K. Chen, Zhang, et al., 2021).”
BackgroundMethodInfluentialHuman activity recognition in artificial intelligence framework: a narrative review
Gupta, N., Gupta, S. K., Pathak, R. K., Jain, V., Rashidi, P., & Suri, J. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10116-x · Cited by 337
“According to our observations (Chen et al. 2020; Suthar and Gadhia 2021; Ding et al. 2019), the growth of HAR is directly proportional to the advancement of AI which thrives the scope of HAR in various application domains.”
BackgroundDeep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
“Chen et al. [5] discuss challenges in HAR and the appropriate deep learning methods for addressing each challenge.”
BackgroundMethodInfluential
Metadata
- Authors
- Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y.
- Affiliations
- Aalborg University (DK)
- UNSW Sydney (AU)
- Northwestern Polytechnical University (CN)
- Michigan State University (US)
- Venue
- ACM Computing Surveys
- Published
- 2021-05-24
- Volume
- 54
- Issue
- 4
- Pages
- 1-40
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3164845984
- Cited by
- 690
- References
- 144
- Citations by year
- 2026: 83 · 2025: 137 · 2024: 172 · 2023: 149 · 2022: 101 · 2021: 45
- FWCI
- 41.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion, public-domain)
- VBN Forskningsportal (Aalborg Universitet) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Keywords
- human activity recognition, sensor-based activity recognition, deep learning, Internet of Things, sensor fusion, activity recognition dataset, wearable sensors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.