Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Open accessThe DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index; 8 of the 23 sources its claims cite were checked for support.
Abstract
Introduces DeepConvLSTM, a deep learning architecture combining convolutional and LSTM recurrent units for multimodal wearable activity recognition, outperforming non-recurrent deep networks and handcrafted feature baselines by 4% to 9%.
Overview
CoChat Summary
TL;DR
The paper proposes DeepConvLSTM, a deep framework combining four convolutional layers with two LSTM recurrent layers for wearable activity recognition from raw multimodal sensor data. It reports improved F1 scores over a baseline CNN and prior results on the OPPORTUNITY and Skoda datasets, including 0.915 F1 for OPPORTUNITY gestures with the Null class and 0.958 F1 on Skoda.
Key findings
- On OPPORTUNITY, DeepConvLSTM achieved F1 scores of 0.930 for modes of locomotion without Null, 0.895 for modes with Null, 0.866 for gestures without Null, and 0.915 for gestures with Null; the baseline CNN scored 0.912, 0.878, 0.783, and 0.883, respectively. The paper reports a 6% average improvement over the best OPPORTUNITY challenge submissions and more than 9% improvement on gesture recognition without Null.
- On Skoda, DeepConvLSTM reached 0.958 F1, compared with 0.884 for the baseline CNN, 0.893 for CNN [43], and 0.861 for CNN [23], improving the best reported result by 6%.
- Multimodal fusion improved gesture recognition on OPPORTUNITY without Null: 0.689 F1 with accelerometers only, 0.611 with gyroscopes only, 0.745 with accelerometers + gyroscopes, 0.839 with accelerometers + gyroscopes + magnetic sensors, and 0.864 with the full OPPORTUNITY sensor set.
- DeepConvLSTM had 999,122 parameters versus 7,445,458 for the baseline CNN, a 600% increase for the baseline; training took 340.3 min versus 282.2 min, and classification took 6.68 s versus 5.43 s, with DeepConvLSTM classifying almost 15 min of data per second and achieving 900× real-time on the GPU used.
Methods
- DeepConvLSTM uses four convolutional layers with 64 feature maps each, followed by two dense LSTM layers with 128 cells and a softmax output; the baseline CNN shares the convolutional layers but uses two non-recurrent dense layers with 128 units. Models were trained supervised with cross-entropy loss, mini-batch gradient descent with RMSProp, learning rate 10e-3, decay factor 0.9, mini-batches of 100 segments, and dropout p=0.5 on dense-layer inputs.
- Inputs were sliding windows of 500 ms with 250 ms step size, using raw sensor data with minimal preprocessing: linear interpolation for missing values and per-channel normalization to [0,1]. Evaluation used weighted F1 to address class imbalance.
- Experiments used the OPPORTUNITY dataset (on-body sensors, 113 channels, 30 Hz; Task A: 5-class modes of locomotion/postures; Task B: 18-class sporadic gestures) and the Skoda dataset (one subject, 10 right-arm 3D accelerometers, decimated to 30 Hz, 10 manipulative gestures, about 3 h and about 70 repetitions per gesture). Analyses included comparison to baseline CNN and published results, confusion matrices, sensor-modality fusion, and hyperparameter evaluations of sequence length and number of convolutional layers.
Limitations
- The paper states that DeepConvLSTM has not yet been implemented on a wearable device; the GPU used clearly outperforms current high-end wearable computational power, and training is best envisioned server-side. It also states that pooling was omitted because the sliding-window setup limits downsampling, though pooling could be useful without that requirement, and that training time increases with the number of layers, creating a performance–computational budget trade-off.
- Evident from the text: Skoda evaluation uses one subject and only right-arm sensors, and OPPORTUNITY testing is limited to ADL4 and ADL5 for Subjects 2 and 3, which constrains generalizability. The text does not report cross-validation or statistical significance testing.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



![Figure 4 Placement of on-body sensors used in the OPPORTUNITYdataset (left: inertial measurements units; right: 3-axis accelerometers) [7].](https://figures.cochat.ai/paper-figures/27c0e4b39d104fe2b5315587d736fd2d/deep-convolutional-and-lstm-recurrent-neural-networks-for-multimodal-wearable-figure-4.jpg)




Verification
Claims the paper makes
5 Valid · 5 Not valid · 13 Not checked · 99 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“The choice of the number of recurrent layers is made following the results presented in [33], where the authors showed that a depth of at least two recurrent layers is beneficial when processing sequential data.”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 3. Architecture > 3.1. DeepConvLSTM
What the sources say
- Supportedcites [33] Karpathy A. Johnson J. Li F.F. Visualizing and understanding recurrent networks Cornell Univ. Lab. 2015 arXiv:1506.02078 source
Section 4.1 compares recurrent networks with one, two, and three layers on two sequence datasets and states that a depth of at least two is consistently beneficial. This directly supports the attributed finding, within the paper’s tested settings. (LLM, conf=0.94)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“This seems to indicate that although deep learning techniques are often employed with large amounts of data, (e.g., millions of frames in computer vision [22]), they may actually be applicable to problem domains where acquiring annotated data is very costly, such as in supervised activity recognition.”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 5. Results and Discussion > 5.4. Discussion
What the sources say
- Supportedcites [22] Pigou L. Oord A.V.D. Dieleman S. van Herreweghe M. Dambre J. Beyond Temporal Pooling: Recurrence and Temporal Convolutions for Gesture Recognition in Video arXiv Preprint 2015 arXiv:1506.01911 source
The citation is attached to the example of large-scale computer-vision data, not to the citing authors’ conclusion about costly annotation. Section 4.1 (page unavailable) reports 1,720,800 labeled video frames in the gesture-recognition dataset, supporting the cited example of data on the order of millions of frames. (LLM, conf=0.86)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The baseline CNN also offers better results than the OPPORTUNITY submissions in the recognition of models of locomotion.”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 5. Results and Discussion > 5.1. Performance Comparison
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From the results, we can also see how the model is able to learn from signals obtained from accelerometers, gyroscopes and magnetometers, fusing them without requiring any specific preprocessing.”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 6. Conclusions
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(iv) it is applicable even if the gestures are longer than the observation window.”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 5. Results and Discussion > 5.4. Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
84 more claims
Create a free account to see all 122 claims and to verify the 2 references still open.
- It may state two separate claims as one. 14
- Probably not a substantial claim. 23
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, these complex network framework suffered from low ef ciency and can hardly meet real-time requirements in practice applications.”
From InnoHAR: A Deep Neural Network for Complex Human Activity Recognition (2019) · cites this paper as [19]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, due to the lack of filtration techniques applied to multimodal data, the system’s performance was low.”
From A Multimodal IoT-Based Locomotion Classification System Using Features Engineering and Recursive Neural Network (2023) · cites this paper as [15]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“and yield better performances than pure CNNs or LSTM networks [12]”
From Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors (2018) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The proposed method outperforms other methods, such as those based on deep believe networks (DBNs) [10], SVM [10], and CNNs [13].”
From Deep Recurrent Neural Networks for Human Activity Recognition (2017) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The popular DeepConvLSTM model [7] can only afford four, moderately-sized convolution layers to learn effective data representations, and two LSTM layers for sequence modeling.”
From Complex Deep Neural Networks from Large Scale Virtual IMU Data for Effective Human Activity Recognition Using Wearables (2021) · cites this paper as [7]
Experimental — accuracy not yet measured
20 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 3. Architecture
“The length of the kernels is the same for every convolutional layer, being defined as Pl=5,∀l=2,⋯,5.”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 4. Experimental Setup > 4.2. Performance Measure
“Following the OPPORTUNITY challenge experimental setup, the length of the window is 500 ms, with a step size of 250 ms.”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“| Total | 996,800 +(128×nc)+nc | 996,800 +(128×nc)+nc | 7,443,136+(128×nc)+nc | 7,443,136+(128×nc)+nc |”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 3. Architecture > 3.3. Model Implementation and Training
Reported 996800 · recomputed 1037888
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“| 6 | Wai,Waf,Wac,Wao: 7232×128 | 942,592 | W: 57,856×128 | 7,405,696 |”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 3. Architecture > 3.3. Model Implementation and Training
Reported 942592 · recomputed 3702784
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“| 7 | Wai,Waf,Wac,Wao: 128×128 | 33,280 | W: 128×128 | 16,512 |”
§ Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition > 3. Architecture > 3.3. Model Implementation and Training
Reported 33280 · recomputed 131072
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · cited 1×
“Other publications showed much deeper networks, such as “GoogLeNet”, which is a 27-layer deep neural network applied to image classification [45].”
BackgroundReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“Networks using LSTM cells have offered better performance than standard recurrent units in speech recognition, where they gave state-of-the-art results in phoneme recognition [20].”
BackgroundConvolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
DeepPose: Human Pose Estimation via Deep Neural Networks
Toshev, A., & Szegedy, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.214 · Cited by 3,185 · cited 1×
“Deep CNNs have had a major impact on fields, like content recommendation [24], speech recognition [25] and in computer vision [26–28], where they have become the de facto standard approach.”
BackgroundOverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680 · cited 1×
“Deep CNNs have had a major impact on fields, like content recommendation [24], speech recognition [25] and in computer vision [26–28], where they have become the de facto standard approach.”
BackgroundLee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412 · cited 1×
“Deep learning techniques have outperformed many conventional methods in computer vision [13] and audio classification [14].”
MethodA review of wearable sensors and systems with application in rehabilitation
Patel, S., Park, H., Bonato, P., Chan, L., & Rodgers, M. (2012) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-9-21 · Cited by 2,396 · cited 1×
“, from simple hand gestures to complex activities, such as “cooking a meal”) and the context in which they occur from sensor data is at the core of smart assistive technologies, such as in smart homes [1], in rehabilitation [2], in health support [3,4], in skill assessment [5] or in industrial settings [6].”
Background
Research works printed but not linked: 1
- Gers F.A. Schraudolph N.N. Schmidhuber J. Learning precise timing with LSTM recurrent networks J. Mach. Learn. Res. 2003 3 115 143
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Deep learning for time series classification: a review
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00619-1 · Cited by 3,342
“We think that our choice makes sense in a way that the goal of deep learning approaches is to remove the bias due to manually designed features (Ordón̈ez and Roggen, 2016), thus enabling the network to learn the most discriminant useful features for the classification task.”
BackgroundDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
“For multi-modal signals, it is better to use CNN since (Bhattacharya and Lane, 2016) Body-worn, ambiemt RBM Gesture, ADL, transportation Self, D01 (Chen and Xue, 2015) Body-worn CNN ADL Self (Chen et al., 2016b) Body-worn CNN ADL D06 (Edel and K¨oppe, 2016) Body-worn RNN ADL D01, D04, Self (Fang and Hu, 2014) Object,…”
MethodInfluentialDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
“, [113], [254], [257], [263], [264], [478], and [479]) based on patterns observed in the output of the mobile camera or other sensors.”
BackgroundInfluentialA State-of-the-Art Survey on Deep Learning Theory and Architectures
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S., Sidike, P., Nasrin, M. S., Hasan, M., Van Essen, B. C., Awwal, A. A. S., & Asari, V. K. (2019) · Electronics · doi:10.3390/electronics8030292 · Cited by 1,620
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
“Ordonez et al. [76] have proposed a DL framework that combines the strength of CNN and LSTM neural networks for human activity recognition from wearable sensor data (accelerometer, gyroscope, etc.).”
BackgroundDeep multimodal learning: a survey on recent advances and trends
Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139
“To capture temporal structures and relationships, deep multimodal learning approaches typically use temporal components such as LSTMs or hidden Markov models combined with visual representation learning layers like CNNs or 3-D-CNNs [42], [43].”
MethodNweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
LSTM-CNN Architecture for Human Activity Recognition
Xia, K., Huang, J., & Wang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982225 · Cited by 851
“[25] proposed an activity recognition classi-fier, which combined deep CNN and LSTM to classify 27 hand gestures and five movements.”
BackgroundReal-time human activity recognition from accelerometer data using Convolutional Neural Networks
Ignatov, A. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2017.09.027 · Cited by 814
Advancing Biosensors with Machine Learning
Cui, F., Yue, Y., Zhang, Y., Zhang, Z., & Zhou, H. S. (2020) · ACS Sensors · doi:10.1021/acssensors.0c01424 · Cited by 768
Sensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730
“Therefore, it is beneficial if the multimodal data are used to interpret complicated activities because multimodal data contain rich semantic knowledge [176,222] .”
BackgroundQiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network
Zhang, Z., Robinson, D., & Tepper, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_48 · Cited by 638
“[5] also used bi-directional LSTM in the Named Entity Classification task, while [19,22] stacked multiple convolutional layers to extract hierarchical features in image processing.”
BackgroundMethodResultInfluentialDeep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Human Action Recognition From Various Data Modalities: A Review
Sun, Z., Ke, Q., Rahmani, H., Bennamoun, M., Wang, G., & Liu, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183112 · Cited by 601
Remembering history with convolutional LSTM for anomaly detection
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019325 · Cited by 582
“LSTM has shown its success for modeling the motion information for activity recognition [17].”
BackgroundUniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v2 · Cited by 596
Applications of machine learning to diagnosis and treatment of neurodegenerative diseases
Myszczynska, M. A., Ojamies, P. N., Lacoste, A. M. B., Neil, D., Saffari, A., Mead, R., Hautbergue, G. M., Holbrook, J. D., & Ferraiuolo, L. (2020) · Nature Reviews Neurology · doi:10.1038/s41582-020-0377-8 · Cited by 595
Recent Advances in Electrochemical Biosensors: Applications, Challenges, and Future Scope
Singh, A., Sharma, A., Ahmed, A., Sundramoorthy, A. K., Furukawa, H., Arya, S., & Khosla, A. (2021) · Biosensors · doi:10.3390/bios11090336 · Cited by 579
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“[207] proposes a hybrid CNN and LSTM model (DeepConvLSTM) for activity recognition using multimodal wearable sensor data.”
BackgroundMachine learning in medical applications: a review of state-of-the-art methods
Shehab, M., Abualigah, L., Shambour, Q., Abu-Hashem, M. A., Shambour, M. K. Y., Alsalibi, A. I., & Gandomi, A. H. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105458 · Cited by 542
Deep Recurrent Neural Networks for Human Activity Recognition
Murad, A., & Pyun, J.-Y. (2017) · Sensors · doi:10.3390/s17112556 · Cited by 524
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
A Survey on Wearable Technology: History, State-of-the-Art and Current Challenges
Ometov, A., Shubina, V., Klus, L., Skibińska, J., Saafi, S., Pascacio, P., Flueratoru, L., Gaibor, D. Q., Chukhno, N., Chukhno, O., et al. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108074 · Cited by 506
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“eep hybrid model to explore different views of temporal dynamics is another attractive trend in the human activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted…”
Mamoshina, P., Ojomoko, L., Yanovich, Y., Ostrovski, A., Botezatu, A., Prikhodko, P., Izumchenko, E., Aliper, A., Romantsov, K., Zhebrak, A., et al. (2018) · Oncotarget · doi:10.18632/oncotarget.22345 · Cited by 471
“For example, RNN model called DeepConvLSTM, a model that combine convolutional networks and recurrent networks with Long Short-Term Memory (LSTM) architecture was applied on recordings from on-body sensors to predict movements and gestures [46].”
MethodZhang, Z., Wen, F., Sun, Z., Guo, X., He, T., & Lee, C. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100228 · Cited by 464
Wang, H., & Wang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.387 · Cited by 463
Ramanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455
“Ordóñez and Roggen [69] have proposed a DeepConvLSTM model based on the success of recurrent neural networks to recognize multimodal activities and to explicitly model the temporal dynamics of feature activations.”
BackgroundSmartphone Sensors for Health Monitoring and Diagnosis
Majumder, S., & Deen, M. J. (2019) · Sensors · doi:10.3390/s19092164 · Cited by 435
Wang, S., Song, J., Lien, J., Poupyrev, I., & Hilliges, O. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984565 · Cited by 433
“Finally, significant improvements in human activity recognition based on accelerometers or gyroscopes have been demonstrated [25] by leveraging similar architectures.”
BackgroundBAT: Deep Learning Methods on Network Intrusion Detection Using NSL-KDD Dataset
Su, T., Sun, H., Zhu, J., Wang, S., & Li, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2972627 · Cited by 434
“BLSTM is an enhanced version of LSTM (Long Short-TermMemory) [36], [37].”
BackgroundMulti-head CNN–RNN for multi-time series anomaly detection: An industrial case study
Canizo, M., Triguero, I., Conde, A., & Onieva, E. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.07.034 · Cited by 420
“As described, time series are processed in a window-based way [29].”
BackgroundMethodInfluentialA novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition
Hu, Y., Wong, Y., Wei, W., Du, Y., Kankanhalli, M., & Geng, W. (2018) · PLOS ONE · doi:10.1371/journal.pone.0206049 · Cited by 398
Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.002 · Cited by 394
Fan, C., Wang, J., Gang, W., & Li, S. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.12.004 · Cited by 368
Demrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368
“The second most used model was the Long Short-TermMemory (LSTM) model, which was used in 17 papers [7], [83], [89], [102], [107], [112], [125], [130], [137], [139], [152], [153], [172],”
MethodMaking Sense of Spatio-Temporal Preserving Representations for EEG-Based Human Intention Recognition
Zhang, D., Yao, L., Chen, K., Wang, S., Chang, X., & Liu, Y. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2905157 · Cited by 365
“RNNs, especially the RNNs with long short-term memory (LSTM) units, have been demonstrated successfully in processing the time series problems, especially when employing multiple layers for each time step [37].”
BackgroundJeyaraj, P. R., & Samuel Nadar, E. R. (2019) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-018-02834-7 · Cited by 360
AI Benchmark: Running Deep Neural Networks on Android Smartphones
Ignatov, A., Timofte, R., Chou, W., Wang, K., Wu, M., Hartley, T., & Van Gool, L. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_19 · Cited by 347
“A separte group deals with on-line sensor data processing for human activity recognition from accelerometer data [25, 26], gesture recognition [27] or sleep monitoring [28].”
BackgroundTimes-series data augmentation and deep learning for construction equipment activity recognition
Rashid, K. M., & Louis, J. (2019) · Advanced Engineering Informatics · doi:10.1016/j.aei.2019.100944 · Cited by 340
Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors
Zhao, Y., Yang, R., Chevalier, G., Xu, X., & Zhang, Z. (2018) · Mathematical Problems in Engineering · doi:10.1155/2018/7316954 · Cited by 348
Web traffic anomaly detection using C-LSTM neural networks
Kim, T.-Y., & Cho, S.-B. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.04.004 · Cited by 340
Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection
Lyu, H., Lu, H., & Mou, L. (2016) · Remote Sensing · doi:10.3390/rs8060506 · Cited by 334
“RNN models have gained significant attention for solving many challenging problems involving sequential time series data, especially Long Short-Term Memory (LSTM) models [27].”
BackgroundA multibranch CNN-BiLSTM model for human activity recognition using wearable sensor data
Challa, S. K., Kumar, A., & Semwal, V. B. (2022) · The Visual Computer · doi:10.1007/s00371-021-02283-3 · Cited by 338
LSTM Networks Using Smartphone Data for Sensor-Based Human Activity Recognition in Smart Homes
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Sensors · doi:10.3390/s21051636 · Cited by 335
“To provide promising results in recognition performance, Ordóñez and Roggen [32] combined the convolutional layer with LSTM layers.”
BackgroundHuman activity recognition in artificial intelligence framework: a narrative review
Gupta, N., Gupta, S. K., Pathak, R. K., Jain, V., Rashidi, P., & Suri, J. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10116-x · Cited by 337
“2017) and DeepConvLSTM (Wang et al.”
MethodInnoHAR: A Deep Neural Network for Complex Human Activity Recognition
Xu, C., Chai, D., He, J., Zhang, X., & Duan, S. (2019) · IEEE Access · doi:10.1109/access.2018.2890675 · Cited by 333
“Ordóñez and Roggen [19] proposed deep convolutional network with utilizing of CNN and LSTM.”
BackgroundMethodInfluentialDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
“eep hybrid model to explore different views of temporal dynamics is another attractive trend in the human activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted…”
Yadav, S. K., Tiwari, K., Pandey, H. M., & Akbar, S. A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106970 · Cited by 311
Hate speech detection: A solved problem? The challenging case of long tail on Twitter
Zhang, Z., & Luo, L. (2019) · Semantic Web · doi:10.3233/sw-180338 · Cited by 325
Deep Learning-Based Gait Recognition Using Smartphones in the Wild
Zou, Q., Wang, Y., Wang, Q., Zhao, Y., & Li, Q. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2985628 · Cited by 305
“In this way, it is common to use CNN as a feature extractor, and then use LSTM to further process the gestural features extracted by the CNN [57]–[59].”
MethodDeep Learning-Based Gait Recognition Using Smartphones in the Wild
Zou, Q., Wang, Y., Wang, Q., Zhao, Y., & Li, Q. (2018) · arXiv · doi:10.48550/arxiv.1811.00338 · Cited by 305
“In this way, it is common to use CNN as a feature extractor, and then use LSTM to further process the gestural features extracted by the CNN [57]–[59].”
MethodComparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors
Li, F., Shirahama, K., Nisar, M., Köping, L., & Grzegorzek, M. (2018) · Sensors · doi:10.3390/s18020679 · Cited by 302
“…taking advantage of the high modularity of ANN-based architectures, previous studies in sensor-based HAR reported that hybrid architectures can extract features carrying information about short and long-term time dependencies, and yield better performances than pure CNNs or LSTM networks [12].”
BackgroundMethodRecent trends in machine learning for human activity recognition—A survey
Ramasamy Ramamurthy, S., & Roy, N. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1254 · Cited by 299
“Ordóñez and Roggen (2016) have proposed a novel deep network comprising of convolutional and LSTM layers.”
BackgroundKanjo, E., Younis, E. M. G., & Ang, C. S. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.001 · Cited by 293
“Thus: where l is the index of the layer that performs convolutional operation.”
Deep Convolutional Neural Networks for Indoor Localization with CSI Images
Wang, X., Wang, X., & Mao, S. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2018.2871165 · Cited by 290
“activity recognition [18], [19] and social networks [20].”
BackgroundDeep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor
Khatun, M. A., Yousuf, M. A., Ahmed, S., Uddin, M. Z., Alyami, S. A., Al-Ashhab, S., Akhdar, H. F., Khan, A., Azad, A., & Moni, M. A. (2022) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2022.3177710 · Cited by 288
“Proposed deep CNN-LSTM with self-attention model was compared with LSTM-CNN from Lyu et al. [53] and CNN-LSTM [54] under the same experimental scenario in order to further verify the model performance.”
A Survey on Deep Learning-Based Change Detection from High-Resolution Remote Sensing Images
Jiang, H., Peng, M., Zhong, Y., Xie, H., Hao, Z., Lin, J., Ma, X., & Hu, X. (2022) · Remote Sensing · doi:10.3390/rs14071552 · Cited by 288
Lipsmeier, F., Taylor, K. I., Kilchenmann, T., Wolf, D., Scotland, A., Schjodt‐Eriksen, J., Cheng, W., Fernandez‐Garcia, I., Siebourg‐Polster, J., Jin, L., et al. (2018) · Movement Disorders · doi:10.1002/mds.27376 · Cited by 266
Bi-LSTM Network for Multimodal Continuous Human Activity Recognition and Fall Detection
Li, H., Shrestha, A., Heidari, H., Le Kernec, J., & Fioranelli, F. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2946095 · Cited by 277
“Rather than considering radar data [27] or wearable sensors data [28] in isolation, we investigate soft”
BackgroundA Survey on Intelligent Internet of Things: Applications, Security, Privacy, and Future Directions
Aouedi, O., Vu, T.-H., Sacco, A., Nguyen, D. C., Piamrat, K., Marchetto, G., & Pham, Q.-V. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3430368 · Cited by 277
Deep recurrent neural network for mobile human activity recognition with high throughput
Inoue, M., Inoue, S., & Nishida, T. (2018) · Artificial Life and Robotics · doi:10.1007/s10015-017-0422-x · Cited by 275
“In concrete, the total size of the inner variables and architecture from the input layer to the output layer of the DRNN is 74166 pcs, and this is the size of less than 10% of the conventional CNN + LSTM model [24].”
BackgroundMethodInfluentialAttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition
Ma, H., Li, W., Zhang, X., Gao, S., & Lu, S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/431 · Cited by 266
Azam, Z., Islam, M. M., & Huda, M. N. (2023) · IEEE Access · doi:10.1109/access.2023.3296444 · Cited by 265
“These directions are crucial for future research, as stated by Ordóñez and Roggen [181].”
BackgroundDeep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
“In addition to the subsequence-based methods, other models employ instance-based sampling [21, 143, 147–150], treating each sample individually to generate positive and negative”
BackgroundMethodHuman Activity Recognition Using Inertial Sensors in a Smartphone: An Overview
Sousa Lima, W., Souto, E., El-Khatib, K., Jalali, R., & Gama, J. (2019) · Sensors · doi:10.3390/s19143213 · Cited by 256
“For example, Ord ó nez and Roggen [90] and Yao et al. [91] present examples of how to combine CNN and RNN.”
AI Benchmark: All About Deep Learning on Smartphones in 2019
Ignatov, A., Timofte, R., Kulik, A., Yang, S., Wang, K., Baum, F., Wu, M., Xu, L., & Van Gool, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00447 · Cited by 247
Machine Learning for Microcontroller-Class Hardware: A Review
Saha, S. S., Sandha, S. S., & Srivastava, M. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3210773 · Cited by 253
Leveraging Machine Learning and Big Data for Smart Buildings: A Comprehensive Survey
Qolomany, B., Al-Fuqaha, A., Gupta, A., Benhaddou, D., Alwajidi, S., Qadir, J., & Fong, A. C. (2019) · IEEE Access · doi:10.1109/access.2019.2926642 · Cited by 246
“The paper [115] proposes a generic deep learning framework based on convolutional and RNNs for human activity recognition that is suitable for multimodal wearable sensors,”
BackgroundA Deep Learning Framework for Assessing Physical Rehabilitation Exercises
Liao, Y., Vakanski, A., & Xian, M. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.2966249 · Cited by 246
“NN-based motion classifiers utilizing different computational units have been proposed, including convolutional units [19], [20], long short-term memory (LSTM) recurrent units [21], [22], gated recurrent units [23], and combinations [24] or modifications of these computational units [25].”
BackgroundDynamic Neural Network Modelling of Soil Moisture Content for Predictive Irrigation Scheduling
Adeyemi, O., Grove, I., Peets, S., Domun, Y., & Norton, T. (2018) · Sensors · doi:10.3390/s18103408 · Cited by 236
“They have been shown to achieve robust performance in modelling sequential data in fields such as natural language processing [52], time series classification of chaotic systems [53], and speech recognition [54].”
BackgroundAccelerometer-Based Human Fall Detection Using Convolutional Neural Networks
Santos, G. L., Endo, P. T., Monteiro, K. H. D. C., Rocha, E. D. S., Silva, I., & Lynn, T. (2019) · Sensors · doi:10.3390/s19071644 · Cited by 232
“The output of these gates are based on component-wise multiplication of the input [7].”
BackgroundCNN-based sensor fusion techniques for multimodal human activity recognition
Münzner, S., Schmidt, P., Reiss, A., Hanselmann, M., Stiefelhagen, R., & Dürichen, R. (2017) · Proceedings of the 2017 ACM International Symposium on Wearable Computers · doi:10.1145/3123021.3123046 · Cited by 235
khan, Z. F., & Alotaibi, S. R. (2020) · Journal of Healthcare Engineering · doi:10.1155/2020/8894694 · Cited by 235
Chae, S. H., Kim, Y., Lee, K.-S., & Park, H.-S. (2020) · JMIR mHealth and uHealth · doi:10.2196/17216 · Cited by 235
Hand Gesture Recognition for Sign Language Using 3DCNN
Al-Hammadi, M., Muhammad, G., Abdul, W., Alsulaiman, M., Bencherif, M. A., & Mekhtiche, M. A. (2020) · IEEE Access · doi:10.1109/access.2020.2990434 · Cited by 232
“The memory state and output of an LSTM unit are updated at each time step [34].”
BackgroundMultiscale Deep Feature Learning for Human Activity Recognition Using Wearable Sensors
Tang, Y., Zhang, L., Min, F., & He, J. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2022.3161812 · Cited by 224
“To ensure fair comparisons, we utilize the same values used in the literature [5], where sensor time series are divided into 500-ms windows that have an 50% overlap rate.”
BackgroundMethodInfluentialDeep learning for diagnosis and classification of faults in industrial rotating machinery
Souza, R. M., Nascimento, E. G. S., Miranda, U. A., Silva, W. J. D., & Lepikson, H. A. (2021) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.107060 · Cited by 221
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Electronics · doi:10.3390/electronics10030308 · Cited by 219
Learning representations for the early detection of sepsis with deep neural networks
Kam, H. J., & Kim, H. Y. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.08.015 · Cited by 218
Wearable-Based Affect Recognition—A Review
Schmidt, P., Reiss, A., Dürichen, R., & Laerhoven, K. V. (2019) · Sensors · doi:10.3390/s19194079 · Cited by 218
“From a methodical point of view CNN offer interesting approaches to transfer [187] or semi-supervised [188] learning.”
BackgroundChung, S., Lim, J., Noh, K. J., Kim, G., & Jeong, H. (2019) · Sensors · doi:10.3390/s19071716 · Cited by 215
“Thus, LSTM network model is renowned for its performance on HAR domains [32].”
BackgroundDanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensors
Gao, W., Zhang, L., Teng, Q., He, J., & Wu, H. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107728 · Cited by 214
Bouchabou, D., Nguyen, S. M., Lohr, C., LeDuc, B., & Kanellos, I. (2021) · Sensors · doi:10.3390/s21186037 · Cited by 210
“Every resident has different lifestyles, habits, or abilities.”
BackgroundWang, K., He, J., & Zhang, L. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2917225 · Cited by 206
“We compared the experimental results of our attention model, the fundamental CNN model, and two classical deep learning models [26] on the UCI HAR Dataset in the metrics of classification accuracy.”
BackgroundMethodResultInfluentialDeep Learning to Predict Falls in Older Adults Based on Daily-Life Trunk Accelerometry
Nait Aicha, A., Englebienne, G., Van Schooten, K. S., Pijnappels, M., & Kröse, B. (2018) · Sensors · doi:10.3390/s18051654 · Cited by 207
“We did not compare our approach with other work done on different tasks such as activity recognition [16] or age-related differences in walking [17].”
BackgroundResultDeep Learning for Hand Gesture Recognition on Skeletal Data
Devineau, G., Moutarde, F., Xi, W., & Yang, J. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00025 · Cited by 203
Kumar, P., Chauhan, S., & Awasthi, L. K. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09986-x · Cited by 206
“Activity recognition with data from multiple wearable sensors is proposed in [147], where a convolutional neural network (CNN) and long short-term memory model (LSTM) are suggested.”
Deep ConvLSTM With Self-Attention for Human Activity Decoding Using Wearable Sensors
Singh, S. P., Sharma, M. K., Lay-Ekuakille, A., Gangwar, D., & Gupta, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3045135 · Cited by 199
“We therefore reduce the number of trainable parameters by modifying the number of CNN and RNN layers in the model presented in[31] for an unbiased comparison.”
BackgroundMethodInfluentialDriver stress detection via multimodal fusion using attention-based CNN-LSTM
Mou, L., Zhou, C., Zhao, P., Nakisa, B., Rastgoo, M. N., Jain, R., & Gao, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114693 · Cited by 198
Namuduri, S., Narayanan, B. N., Davuluru, V. S. P., Burton, L., & Bhansali, S. (2020) · Journal of The Electrochemical Society · doi:10.1149/1945-7111/ab67a8 · Cited by 195
Convolutional Neural Networks for Human Activity Recognition Using Body-Worn Sensors
Moya Rueda, F., Grzeszick, R., Fink, G. A., Feldhorst, S., & Ten Hompel, M. (2018) · Informatics · doi:10.3390/informatics5020026 · Cited by 196
“This architecture was introduced in a previous work [11] based on the CNN and deepConvLSTM presented in [4,5,9].”
BackgroundMethodInfluentialSensor-Based Gait Parameter Extraction With Deep Convolutional Neural Networks
Hannink, J., Kautz, T., Pasluosta, C. F., Gasmann, K.-G., Klucken, J., & Eskofier, B. M. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636456 · Cited by 193
Hybrid deep neural model for hourly solar irradiance forecasting
Huang, X., Li, Q., Tai, Y., Chen, Z., Zhang, J., Shi, J., Gao, B., & Liu, W. (2021) · Renewable Energy · doi:10.1016/j.renene.2021.02.161 · Cited by 192
Jin, X., Jie, L., Wang, S., Qi, H., & Li, S. (2018) · Remote Sensing · doi:10.3390/rs10030395 · Cited by 191
“…DCRNN can learn better image representation, because the convolutional layers act as feature extractors and provide abstract representations of the input data in feature maps, and the recurrent neural networks are designed to learn contextual dependencies by using the recurrent connections [50,51].”
BackgroundDeep Learning Intervention for Health Care Challenges: Some Biomedical Domain Considerations
Tobore, I., Li, J., Yuhang, L., Al-Handarish, Y., Kandwal, A., Nie, Z., & Wang, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/11966 · Cited by 180
Attention induced multi-head convolutional neural network for human activity recognition
Khan, Z. N., & Ahmad, J. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107671 · Cited by 187
Metadata
- Authors
- Ordóñez, F., & Roggen, D.
- Affiliations
- University of Sussex (GB)
- Corresponding author
- Ordóñez, Francisco
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2016-01-18
- Volume
- 16
- Issue
- 1
- Pages
- 115
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC4732148
- OpenAlex
- W2270470215
- Cited by
- 2,761
- References
- 49
- Citations by year
- 2026: 284 · 2025: 256 · 2024: 284 · 2023: 270 · 2022: 319 · 2021: 379 · 2020: 347 · 2019: 288 · 2018: 219 · 2017: 93 · 2016: 21
- FWCI
- 140.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Sussex Research Online (University of Sussex) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Google Faculty Research Award (Is deep learning useful for wearable activity recognition?)
- EPSRC (EP/N007816/1)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- human activity recognition, wearable sensors, multimodal sensor fusion, convolutional neural networks, LSTM neural network, temporal dynamics, automatic feature extraction, hyperparameter optimization
- MeSH terms
- Machine Learning, Clothing, Humans, Human Activities, Signal Processing, Computer-Assisted, Databases, Factual, Neural Networks, Computer, Monitoring, Ambulatory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.