Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index; 5 of the 32 sources its claims cite were checked for support.
Abstract
In this paper, we perform a systematic study about the on-body sensor positioning and data acquisition details for Human Activity Recognition (HAR) systems. We build a testbed that consists of eight body-worn Inertial Measurement Units (IMU) sensors and an Android mobile device for activity data collection. We develop a Long Short-Term Memory (LSTM) network framework to support training of a deep learning model on human activity data, which is acquired in both real-world and controlled environments. From the experiment results, we identify that activity data with sampling rate as low as 10 Hz from four sensors at both sides of wrists, right ankle, and waist is sufficient in recognizing Activities of Daily Living (ADLs) including eating and driving activity. We adopt a two-level ensemble model to combine class-probabilities of multiple sensor modalities, and demonstrate that a classifier-level sensor fusion technique can improve the classification performance. By analyzing the accuracy of each sensor on different types of activity, we elaborate custom weights for multimodal sensor fusion that reflect the characteristic of individual activities.
Overview
CoChat Summary
TL;DR
The paper builds an eight-IMU testbed and LSTM framework to study on-body sensor placement, sampling rate, and multimodal fusion for human activity recognition. It finds that 10 Hz data from four sensors—both wrists, right ankle, and waist—is sufficient for ADLs, and classifier-level fusion improves recognition accuracy up to 94.47%.
Key findings
- Activity data with sampling rate as low as 10 Hz from four sensors at both wrists, right ankle, and waist was sufficient for recognizing ADLs including eating and driving; a 2.5 s sliding window outperformed other settings, with 25 samples covering 2.5 s.
- The four-sensor baseline achieved 93.0% recognition accuracy. Among three-sensor combinations, right wrist, right ankle, and waist was most competitive; with two sensors, placing one on the upper half and one on the lower half performed better than both on the upper or both on the lower half. Right wrist tended to outperform left wrist, and right ankle played a more critical role than waist.
- Single-modality accuracy was 92.18% for accelerometer, 85.22% for magnetometer, and 78.33% for gyroscope. Multimodal fusion reached up to 93.07% with stacking/voting, while soft-voting achieved 94.47% versus hard-voting at 93.48%, a 2.48% improvement over single-modal recognition.
- Activity-specific weights increased accuracy by 7.65% for walking upstairs and 36.97% for walking downstairs. Static activities were best detected by accelerometer, and fusing additional sensors could degrade sitting/standing accuracy; stair walking was often confused with plain walking.
Methods
- A testbed with eight body-worn IMU sensors (MPU-9250) and an Android mobile device collected data from five researchers (two males, three females; ages 34–48; heights 160–175 cm; all right-handed) over three workdays, about three hours per subject, in real-world and controlled environments. Final configuration used four sensors on left/right wrist, right ankle, and waist.
- Raw sensor data were fed to an LSTM network with a 2.5 s sliding window and 50% overlap; parameters included batch size 150, one stacked LSTM layer, hidden neuron size 32, 25 steps, and keep probability 0.8. Evaluation used 10-fold cross-validation and leave-one-subject-out cross-validation with jittering data augmentation.
- Sensor fusion used classifier-level two-level ensembles: LSTM base learners per modality, stacking with Random Forest/kNN/SVM meta-learners (Random Forest adopted), and soft/hard voting with weights based on sensor accuracy or activity-specific characteristics.
Limitations
- The paper states that experiments used a small number of test subjects within the institution, that the meta-learner was evaluated only with classical algorithms (RF, kNN, SVM), and that future work should include large-scale/long-term experiments, additional sensing modalities, and online weight learning.
- Evident from the text: the pilot involved only five right-handed subjects with limited demographic variation, gyroscope data were used without calibration, and stair walking versus plain walking produced equivocal results.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
4 Valid · 0 Not valid · 13 Not checked · 50 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Authors of [18] surveyed ADLs and their occurrence in public HAR datasets, and we find that six primitive activity labels including walking, standing, sitting, lying, walking upstairs, and walking downstairs can cover daily activities listed in time-use survey results.”
§ Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning > 3. Testbed and Data Acquisition > 3.2. ADLs
What the sources say
- Not checked yetcites [37] (2019, April 09). The General Social Survey—Statistics Canada, Available online: https://www150.statcan.gc.ca/n1/pub/89f0115x/89f0115x2013001-eng.htm.
- Not checked yetcites [38] (2019, April 09). The time use Survey—Statistics Korea, Available online: http://kostat.go.kr/portal/eng/pressReleases/11/6/index.board.
- Supportedcites [18] Micucci, D., Mobilio, M., and Napoletano, P. (2017). UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones. Appl. Sci., 7. source
Section 2.2 states that the authors analyzed ADLs across 24 publicly available datasets, and Figure 1 shows their occurrence in those datasets. The six-label coverage of time-use survey results is explicitly framed as the citing authors’ own finding, not a finding attributed to this source. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, as the dataset adopts heterogeneous sensors on limited position of the human body, it is not sufficient to evaluate the recognition performance according to the sensor position and sampling rate.”
§ Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning > 2. Related Work > 2.2. Mobile Sensing and Public Datasets
What the sources say
- Partly supportedcites [15] Vaizman, 2017, Recognizing Detailed Human Context in the Wild from Smartphones and Smartwatches, IEEE Pervasive Comput. sourceExperimental — accuracy not yet measured
Our copy supports the descriptive premise: the dataset is built from a phone app plus a companion Pebble smartwatch, with heterogeneous sensors sampled at different rates (Table 2, 'Sensor measurements' / 'EVALUATION AND RESULTS': accelerometer/gyro/magnetometer 40Hz, watch accelerometer 25Hz, compass and location variable, audio 22,050Hz reduced to MFCC), and body placement is limited to the wrist watch (DATA COLLECTION: 'the majority of the subjects (93%) were right handed, and chose to wear the smartwatch on their left wrist') plus the subjects' own phone in unconstrained positions. However, no passage states or argues that the dataset is insufficient to evaluate recognition performance as a function of sensor position or sampling rate; the paper instead treats unconstrained device placement as a desired in-the-wild condition to be overcome (Related work) and evaluates sensor modality/fusion, not position or sampling-rate effects (Performance evaluation; Fig. 3). That insufficiency conclusion is the citing authors' own inference, so only part of what is attributed to this source is in it. (LLM, conf=0.68)
- Not checked yetcites [16] Vaizman, Y., Ellis, K., Lanckriet, G., and Weibel, N. (2018, January 21–26). ExtraSensory App: Data Collection In-the-Wild with Rich User Interface to Self-Report Behavior. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18), Montreal QC, Canada. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From the experiment results, we identify that activity data with sampling rate as low as 10 Hz from four sensors at both sides of wrists, right ankle, and waist is sufficient in recognizing Activities of Daily Living (ADLs) including eating and driving activity.”
§ Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We adopt a two-level ensemble model to combine class-probabilities of multiple sensor modalities, and demonstrate that a classifier-level sensor fusion technique can improve the classification performance.”
§ Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning > Abstract
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Participants experienced significant discomfort incurred by the sensor on the chest; we dropped the chest sensor in the final testbed configuration for its feasibility.”
§ Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning > 3. Testbed and Data Acquisition > 3.4. Final Testbed Configuration
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
41 more claims
Create a free account to see all 67 claims and to verify the 27 references still open.
- Probably not a substantial claim. 9
- It may state two separate claims as one. 12
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, due to the lack of proper filtration and feature extraction techniques applied, the system was not able to recognize the ADL correctly.”
From A Multimodal IoT-Based Locomotion Classification System Using Features Engineering and Recursive Neural Network (2023) · cites this paper as [17]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In sensor-based HAR leveraging the temporal nature of IMU signals allows for the application of augmentation methods grounded in signal processing [32,34,99,132,141,178,193].”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [34]
Experimental — accuracy not yet measured
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×
“As a variation of RNN architecture, LSTM [25] network is renowned for its capability to learn long-term dependencies in time-series data by the selective forget-and-update procedure.”
BackgroundMethodA systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515 · cited 1×
“On the other hand, macro-averaging F1-score is a harmonic mean of precision and recall measures, and takes both false positives and false negatives into account based on a per-class average [42].”
BackgroundDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“Thus, LSTM network model is renowned for its performance on HAR domains [32].”
BackgroundDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 1×
“Besides the body-worn sensors, object sensors such as Radio Frequency Identifier (RFID) tags are widely used to infer human activities based on the movements detected in smart home environments [27].”
Background(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 1×
“Previous work in the HAR literature empirically adopted 5.12 s-long window size [35,39].”
InfluentialThe Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742 · cited 1×
“Human activity recognition has been investigated using various sensor modalities [26].”
BackgroundUm, T. T., Pfister, F. M. J., Pichler, D., Endo, S., Lang, M., Hirche, S., Fietzek, U., & Kulić, D. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136817 · Cited by 729 · cited 1×
“We apply the jittering method to simulate additive sensor noise using random parameters as described in [47] for label-preserving augmentation.”
MethodUnobtrusive Sensing and Wearable Devices for Health Informatics
Zheng, Y.-L., Ding, X.-R., Poon, C. C. Y., Lo, B. P. L., Zhang, H., Zhou, X.-L., Yang, G.-Z., Zhao, N., & Zhang, Y.-T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2309951 · Cited by 722
Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676 · cited 2×
“In this paper, we adopt a deep neural network architecture to recognize human activity from raw data input, which has shown promising results when adopted for interpreting human activities without complex data pre-processing for feature extraction [21–23].”
MethodUm, T. T. (n.d.) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 602
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v2 · Cited by 596
Deep Recurrent Neural Networks for Human Activity Recognition
Murad, A., & Pyun, J.-Y. (2017) · Sensors · doi:10.3390/s17112556 · Cited by 524 · cited 1×
“Papers [33,34] also compared deep-learning methods for HAR, and verified that variants of the LSTM architecture lead to flexible and robust results in several sensor-based HAR datasets.”
MethodOptimal Placement of Accelerometers for the Detection of Everyday Activities
Cleland, I., Kikhia, B., Nugent, C., Boytsov, A., Hallberg, J., Synnes, K., McClean, S., & Finlay, D. (2013) · Sensors · doi:10.3390/s130709183 · Cited by 401 · cited 2×
“Previous works in HAR literature rely on predictive modeling approaches used in statistics and stochastic process [19,20] (e.g., decision tree, kNN, SVM).”
BackgroundMethodRobust human activity recognition from depth video using spatiotemporal multi-fused features
Jalal, A., Kim, Y.-H., Kim, Y.-J., Kamal, S., & Kim, D. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.08.003 · Cited by 384 · cited 1×
“Although activity recognition has been investigated to a great extent in computer vision area [10–12], the application is limited to a certain scenario that equips pre-installed cameras with sufficient resolution and guaranteed angle of view.”
BackgroundA Deep Learning Approach to Human Activity Recognition Based on Single Accelerometer
Chen, Y., & Xue, Y. (2015) · 2015 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.263 · Cited by 378 · cited 1×
“Thus, raw sensor data is directly fed into LSTM cells for offline activity classification with no additional feature engineering [22,23].”
MethodData Augmentation for Deep Neural Network Acoustic Modeling
Cui, X., Goel, V., & Kingsbury, B. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2015.2438544 · Cited by 376
Sensor Positioning for Activity Recognition Using Wearable Accelerometers
Atallah, L., Lo, B., King, R., & Yang, G.-Z. (2011) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2011.2160540 · Cited by 346 · cited 2×
“Previous works in HAR literature rely on predictive modeling approaches used in statistics and stochastic process [19,20] (e.”
BackgroundMethodFeature Selection and Activity Recognition System Using a Single Triaxial Accelerometer
Gupta, P., & Dallas, T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2307069 · Cited by 335 · cited 1×
“Selecting optimal placement of sensors on different body positions has been widely studied for various purposes of activity recognition that range from gait monitoring or fall detection for elderly subjects to daily living activities of healthy subjects usually with no impairments [29].”
BackgroundRecognizing Detailed Human Context in the Wild from Smartphones and Smartwatches
Vaizman, Y., Ellis, K., & Lanckriet, G. (2017) · IEEE Pervasive Computing · doi:10.1109/mprv.2017.3971131 · Cited by 324
Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors
Li, F., Shirahama, K., Nisar, M., Köping, L., & Grzegorzek, M. (2018) · Sensors · doi:10.3390/s18020679 · Cited by 302
Jalal, A., Kamal, S., & Kim, D. (2014) · Sensors · doi:10.3390/s140711735 · Cited by 244
MoCap-guided Data Augmentation for 3D Pose Estimation in the Wild
Rogez, G., & Schmid, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02046 · Cited by 210
A Bayesian Data Augmentation Approach for Learning Deep Models
Tran, T. B., Pham, T. T., Carneiro, G., Palmer, L. J., & Reid, I. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10564 · Cited by 180 · cited 1×
“We also perform leave-one-subject-out (LOSO) cross-validation for reference by leveraging data augmentation [43–46], which is widely adopted in the deep learning research that requires large dataset for model training.”
MethodSynthetic Sensors: Towards General-Purpose Sensing
Laput, G., Zhang, Y., & Harrison, C. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025773 · Cited by 163
Towards multimodal deep learning for activity recognition on mobile devices
Radu, V., Lane, N. D., Bhattacharya, S., Mascolo, C., Marina, M. K., & Kawsar, F. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct · doi:10.1145/2968219.2971461 · Cited by 147 · cited 2×
“In this paper, we adopt a deep neural network architecture to recognize human activity from raw data input, which has shown promising results when adopted for interpreting human activities without complex data pre-processing for feature extraction [21–23].”
BackgroundMethodAnalysis of human behavior recognition algorithms based on acceleration data
Bruno, B., Mastrogiovanni, F., Sgorbissa, A., Vernazza, T., & Zaccaria, R. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6630784 · Cited by 134 · cited 1×
“On the other hand, wearable sensor approach allows continuous sensing during daily activities without spatio-temporal limitation [13,14], since devices are ubiquitous and do not require infrastructural support.”
BackgroundExtraSensory App: Data Collection In-the-Wild with Rich User Interface to Self-Report Behavior
Vaizman, Y., Ellis, K., Lanckriet, G., & Weibel, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174128 · Cited by 115
Robust Biometric Recognition From Palm Depth Images for Gloved Hands
Nguyen, B. P., Tay, W.-L., & Chui, C. (2015) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2015.2453203 · Cited by 112 · cited 1×
“We plan to implement more classification algorithms with enhanced performance [50], and also extend our meta-learner using deep learning models to improve the recognition accuracy.”
MethodWearable Sensor-Based Behavioral Anomaly Detection in Smart Assisted Living Systems
Zhu, C., Sheng, W., & Liu, M. (2015) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2015.2474743 · Cited by 102 · cited 1×
“On the other hand, wearable sensor approach allows continuous sensing during daily activities without spatio-temporal limitation [13,14], since devices are ubiquitous and do not require infrastructural support.”
BackgroundKernel fusion based extreme learning machine for cross-location activity recognition
Wang, Z., Wu, D., Gravina, R., Fortino, G., Jiang, Y., & Tang, K. W. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.01.004 · Cited by 98
Guo, H., Chen, L., Peng, L., & Chen, G. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971708 · Cited by 83 · cited 2×
“Using a single feature vector for the training model is straightforward, but feature compatibility issues regarding heterogeneous sampling frequencies and configuration parameters can deteriorate the classifier performance [35].”
BackgroundInfluentialBody Surface Context: A New Robust Feature for Action Recognition From Depth Videos
Song, Y., Tang, J., Liu, F., & Yan, S. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2302558 · Cited by 70 · cited 1×
“…human activity leads to a deep understanding of individuals’ activity patterns or long-term habits, which contributes to developing a wide range of user-centric applications such as human-computer interaction [1,2], surveillance [3,4], video streaming [5,6], AR/VR [7], and healthcare systems [8,9].”
BackgroundMathur, A., Zhang, T., Bhattacharya, S., Velickovic, P., Joffe, L., Lane, N. D., Kawsar, F., & Lio, P. (2018) · 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2018.00048 · Cited by 70 · cited 1×
“We also perform leave-one-subject-out (LOSO) cross-validation for reference by leveraging data augmentation [43–46], which is widely adopted in the deep learning research that requires large dataset for model training.”
MethodEmpirical Study and Improvement on Deep Transfer Learning for Human Activity Recognition
Ding, R., Li, X., Nie, L., Li, J., Si, X., Chu, D., Liu, G., & Zhan, D. (2018) · Sensors · doi:10.3390/s19010057 · Cited by 63 · cited 1×
“Deep learning model is renowned for its feature learning ability through neural networks, which accepts a large amount of raw data for training and identify unseen data through knowledge transfer methods [31].”
BackgroundStep accumulation per minute epoch is not the same as cadence for free-living adults
DALL, P. M., MCCRORIE, P. R. W., GRANAT, M. H., & STANSFIELD, B. W. (2013) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3182955780 · Cited by 62
Motion Capture of the Human Body Using Multiple Depth Sensors
Kim, Y., Baek, S., & Bae, B.-C. (2017) · ETRI Journal · doi:10.4218/etrij.17.2816.0045 · Cited by 61
Complex Activity Recognition Using Acceleration, Vital Sign, and Location Data
Peng, L., Chen, L., Wu, M., & Chen, G. (2018) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2863292 · Cited by 37 · cited 1×
“As class-probability predictions are uniform in their expression, classifier-level ensemble learning techniques are widely adopted to integrate multiple machine learning models [34–36].”
BackgroundJoint Camera Pose Estimation and 3D Human Pose Estimation in a Multi-camera Setup
Puwein, J., Ballan, L., Ziegler, R., & Pollefeys, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16808-1_32 · Cited by 36
Optimizing the Multiclass F-Measure via Biconcave Programming
Narasimhan, H., Pan, W., Kar, P., Protopapas, P., & Ramaswamy, H. G. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0143 · Cited by 29 · cited 1×
“F1-score is a commonly used measure in the class imbalanced settings [41].”
MethodIn situ spatial AR surgical planning using projector-Kinect system
Wen, R., Nguyen, B. P., Chng, C.-B., & Chui, C. (2013) · International Symposium on Information and Communication Technology · doi:10.1145/2542050.2542060 · Cited by 28
Human-like sign-language learning method using deep learning
Ji, Y., Kim, S., Kim, Y.-J., & Lee, K.-B. (2018) · ETRI Journal · doi:10.4218/etrij.2018-0066 · Cited by 18
Ilbeygi, M., & Kangavari, M. R. (2018) · ETRI Journal · doi:10.4218/etrij.2017-0294 · Cited by 14 · cited 1×
“…human activity leads to a deep understanding of individuals’ activity patterns or long-term habits, which contributes to developing a wide range of user-centric applications such as human-computer interaction [1,2], surveillance [3,4], video streaming [5,6], AR/VR [7], and healthcare systems [8,9].”
BackgroundSensor Positioning and Data Acquisition for Activity Recognition using Deep Learning
Chung, S., Lim, J., Noh, K. J., Kim, G. G., & Jeong, H. T. (2018) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc.2018.8539473 · Cited by 13 · cited 1×
“This paper presents a preliminary study of investigating optimal position of sensors and their data acquisition details [24] by adopting deep learning algorithm for HAR.”
BackgroundSelf-citationSowmiya, D., & Palanisamy, A. (2018) · ETRI Journal · doi:10.4218/etrij.2018-0102 · Cited by 10 · cited 1×
“Recognizing human activity leads to a deep understanding of individuals’ activity patterns or long-term habits, which contributes to developing a wide range of user-centric applications such as human-computer interaction [1,2], surveillance [3,4], video streaming [5,6], AR/VR [7], and healthcare systems [8,9].”
BackgroundKim, D., Rodríguez, S., Matson, E. T., & Kim, G. J. (2018) · ETRI Journal · doi:10.4218/etrij.18.3018.0000 · Cited by 10 · cited 1×
“…human activity leads to a deep understanding of individuals’ activity patterns or long-term habits, which contributes to developing a wide range of user-centric applications such as human-computer interaction [1,2], surveillance [3,4], video streaming [5,6], AR/VR [7], and healthcare systems [8,9].”
BackgroundSelf-citationExtensible Hierarchical Method of Detecting Interactive Actions for Video Understanding
Moon, J., Jin, J.-H., Kwon, Y., Kang, K., Park, J., & Park, K. (2017) · ETRI Journal · doi:10.4218/etrij.17.0116.0054 · Cited by 7
Cited by
Lee, L.-H., Braud, T., Zhou, P. Y., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2024) · Foundations and Trends® in Human-Computer Interaction · doi:10.1561/1100000095 · Cited by 1,082
Lee, L.-H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2021) · arXiv · doi:10.48550/arxiv.2110.05352 · Cited by 1,088
Ali, F., El-Sappagh, S., Islam, S. M. R., Kwak, D., Ali, A., Imran, M., & Kwak, K.-S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.008 · Cited by 818
Ramanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455
“Chung et al. [45] have performed a pilot study with 15 participants about the on-body sensor positioning system.”
BackgroundDemrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368
“The second most used model was the Long Short-TermMemory (LSTM) model, which was used in 17 papers [7], [83], [89], [102], [107], [112], [125], [130], [137], [139], [152], [153], [172],”
Method
Metadata
- Authors
- Chung, S., Lim, J., Noh, K. J., Kim, G., & Jeong, H.
- Affiliations
- Electronics and Telecommunications Research Institute (KR)
- Corresponding author
- Chung, Seungeun
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2019-04-10
- Volume
- 19
- Issue
- 7
- Pages
- 1716
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC6479605
- OpenAlex
- W2940096514
- Cited by
- 215
- References
- 48
- Citations by year
- 2026: 22 · 2025: 33 · 2024: 35 · 2023: 36 · 2022: 31 · 2021: 32 · 2020: 21 · 2019: 5
- FWCI
- 9.94
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Electronics and Telecommunications Research Institute
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, inertial measurement unit, multimodal sensor fusion, ensemble learning, LSTM networks, activities of daily living, sampling frequency, sensor placement, eating
- MeSH terms
- Wearable Electronic Devices, Deep Learning, Standing Position, Activities of Daily Living, Algorithms, Automobile Driving, Humans, Human Activities, Monitoring, Physiologic, Biosensing Techniques, Walking, Multimodal Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.