A-Wristocracy: Deep learning on wrist-worn sensing for recognition of user complex activities
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
In this work we present A-Wristocracy, a novel framework for recognizing very fine-grained and complex inhome activities of human users (particularly elderly people) with wrist-worn device sensing. Our designed A-Wristocracy system improves upon the state-of-the-art works on in-home activity recognition using wearables. These works are mostly able to detect coarse-grained ADLs (Activities of Daily Living) but not large number of fine-grained and complex IADLs (Instrumental Activities of Daily Living). These are also not able to distinguish similar activities but with different context (such as sit on floor vs. sit on bed vs. sit on sofa). Our solution helps accurate detection of in-home ADLs/ IADLs and contextual activities, which are all critically important for remote elderly care in tracking their physical and cognitive capabilities. A-Wristocracy makes it feasible to classify large number of fine-grained and complex activities, through Deep Learning based data analytics and exploiting multi-modal sensing on wrist-worn device. It exploits minimal functionality from very light additional infrastructure (through only few Bluetooth beacons), for coarse level location context. A-Wristocracy preserves direct user privacy by excluding camera/ video imaging on wearable or infrastructure. The classification procedure consists of practical feature set extraction from multi-modal wearable sensor suites, followed by Deep Learning based supervised fine-level classification algorithm. We have collected exhaustive home-based ADLs and IADLs data from multiple users. Our designed classifier is validated to be able to recognize very fine-grained complex 22 daily activities (much larger number than 6-12 activities detected by state-of-the-art works using wearable and no camera/ video) with high average test accuracies of 90% or more for two users in two different home environments.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The results showed an excellent effect, but the model converged hardly, causing a lot of time to be wasted in the training stage.”
From LSTM-CNN Architecture for Human Activity Recognition (2020) · cites this paper as [29]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2014) · Cited by 33,419
(2016) · Cited by 11,679
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 8×
“In this work we have proposed and designed A-Wristocracy, an innovative multi-modal sensing and Deep Learning Neural Network based data analytics on wrist-worn wearable device, for fine-grained and complex in-home ADL/ IADL recognition.”
MethodInfluentialA systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515 · cited 1×
“performance measures for classification as defined in [11].”
BackgroundLearning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147 · cited 1×
“…the proposed and designed A-Wristocracy in-home activity classifier consists of pipeline of following phases: (i) sliding window based data pre-processing followed by feature extraction on each of the sensor datastreams; (ii) Deep Learning Neural Network based classification with parameter tuning.”
MethodDetecting activities of daily living in first-person camera views
Pirsiavash, H., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248010 · Cited by 649 · cited 1×
“…the proposed and designed A-Wristocracy in-home activity classifier consists of pipeline of following phases: (i) sliding window based data pre-processing followed by feature extraction on each of the sensor datastreams; (ii) Deep Learning Neural Network based classification with parameter tuning.”
MethodHow smart are our environments? An updated look at the state of the art
Cook, D. J., & Das, S. K. (2007) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2006.12.001 · Cited by 589 · cited 1×
“Relevant works on multi-sensor fusion and context-awareness in Smart Environments include [10], [6].”
BackgroundSelf-citationSpector, W. D., Katz, S., Murphy, J. B., & Fulton, J. P. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90004-x · Cited by 565 · cited 1×
“But the more important drawback is that most of the works are able to recognize only basic coarse-grained ADLs (Activities of Daily Living), while very few complex IADLs (instrumental activities of daily living) [14].”
BackgroundFeature Selection and Activity Recognition System Using a Single Triaxial Accelerometer
Gupta, P., & Dallas, T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2307069 · Cited by 335 · cited 1×
“[7] Belt-clip accelerometer None 6 activities: walking, jumping, running, sit to-stand/stand-to-sit, stand-to-kneelto-stand, and being stationary K.”
Simultaneous Tracking and Activity Recognition (STAR) Using Many Anonymous, Binary Sensors
Wilson, D. H., & Atkeson, C. (2005) · Lecture Notes in Computer Science · doi:10.1007/11428572_5 · Cited by 314 · cited 1×
“[15] None Motion detectors, break-beam sensors, pressure mats, and contact switches Room-level tracking and basic activities such as sleeping in bed, user movement status”
BackgroundRecognizing multi-user activities using wearable sensors in a smart home
Wang, L., Gu, T., Tao, X., Chen, H., & Lü, J. (2010) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2010.11.008 · Cited by 182
Cross-people mobile-phone based activity recognition
Zhao, Z., Chen, Y., Liu, J., Shen, Z., & Liu, M. (2011) · doi:10.5591/978-1-57735-516-8/ijcai11-423 · Cited by 134
NuActiv: recognizing unseen new activities using semantic attribute-based learning
Cheng, H.-T., Sun, F.-T., Griss, M., Davis, P., Li, J., & You, D. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464438 · Cited by 117 · cited 1×
“…the proposed and designed A-Wristocracy in-home activity classifier consists of pipeline of following phases: (i) sliding window based data pre-processing followed by feature extraction on each of the sensor datastreams; (ii) Deep Learning Neural Network based classification with parameter tuning.”
MethodComplex activity recognition using context-driven activity theory and activity signatures
Saguna, S., Zaslavsky, A., & Chakraborty, D. (2013) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2490832 · Cited by 103
Multi-scale Conditional Random Fields for first-person activity recognition
Zhan, K., Faux, S. G., & Ramos, F. T. (2014) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2014.6813944 · Cited by 55 · cited 2×
“[13], [16], [17]), (ii) only with static infrastructure based systems in physical environment (e.”
BackgroundInfrastructure-assisted smartphone-based ADL recognition in multi-inhabitant smart environments
Roy, N., Misra, A., & Cook, D. J. (2013) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2013.6526712 · Cited by 52
An energy-efficient quality adaptive framework for multi-modal sensor context recognition
Roy, N., Misra, A., Julien, C., Das, S. K., & Biswas, J. (2011) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2011.5767596 · Cited by 41
Self-citation
Research works printed but not linked: 1
- 0, H2o package in r
Cited by
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
“For multi-modal signals, it is better to use CNN since (Bhattacharya and Lane, 2016) Body-worn, ambiemt RBM Gesture, ADL, transportation Self, D01 (Chen and Xue, 2015) Body-worn CNN ADL Self (Chen et al., 2016b) Body-worn CNN ADL D06 (Edel and K¨oppe, 2016) Body-worn RNN ADL D01, D04, Self (Fang and Hu, 2014) Object,…”
BackgroundMethodInfluentialNweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
LSTM-CNN Architecture for Human Activity Recognition
Xia, K., Huang, J., & Wang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982225 · Cited by 851
“Hitherto, this technology has been widely used in the fields of home behavior analysis [2], video surveillance [3], gait analysis [4], and gesture recognition [5], etc.”
MethodDeep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“mean/variance [142] -simple -coarse -unsatisfactory performance”
BackgroundA survey on wearable sensor modality centred human activity recognition in health care
Wang, Y., Cang, S., & Yu, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.04.057 · Cited by 409
Metadata
- Authors
- Vepakomma, P., De, D., Das, S. K., & Bhansali, S.
- Affiliations
- Motorola (United States) (US)
- Missouri University of Science and Technology (US)
- Florida International University (US)
- Venue
- 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 1-6
- ISSN
- 2376-8886 (ISSN-L)
- OpenAlex
- W1923002919
- Cited by
- 136
- References
- 19
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 13 · 2023: 19 · 2022: 16 · 2021: 23 · 2020: 23 · 2019: 16 · 2018: 14 · 2017: 3 · 2016: 1
- FWCI
- 2.43
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Wearable and Implantable Body Sensor Networks (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
- Keywords
- instrumental activities of daily living, activities of daily living, elderly care, Bluetooth beacons, location context, feature extraction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.