Multimodal Wearable Sensing for Fine-Grained Activity Recognition in Healthcare
Abstract
State-of-the-art in-home activity recognition schemes with wearable devices are mostly capable of detecting coarse-grained activities (sitting, standing, walking, or lying down), but can't distinguish complex activities (sitting on the floor versus the sofa or bed). Such schemes often aren't effective for emerging critical healthcare applications -- for example, in remote monitoring of patients with Alzheimer's disease, bulimia, or anorexia -- because they require a more comprehensive, contextual, and fine-grained recognition of complex daily user activities. Here, a novel approach for in-home, fine-grained activity recognition uses multimodal wearable sensors on multiple body positions, along with lightly deployed Bluetooth beacons in the environment. In particular, this solution exploits measuring user's ambient environment and location context with wearable sensing and Bluetooth beacons, along with user movement captured with accelerometer and gyroscope sensors. The proposed algorithm is a two-level supervised classifier with both levels running on a server. In the first level, multisensor data from wearables on each body position are collected and analyzed using the proposed modified conditional random field (CRF)-based supervised activity classifier. The classified activity state from each of the wearables data are then fused for deciding the user's final activity state. Preliminary experimental results are presented on the classification of 19 complex daily activities of a user at home.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Prior multimodal systems that did not use hand-crafted features had low accuracy.
“Though the system did not use any hand-crafted features, resulting in low accuracy”
From A Multimodal IoT-Based Locomotion Classification System Using Features Engineering and Recursive Neural Network (2023) · cites this paper as [16]
Cites
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,953 · see citing works
Review of the prevalence and incidence of eating disorders
Hoek, H. W., & van Hoeken, D. (2003) · International Journal of Eating Disorders · doi:10.1002/eat.10222 · Cited by 1,464 · see citing works
Spector, W. D., Katz, S., MURPHY, J. B., & Fulton, J. P. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90004-x · Cited by 565 · see citing works
Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer
Gupta, P., & Dallas, T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2307069 · Cited by 335 · see citing works
Multi-scale Conditional Random Fields for first-person activity recognition
Zhan, K., Faux, S. G., & Ramos, F. T. (2014) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2014.6813944 · Cited by 53 · see citing works
Infrastructure-assisted smartphone-based ADL recognition in multi-inhabitant smart environments
Roy, N., Misra, A., & Cook, D. J. (2013) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2013.6526712 · Cited by 47 · see citing works
The Complete Guide to Alzheimer's Proofing Your Home
Warner, M. L. (1998) · Medical Entomology and Zoology · Cited by 29 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Wearable Sensors for Remote Health Monitoring
Majumder, S., Mondal, T., & Deen, M. (2017) · Sensors · doi:10.3390/s17010130 · Cited by 1,375 · see citing works
Demrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368 · see citing works
Mental health monitoring with multimodal sensing and machine learning: A survey
Garcia-Ceja, E., Riegler, M., Nordgreen, T., Jakobsen, P., Oedegaard, K. J., & Tørresen, J. (2018) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2018.09.003 · Cited by 356 · see citing works
A comprehensive survey on multimodal medical signals fusion for smart healthcare systems
Muhammad, G., Alshehri, F., Karray, F., Saddik, A. E., Alsulaiman, M., & Falk, T. H. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.007 · Cited by 287 · see citing works
khan, Z. F., & Alotaibi, S. R. (2020) · Journal of Healthcare Engineering · doi:10.1155/2020/8894694 · Cited by 235 · see citing works
LimbMotion: Decimeter-level Limb Tracking for Wearable-based Human-Computer Interaction
Zhou, H., Gao, Y., Song, X., Liu, W., & Dong, W. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3369836 · Cited by 27 · see citing works
Javeed, M., Mudawi, N. A., Alabduallah, B. I., Jalal, A., & Kim, W. (2023) · Sensors · doi:10.3390/s23104716 · Cited by 18 · see citing works
- Authors
- De, D., Bharti, P., Das, S. K., & Chellappan, S.
- Affiliations
- Missouri University of Science and Technology (US)
- Venue
- IEEE Internet Computing
- Published
- 2015-09
- Volume
- 19
- Issue
- 5
- Pages
- 26-35
- ISSN
- 1089-7801 (ISSN-L)
- OpenAlex
- W1911418635
- Cited by
- 129
- References
- 7
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 8 · 2023: 11 · 2022: 18 · 2021: 9 · 2020: 17 · 2019: 12 · 2018: 15 · 2017: 14 · 2016: 10
- FWCI
- 11.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Internet Computing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Advanced Sensor and Energy Harvesting Materials
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Keywords
- fine-grained activity recognition, home monitoring, Bluetooth beacons, conditional random fields, sensor fusion, accelerometer and gyroscope, remote patient monitoring, Alzheimer's disease, location context
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
