The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Bi-LSTM Network for Multimodal Continuous Human Activity Recognition and Fall Detection
Open accessAbstract
This paper presents a framework based on multilayer bi-LSTM network (bidirectional Long Short-Term Memory) for multimodal sensor fusion to sense and classify daily activities' patterns and high-risk events such as falls. The data collected in this work are continuous activity streams from FMCW radar and three wearable inertial sensors on the wrist, waist, and ankle. Each activity has a variable duration in the data stream so that the transitions between activities can happen at random times within the stream, without resorting to conventional fixed-duration snapshots. The proposed bi-LSTM implements soft feature fusion between wearable sensors and radar data, as well as two robust hard-fusion methods using the confusion matrices of both sensors. A novel hybrid fusion scheme is then proposed to combine soft and hard fusion to push the classification performances to approximately 96% accuracy in identifying continuous activities and fall events. These fusion schemes implemented with the proposed bi-LSTM network are compared with conventional sliding window approach, and all are validated with realistic “leaving one participant out” (L1PO) method (i.e. testing subjects unknown to the classifier). The developed hybrid-fusion approach is capable of stabilizing the classification performance among different participants in terms of reducing accuracy variance of up to 18.1% and increasing minimum, worst-case accuracy up to 16.2%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“Rather than considering radar data [27] or wearable sensors data [28] in isolation, we investigate soft”
BackgroundWearable Sensors for Human Activity Monitoring: A Review
Mukhopadhyay, S. C. (2015) · IEEE Sensors Journal · doi:10.1109/jsen.2014.2370945 · Cited by 1,401
A Review of Data Fusion Techniques
Castanedo, F. (2013) · The Scientific World Journal · doi:10.1155/2013/704504 · Cited by 1,027
Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine
Kim, Y., & Ling, H. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2012849 · Cited by 870
RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices
Wang, H., Zhang, D., Wang, Y., Ma, J., Wang, Y., & Li, S. (2017) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2016.2557795 · Cited by 640
Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition
Wu, D., Pigou, L., Kindermans, P.-J., Le, N. D.-H., Shao, L., Dambre, J., & Odobez, J.-M. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2537340 · Cited by 453
Gürbüz, S. Z., & Amin, M. G. (2019) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2890128 · Cited by 421
Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.002 · Cited by 394
Research works printed but not linked: 6
- 10.1109/TGRS.2012.2188411 · doi:10.1109/tgrs.2012.2188411
- wang, 2013, CW and pulse-Doppler radar processing based on FPGA for human sensing applications, IEEE Trans Geosci Remote Sens, 51, 3097
- erol, 0, Radar data cube processing for human activity recognition using multi subspace learning, IEEE Trans Aerosp Electron Syst
- 2018, Help At Home Use of Assistive Technology for Older People, 3
- 2008, WHO Global Report on Falls Prevention in Older Age
- 10.1049/iet-rsn.2016.0055 · doi:10.1049/iet-rsn.2016.0055
Cited by
Artificial intelligence for the metaverse: A survey
Huynh-The, T., Pham, Q.-V., Pham, X.-Q., Nguyen, T. T., Han, Z., & Kim, D.-S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105581 · Cited by 710
ST-DeepHAR: Deep Learning Model for Human Activity Recognition in IoHT Applications
Abdel-Basset, M., Hawash, H., Chakrabortty, R. K., Ryan, M., Elhoseny, M., & Song, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3033430 · Cited by 136
A spatio-temporal graph neural network for fall prediction with inertial sensors
Wang, S., Li, X., Liao, G., Liu, J., Liao, C., Liu, M., Liao, J., & Liu, L. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111709 · Cited by 18
Metadata
- Authors
- Li, H., Shrestha, A., Heidari, H., Le Kernec, J., & Fioranelli, F.
- Venue
- IEEE Sensors Journal
- Published
- 2020-02-01
- Volume
- 20
- Issue
- 3
- Pages
- 1191-1201
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W2979637742
- Cited by
- 277
- References
- 33
- FWCI
- 10.95
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Engineering and Physical Sciences Research Council (EP/R041679/1)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bi-LSTM Network for Multimodal Continuous Human Activity Recognition and Fall Detection. https://app.cochat.ai/papers/10.1109/jsen.2019.2946095
- The paper
- Li, H., Shrestha, A., Heidari, H., Le Kernec, J., & Fioranelli, F. (2020). Bi-LSTM Network for Multimodal Continuous Human Activity Recognition and Fall Detection. IEEE Sensors Journal. https://doi.org/10.1109/jsen.2019.2946095
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.