The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Deep Learning for Fall Detection: Three-Dimensional CNN Combined With LSTM on Video Kinematic Data
Abstract
Fall detection is an important public healthcare problem. Timely detection could enable instant delivery of medical service to the injured. A popular nonintrusive solution for fall detection is based on videos obtained through ambient camera, and the corresponding methods usually require a large dataset to train a classifier and are inclined to be influenced by the image quality. However, it is hard to collect fall data and instead simulated falls are recorded to construct the training dataset, which is restricted to limited quantity. To address these problems, a three-dimensional convolutional neural network (3-D CNN) based method for fall detection is developed, which only uses video kinematic data to train an automatic feature extractor and could circumvent the requirement for large fall dataset of deep learning solution. 2-D CNN could only encode spatial information, and the employed 3-D convolution could extract motion feature from temporal sequence, which is important for fall detection. To further locate the region of interest in each frame, a long short-term memory (LSTM) based spatial visual attention scheme is incorporated. Sports dataset Sports-1 M with no fall examples is employed to train the 3-D CNN, which is then combined with LSTM to train a classifier with fall dataset. Experiments have verified the proposed scheme on fall detection benchmark with high accuracy as 100%. Superior performance has also been obtained on other activity databases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Ucf101: A dataset of 101 human actions classes from videos in the wild
Soomro, K., Zamir, A. R., & Shah, M. (2012) · arXiv · doi:10.48550/arxiv.1212.0402 · Cited by 4,575
Hmdb: a large video database for human motion recognition
Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126543 · Cited by 3,965 · cited 1×
“For further activity classification comparison, experiments on dataset HMDB-51 [58] have also been performed.”
MethodRegion-based convolutional networks for accurate object detection and segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2437384 · Cited by 2,912
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2599174 · Cited by 1,547
Long-Term Temporal Convolutions for Action Recognition
Varol, G., Laptev, I., & Schmid, C. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2712608 · Cited by 915
A survey on fall detection: Principles and approaches
Mubashir, M., Shao, L., & Seed, L. (2013) · Neurocomputing · doi:10.1016/j.neucom.2011.09.037 · Cited by 869
Challenges, issues and trends in fall detection systems
Igual, R., Medrano, C., & Plaza, I. (2013) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-12-66 · Cited by 654
Human fall detection on embedded platform using depth maps and wireless accelerometer
Kwolek, B., & Kepski, M. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2014.09.005 · Cited by 650
Fall Detection in Homes of Older Adults Using the Microsoft Kinect
Stone, E. E., & Skubic, M. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2312180 · Cited by 528
On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures
Bianchini, M., & Scarselli, F. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2293637 · Cited by 500
Robust Video Surveillance for Fall Detection Based on Human Shape Deformation
Rougier, C., Meunier, J., St-Arnaud, A., & Rousseau, J. (2011) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2129370 · Cited by 490
Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification
Wu, Z., Wang, X., Jiang, Y.-G., Ye, H., & Xue, X. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806222 · Cited by 479
VideoLSTM convolves, attends and flows for action recognition
Li, Z., Gavrilyuk, K., Gavves, E., Jain, M., & Snoek, C. G. M. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.10.011 · Cited by 466
Application of Deep Belief Networks for Natural Language Understanding
Sarikaya, R., Hinton, G. E., & Deoras, A. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2303296 · Cited by 460
A Smart and Passive Floor-Vibration Based Fall Detector for Elderly
Alwan, M., Rajendran, P. J., Kell, S., Mack, D., Dalal, S., Wolfe, M., & Felder, R. (2006) · 2006 2nd International Conference on Information & Communication Technologies · doi:10.1109/ictta.2006.1684511 · Cited by 402
Vision-Based Fall Detection with Convolutional Neural Networks
Núñez-Marcos, A., Azkune, G., & Arganda-Carreras, I. (2017) · Wireless Communications and Mobile Computing · doi:10.1155/2017/9474806 · Cited by 282
Automatic Fall Monitoring: A Review
Pannurat, N., Thiemjarus, S., & Nantajeewarawat, E. (2014) · Sensors · doi:10.3390/s140712900 · Cited by 237
Portable preimpact fall detector with inertial sensors
Wu, G., & Xue, S. (2008) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2007.916282 · Cited by 227
A Wearable Airbag to Prevent Fall Injuries
Tamura, T., Yoshimura, T., Sekine, M., Uchida, M., & Tanaka, O. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2033673 · Cited by 223
Activity summarisation and fall detection in a supportive home environment
Nait-Charif, H., & McKenna, S. J. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1333768 · Cited by 223
A Smart Phone-Based Pocket Fall Accident Detection, Positioning, and Rescue System
Kau, L.-J., & Chen, C.-S. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2328593 · Cited by 190
Recognizing Falls from Silhouettes
Anderson, D., Keller, J. M., Skubic, M., Chen, X., & He, Z. (2006) · 2006 International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2006.259594 · Cited by 185
Vision and Falls in Older People: Risk Factors and Intervention Strategies
Lord, S. R., Smith, S. T., & Menant, J. C. (2010) · Clinics in Geriatric Medicine · doi:10.1016/j.cger.2010.06.002 · Cited by 176
Two-Stream 3D Convolutional Neural Network for Skeleton-Based Action RecognitionPreprint
Liu, H., Tu, J., & Liu, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08106 · Cited by 168
A survey on vision-based fall detection
Zhang, Z., Conly, C., & Athitsos, V. (2015) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/2769493.2769540 · Cited by 160
Automatic Monocular System for Human Fall Detection Based on Variations in Silhouette Area
Mirmahboub, B., Samavi, S., Karimi, N., & Shirani, S. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2228262 · Cited by 159
On the depth of deep neural networks: a theoretical view
Sun, S., Chen, W., Wang, L., Liu, X., & Liu, T.-Y. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10243 · Cited by 147 · cited 1×
“The latest research suggests that the increasing depth of the network has both positive and negative effect, therefore the optimal selection of the depth is a balance between the contradicted influences [38].”
BackgroundA Real-Time, Multiview Fall Detection System: A LHMM-Based Approach
Thome, N., Miguet, S., & Ambellouis, S. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005606 · Cited by 137
3D depth image analysis for indoor fall detection of elderly people
Yang, L., Ren, Y., & Zhang, W. (2016) · Digital Communications and Networks · doi:10.1016/j.dcan.2015.12.001 · Cited by 132
Acoustic fall detection using one-class classifiers
Popescu, M., & Mahnot, A. (2009) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2009.5334521 · Cited by 81
Yang, L., Ren, Y., Hu, H., & Tian, B. (2015) · Sensors · doi:10.3390/s150923004 · Cited by 75
Two-Stream Flow-Guided Convolutional Attention Networks for Action Recognition
Tran, A., & Cheong, L. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.368 · Cited by 74
Learning the Structure of Deep Convolutional Networks
Feng, J., & Darrell, T. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.315 · Cited by 71
Sannino, G., Falco, I. D., & Pietro, G. D. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.04.060 · Cited by 52
Fall detection based on the gravity vector using a wide-angle camera
Bosch-Jorge, M., Sánchez-Salmerón, A.-J., Valera, Á., & Ricolfe-Viala, C. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.06.045 · Cited by 35
Cited by
Atitallah, S. B., Driss, M., Boulila, W., & Ghézala, H. B. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100303 · Cited by 375
Attention, please! A survey of neural attention models in deep learning
de Santana Correia, A., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 298
Udriștoiu, A. L., Cazacu, I. M., Gruionu, L. G., Gruionu, G., Iacob, A. V., Burtea, D. E., Ungureanu, B. S., Costache, M. I., Constantin, A., Popescu, C. F., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0251701 · Cited by 63
“In these previous studies, the combination between CNN and LSTM was used to discover the time dependencies in images sequences for falling detection [8].”
MethodConvolutional neural network and long short-term memory models for ice-jam predictions
Madaeni, F., Chokmani, K., Lhissou, R., Homayouni, S., Gauthier, Y., & Tolszczuk-Leclerc, S. (2022) · The Cryosphere · doi:10.5194/tc-16-1447-2022 · Cited by 51
Domain Generalization for Activity Recognition via Adaptive Feature Fusion
Qin, X., Wang, J., Chen, Y., Lu, W., & Jiang, X. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3552434 · Cited by 55
Metadata
- Authors
- Lu, N., Wu, Y., Feng, L., & Song, J.
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2019-01
- Volume
- 23
- Issue
- 1
- Pages
- 314-323
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W2909645133
- Cited by
- 339
- References
- 54
- FWCI
- 16.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.