CoChat

Vision-Based Fall Detection with Convolutional Neural Networks

Open access
Núñez-Marcos, Adrián, Azkune, Gorka, Arganda-Carreras, Ignacio · 2017 · Wireless Communications and Mobile Computing

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

Abstract

One of the biggest challenges in modern societies is the improvement of healthy aging and the support to older persons in their daily activities. In particular, given its social and economic impact, the automatic detection of falls has attracted considerable attention in the computer vision and pattern recognition communities. Although the approaches based on wearable sensors have provided high detection rates, some of the potential users are reluctant to wear them and thus their use is not yet normalized. As a consequence, alternative approaches such as vision-based methods have emerged. We firmly believe that the irruption of the Smart Environments and the Internet of Things paradigms, together with the increasing number of cameras in our daily environment, forms an optimal context for vision-based systems. Consequently, here we propose a vision-based solution using Convolutional Neural Networks to decide if a sequence of frames contains a person falling. To model the video motion and make the system scenario independent, we use optical flow images as input to the networks followed by a novel three-step training phase. Furthermore, our method is evaluated in three public datasets achieving the state-of-the-art results in all three of them.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1155/2017/9474806

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 The system architecture or pipeline: the RGB images are converted to optical flow images, then features are extracted with a CNN, and a FC-NN decides whether there has been a fall or not.
Figure 1 The system architecture or pipeline: the RGB images are converted to optical flow images, then features are extracted with a CNN, and a FC-NN decides whether there has been a fall or not.CC-BY · From the PDF
Figure 2 Sample of sequential frames of a fall from the Multiple Cameras Fall Dataset (a) and their corresponding optical flow horizontal displacement images (b).
Figure 2 Sample of sequential frames of a fall from the Multiple Cameras Fall Dataset (a) and their corresponding optical flow horizontal displacement images (b).CC-BY · From the PDF
Figure 3 VGG-16 architecture: convolutional layers in green, max pooling layers in orange, and fully connected layers in purple. We followed the same notation of the original paper.
Figure 3 VGG-16 architecture: convolutional layers in green, max pooling layers in orange, and fully connected layers in purple. We followed the same notation of the original paper.CC-BY · From the PDF
Figure 4 The transfer learning process applied to the neural network. (1) Full training with Imagenet to learn a generic feature extractor. (2) Training in UCF101 to learn to model motion. (3) Fine-tuning to build a fall detector.
Figure 4 The transfer learning process applied to the neural network. (1) Full training with Imagenet to learn a generic feature extractor. (2) Training in UCF101 to learn to model motion. (3) Fine-tuning to build a fall detector.CC-BY · From the PDF
Figure 5 Sliding window method to obtain stacks of consecutive frames.
Figure 5 Sliding window method to obtain stacks of consecutive frames.CC-BY · From the PDF
Image 6
CC-BY · From the PDF
Figure 7 Original images of the FDD dataset in (a); the same images with simulated dynamic lighting in (b); optical flow images without the lighting change in (c); and optical flow images with the lighting change in (d). The 12 frames correspond to half a second of the original video (recorded at 25 FPS).
Figure 7 Original images of the FDD dataset in (a); the same images with simulated dynamic lighting in (b); optical flow images without the lighting change in (c); and optical flow images with the lighting change in (d). The 12 frames correspond to half a second of the original video (recorded at 25 FPS).CC-BY · From the PDF
Image 8
CC-BY · From the PDF
Image 9
CC-BY · From the PDF
Image 10
CC-BY · From the PDF
Image 11
CC-BY · From the PDF
Image 12
CC-BY · From the PDF
Image 13
CC-BY · From the PDF
Image 14
CC-BY · From the PDF
Image 15
CC-BY · From the PDF
Image 16
CC-BY · From the PDF
Image 17
CC-BY · From the PDF
Image 18
CC-BY · From the PDF
Image 19
CC-BY · From the PDF
Image 20
CC-BY · From the PDF
Image 21
CC-BY · From the PDF
Image 22
CC-BY · From the PDF
Image 23
CC-BY · From the PDF
Image 24
CC-BY · From the PDF
Image 25
CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 8

  1. M. Vallejo, C. V. Isaza, and J. D. Lopez, "Artificial Neural Net- works as an alternative to traditional fall detection methods, " in Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013, pp. 1648-1651, Japan, July 2013.
  2. A. Sengto and T. Leauhatong, "Human falling detection algo- rithm using back propagation neural network, " in Proceedings of the 5th 2012 Biomedical Engineering International Conference, BMEiCON 2012, Thailand, December 2012.
  3. I. Charfi, J. Miteran, J. Dubois, M. Atri, and R. Tourki, "Def- inition and performance evaluation of a robust SVM based fall detection solution, " in Proceedings of the 8th International Conference on Signal Image Technology and Internet Based Systems, SITIS 2012, pp. 218-224, Italy, November 2012.
  4. V. Vishwakarma, C. Mandal, and S. Sural, in Pattern Recognition and Machine Intelligence, Automatic detection of human fall in video, Ed., pp. 616-623, 2007.
  5. Y. Jia, E. Shelhamer, J. Donahue et al., "Caffe: convolutional architecture for fast feature embedding, " in Proceedings of the ACM International Conference on Multimedia, pp. 675-678, ACM, Orlando, Fla, USA, November 2014.
  6. F. A. Hamprecht, C. Schnörr, and B. Jähne, ""A duality based approach for realtime TV-L 1 optical flow, " in Pattern Recogni- tion, pp. 214-223, 2007.
  7. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classifi- cation with deep convolutional neural networks, " in Proceedings of the 26th Annual Conference on Neural Information Processing Systems (NIPS '12), pp. 1097-1105, Lake Tahoe, Nev, USA, December 2012.
  8. K. Simonyan and A. Zisserman, "Two-stream convolutional networks for action recognition in videos, " in Proceedings of the 28th Annual Conference on Neural Information Processing Sys- tems 2014, NIPS 2014, pp. 568-576, can, December 2014.

Cited by

See all 296

Metadata

Authors
Núñez-Marcos, A., Azkune, G., & Arganda-Carreras, I.
Affiliations
  • Universidad de Deusto (ES)
  • Department of Computer Science and Artificial Intelligence, Basque Country University, P. Manuel Lardizabal 1, 20018 San Sebastian, Spain
Corresponding author
Núñez-Marcos, Adrián
Venue
Wireless Communications and Mobile Computing
Publisher
Wiley
Published
2017
Volume
2017
Pages
1-16
ISSN
  • 1530-8669 (ISSN-L)
  • 1530-8677
OpenAlex
W2772973030
Cited by
282
References
38
Citations by year
2026: 14 · 2025: 30 · 2024: 30 · 2023: 35 · 2022: 58 · 2021: 40 · 2020: 43 · 2019: 25 · 2018: 7
FWCI
8.52
Type
journal article
Language
en
Open access
Locations
  • Wireless Communications and Mobile Computing (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Basque Government’s Department of Education
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
  • Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Balance, Gait, and Falls Prevention
Keywords
fall detection, vision-based monitoring, convolutional neural networks, optical flow, older adults, healthy aging, smart environments, Internet of Things

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.