The DOI matches its Crossref record; 107 of the 107 references it cites were found in a registry or an index.
A Review on Video-Based Human Activity Recognition
Open accessAbstract
This review article surveys extensively the current progresses made toward video-based human activity recognition. Three aspects for human activity recognition are addressed including core technology, human activity recognition systems, and applications from low-level to high-level representation. In the core technology, three critical processing stages are thoroughly discussed mainly: human object segmentation, feature extraction and representation, activity detection and classification algorithms. In the human activity recognition systems, three main types are mentioned, including single person activity recognition, multiple people interaction and crowd behavior, and abnormal activity recognition. Finally the domains of applications are discussed in detail, specifically, on surveillance environments, entertainment environments and healthcare systems. Our survey, which aims to provide a comprehensive state-of-the-art review of the field, also addresses several challenges associated with these systems and applications. Moreover, in this survey, various applications are discussed in great detail, specifically, a survey on the applications in healthcare monitoring systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
(1981) · Cited by 11,963
The Nature of Statistical Learning Theory
Vapnik, V. N. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3264-1 · Cited by 10,696
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 7×
“As discussed previously, local descriptors are designed to be more robust to noise and occlusion, and possibly invariant to rotation and scale, such as scale-invariant feature transform (SIFT) features [12,57,58], histogram of oriented gradient (HOG) features [5,59], nonparametric weighted feature extraction (NWFE) fe…”
BackgroundMethodInfluentialFundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
Research works printed but not linked: 39
- Luo, 2003, Object-based analysis and interpretation of human motion in sports video sequences by dynamic Bayesian networks, Comput. Vis. Image Underst., 92, 196, 10.1016/j.cviu.2003.08.001 · doi:10.1016/j.cviu.2003.08.001
- Lu, X., Liu, Q., and Oe, S. (2004, January 5–7). Recognizing Non-rigid Human Actions using Joints Tracking in Space-Time. Proceedings of the IEEE International Conference on Information Technology: Coding and Computing (ITCC), Las Vegas, NV, USA.
- Bodor, R., Jackson, B., and Papanikolopoulos, N. (2003, January 18–20). Vision-based Human Tracking and Activity Recognition. Proceedings of the 11th Mediterranean Conference on Control and Automation, Rhodes, Greece.
- Huo, F., Hendriks, E., Paclik, P., and Oomes, A.H.J. (2009, January 6–8). Markerless Human Motion Capture and Pose Recognition. Proceedings of the 10th IEEE Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), London, UK. · doi:10.1109/wiamis.2009.5031420
- Kumari, S., and Mitra, S.K. (2011, January 15–17). Human Action Recognition Using DFT. Proceedings of the third IEEE National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), Hubli, India. · doi:10.1109/ncvpripg.2011.58
- Kuo, 2010, A visual context-awareness-based sleeping-respiration measurement system, IEEE Trans. Inf. Technol. Biomed., 14, 255, 10.1109/TITB.2009.2036168 · doi:10.1109/titb.2009.2036168
- Huynh, 2009, Real time detection, tracking and recognition of medication intake, World Acad. Sci. Eng. Technol., 60, 280
- Foroughi, H., Rezvanian, A., and Paziraee, A. (2008, January 16–19). Robust Fall Detection Using Human Shape and Multi-Class Support Vector Machine. Proceedings of the IEEE Sixth Indian Conference on Computer Vision, Graphics & Image Processing (ICVGIP), Bhubaneswar, India. · doi:10.1109/icvgip.2008.49
- Foroughi, H., Yazdi, H.S., Pourreza, H., and Javidi, M. (2008, January 28–30). An Eigenspace-based Approach for Human Fall Detection Using Integrated Time Motion Image and Multi-class Support Vector Machine. Proceedings of IEEE 4th International Conference on Intelligent Computer Communication and Processing (ICCP), Cluj-Napoca, Romania. · doi:10.1109/iccp.2008.4648358
- Liu, 2007, Understanding of human behaviors from videos in nursing care monitoring systems, J. High Speed Netw., 16, 91
- Ghali, A., Cunningham, A.S., and Pridmore, T.P. (2003, January 8–11). Object and Event Recognition for Stroke Rehabilitation. Proceedings of Visual Communications and Image Processing, Lugano, Switzerland.
- Ayase, R., Higashi, T., Takayama, S., Sagawa, S., and Ashida, N. (2008, January 7–9). A Method for Supporting At-home Fitness Exercise Guidance and At-home Nursing Care for the Elders, Video-based Simple Measurement System. Proceedings of IEEE 10th International Conference on e-health Networking, Applications and Services (HealthCom), Singapore. · doi:10.1109/health.2008.4600133
- Goffredo, 2009, Markerless human motion analysis in Gauss-Laguerre transform domain: An application to sit-to-stand in young and elderly people, IEEE Trans. Inf. Technol. Biomed., 13, 207, 10.1109/TITB.2008.2007960 · doi:10.1109/titb.2008.2007960
- Liao, T., Miaou, S., and Li, Y. (2010, January 5–7). A vision-based walking posture analysis system without markers. IEEE 2nd International Conference on Signal Processing Systems (ICSPS), Dalian, China. · doi:10.1109/icsps.2010.5555656
- Li, Y., Miaou, S., Hung, C.K., and Sese, J.T. (2011, January 26–28). A Gait Analysis System Using two Cameras with Orthogonal View. Proceedings of IEEE International Conference on Multimedia Technology (ICMT), Hangzhou, China.
- Yoon, S., Won, C.S., Pyun, K., and Gray, R.M. (2003, January 25–27). Image Classification Using GMM with Context Information and with a Solution of Singular Covariance Problem. IEEE Proceedings of Data Compression Conference (DCC), Snowbird, UT, USA.
- Brendel, W., and Todorovic, S. (October, January 29). Video Object Segmentation by Tracking Regions. proceedings of IEEE 12th International Conference on Computer Vision, Kyoto, Japan.
- Daniilidis, 1998, Real-time tracking of moving objects with an active camera, Real-Time Imaging, 4, 3, 10.1006/rtim.1996.0060 · doi:10.1006/rtim.1996.0060
- Huang, C., Chen, Y., and Fu, L. (2009, January 18–21). Real-time Object Detection and Tracking on a Moving Camera Platform. Proceedings of IEEE ICCAS-SICE, Fukuoka, Japan.
- Nakazawa, A., Kato, H., and Inokuchi, S. (1998, January 20). Human Tracking Using Distributed Vision Systems. Proceedings of IEEE Fourteenth International Conference on Pattern Recognition, Brisbane, Qld., Australia.
- Leong, 2007, Automatic body feature extraction from a marker-less scanned human body, Comput.-Aided Des., 39, 568, 10.1016/j.cad.2007.03.003 · doi:10.1016/j.cad.2007.03.003
- Lee, 2006, A model-based approach for estimating human 3D poses in static images, IEEE Trans. Pattern Anal. Mach. Intell., 28, 905, 10.1109/TPAMI.2006.110 · doi:10.1109/tpami.2006.110
- Rogez, G., Guerrero, J.J., and Orrite, C. (2007, January 5–7). View-invariant Human Feature Extraction for Video-Surveillance Applications. Proceedings of IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS), London, UK. · doi:10.1109/avss.2007.4425331
- Ke, S., Zhu, L., Hwang, J., Pai, H., Lan, K., and Liao, C. (September, January 29). Real-time 3D Human Pose Estimation from Monocular View with Applications to Event Detection and Video Gaming. Proceedings of Seventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Boston, MA, USA.
- Ke, S., Hwang, J., Lan, K., and Wang, S. (2011, January 23–26). View-invariant 3D Human Body Pose Reconstruction Using a Monocular Video Camera. Proceedings of Fifth ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC), Ghent, Belgium. · doi:10.1109/icdsc.2011.6042900
- Clausen, 2005, Efficient content-based retrieval of motion capture data, ACM Trans. Graph. (TOG), 24, 677, 10.1145/1073204.1073247 · doi:10.1145/1073204.1073247
- Hoang, L.U.T., Ke, S., Hwang, J., Yoo, J., and Choi, K. (2012, January 2–4). Human Action Recognition based on 3D Body Modeling from Monocular Videos. Proceedings of Frontiers of Computer Vision Workshop, Tokyo, Japan.
- Hoang, L.U.T., Ke, S., Hwang, J, Tuan, P.V., and Chau, T.N. (2012, January 10–12). Quasi-periodic Action Recognition from Monocular Videos via 3D Human Models and Cyclic HMMs. Proceedings of IEEE International Conference on Advanced Technologies for Communications (ATC), Hanoi, Vietnam.
- Tipping, 2001, Sparse Bayesian learning and the relevance vector machine, J. Mach. Learn. Res., 1, 211
- Fiaz, M.K., and Ijaz, B. (2010, January 15–17). Vision based Human Activity Tracking using Artificial Neural Networks. Proceedings of IEEE International Conference on Intelligent and Advanced Systems (ICIAS), Kuala Lumpur, Malaysia. · doi:10.1109/icias.2010.5716186
- Enzweiler, 2009, Monocular pedestrian detection: Survey and experiments, IEEE Trans. Pattern Anal. Mach. Intell., 31, 2179, 10.1109/TPAMI.2008.260 · DOI · Paper page
- Zhu, S., Zhang, R., and Tu, Z. (2000, January 13–15). Integrating Bottom-up/Top-down for Object Recognition by Data Driven Markov Chain Monte Carlo. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, USA.
- Shieh, W., and Huang, J. (2009, January 25–27). Proceedings of the 2005 International Conference on Computer Vision (ICCV) in Human-Computer Interaction. Proceedings of IEEE International Conference on Embedded Software and Systems (ICESS), HangZhou, Zhejiang, China.
- Sengto, A., and Leauhatong, T. (2012, January 5–7). Human Falling Detection Algorithm Using Back Propagation Neural Network. Proceedings of IEEE Biomedical Engineering International Conference (BMEiCON), Ubon Ratchathani, Thailand. · doi:10.1109/bmeicon.2012.6465460
- Subburaman, V.B., Descamps, A., and Carincotte, C. (2012, January 18–21). Counting People in the Crowd Using a Generic Head Detector. Proceedings of IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance (AVSS), Beijing, China. · doi:10.1109/avss.2012.87
- Merad, D., Aziz, K.E., and Thome, N. (September, January 29). Fast People Counting Using Head Detection from Skeleton Graph. Proceeidngs of Seventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Boston, MA, USA.
- Saxena, S., Brémond, F., Thonnat, M., and Ma, R. (2008, January 20–24). Crowd behavior recognition for video surveillance. Proceedings of the 10th International Conference on Advanced Concepts for Intelligent Vision Systems (ACIVS), Juan-les-Pins, France. · doi:10.1007/978-3-540-88458-3_88
- Zin, T.T., Tin, P., Toriu, T., and Hama, H. (2010, January 15–17). A Markov Random Walk Model for Loitering People Detection. Proceedings of IEEE Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), Darmstadt, Germany. · doi:10.1109/iihmsp.2010.172
- Sicre, R., and Nicolas, H. (2010, January 23–25). Shopping Scenarios Semantic Analysis in Videos. Proceedings of the 8th IEEE International Workshop on Content-Based Multimedia Indexing (CBMI), Grenoble, France. · doi:10.1109/cbmi.2010.5529913
Cited by
Vision-based human activity recognition: a survey
Beddiar, D. R., Nini, B., Sabokrou, M., & Hadid, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09004-3 · Cited by 505
From action to activity: Sensor-based activity recognition
Liu, Y., Nie, L., Liu, L., & Rosenblum, D. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.096 · Cited by 486
A survey on wearable sensor modality centred human activity recognition in health care
Wang, Y., Cang, S., & Yu, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.04.057 · Cited by 409
Abnormal behavior recognition for intelligent video surveillance systems: A review
Ben Mabrouk, A., & Zagrouba, E. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.029 · Cited by 361
Human activity recognition in artificial intelligence framework: a narrative review
Gupta, N., Gupta, S. K., Pathak, R. K., Jain, V., Rashidi, P., & Suri, J. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10116-x · Cited by 337
InnoHAR: A Deep Neural Network for Complex Human Activity Recognition
Xu, C., Chai, D., He, J., Zhang, X., & Duan, S. (2019) · IEEE Access · doi:10.1109/access.2018.2890675 · Cited by 333
Cust, E. E., Sweeting, A. J., Ball, K., & Robertson, S. (2019) · Journal of Sports Sciences · doi:10.1080/02640414.2018.1521769 · Cited by 324
Space-time representation of people based on 3D skeletal data: A review
Han, F., Reily, B., Hoff, W., & Zhang, H. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.01.011 · Cited by 316
Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition
Chen, Y., & Shen, C. (2017) · IEEE Access · doi:10.1109/access.2017.2676168 · Cited by 297
Prakash, C., Kumar, R., & Mittal, N. (2018) · Artificial Intelligence Review · doi:10.1007/s10462-016-9514-6 · Cited by 273
Bridging e-Health and the Internet of Things: The SPHERE Project
Zhu, N., Diethe, T., Camplani, M., Tao, L., Burrows, A., Twomey, N., Kaleshi, D., Mirmehdi, M., Flach, P., & Craddock, I. (2015) · IEEE Intelligent Systems · doi:10.1109/mis.2015.57 · Cited by 242
On the use of ensemble of classifiers for accelerometer-based activity recognition
Catal, C., Tufekci, S., Pirmit, E., & Kocabag, G. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.01.025 · Cited by 240
A survey on data fusion in internet of things: Towards secure and privacy-preserving fusion
Ding, W., Jing, X., Yan, Z., & Yang, L. T. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.12.001 · Cited by 230
Improving human activity recognition and its application in early stroke diagnosis
Villar, J. R., González, S., Sedano, J., Chira, C., & Trejo-Gabriel-Galan, J. M. (2015) · International Journal of Neural Systems · doi:10.1142/s0129065714500361 · Cited by 75
Features and models for human activity recognition
González, S., Sedano, J., Villar, J. R., Corchado, E., Herrero, Á., & Baruque, B. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.01.082 · Cited by 73
Remote Health Monitoring Systems for Elderly People: A Survey
Ahmed, S., Irfan, S., Kiran, N., Masood, N., Anjum, N., & Ramzan, N. (2023) · Sensors · doi:10.3390/s23167095 · Cited by 52
Forecasting occurrences of activities
Minor, B., & Cook, D. J. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.09.010 · Cited by 45
“Our group and others have explored a large number of approaches to supervised activity recognition [17-31].”
BackgroundActivity-Aware Energy-Efficient Automation of Smart Buildings
Thomas, B., & Cook, D. (2016) · Energies · doi:10.3390/en9080624 · Cited by 42
Adversarial Multi-view Networks for Activity Recognition
Bai, L., Yao, L., Wang, X., Kanhere, S. S., Guo, B., & Yu, Z. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397323 · Cited by 40
Movement Human Actions Recognition Based on Machine Learning
Xu, H., Li, L., Fang, M., & Zhang, F. (2018) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v14i04.8513 · Cited by 34
Impact of Wearable Measurement Properties and Data Quality on ADLs Classification Accuracy
Poli, A., Cosoli, G., Scalise, L., & Spinsante, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3009368 · Cited by 33
Human behavior recognition based on sparse transformer with channel attention mechanism
Cao, K., & Wang, M. (2023) · Frontiers in Physiology · doi:10.3389/fphys.2023.1239453 · Cited by 12
Metadata
- Authors
- Ke, S.-R., Thuc, H., Lee, Y.-J., Hwang, J.-N., Yoo, J.-H., & Choi, K.-H.
- Venue
- Computers
- Publisher
- MDPI AG
- Published
- 2013-06-05
- Volume
- 2
- Issue
- 2
- Pages
- 88-131
- ISSN
- 2073-431X (ISSN-L)
- OpenAlex
- W2034899024
- Cited by
- 439
- References
- 107
- FWCI
- 33.83
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.