The DOI matches its Crossref record; 273 of the 273 references it cites were found in a registry or an index.
Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions
Abstract
Abstract Activity detection and classification using different sensor modalities have emerged as revolutionary technology for real-time and autonomous monitoring in behaviour analysis, ambient assisted living, activity of daily living (ADL), elderly care, rehabilitations, entertainments and surveillance in smart home environments. Wearable devices, smart-phones and ambient environments devices are equipped with variety of sensors such as accelerometers, gyroscopes, magnetometer, heart rate, pressure and wearable camera for activity detection and monitoring. These sensors are pre-processed and different feature sets such as time domain, frequency domain, wavelet transform are extracted and transform using machine learning algorithm for human activity classification and monitoring. Recently, deep learning algorithms for automatic feature representation have also been proposed to lessen the burden of reliance on handcrafted features and to increase performance accuracy. Initially, one set of sensor data, features or classifiers were used for activity recognition applications. However, there are new trends on the implementation of fusion strategies to combine sensors data, features and classifiers to provide diversity, offer higher generalization, and tackle challenging issues. For instances, combination of inertial sensors provide mechanism to differentiate activity of similar patterns and accurate posture identification while other multimodal sensor data are used for energy expenditure estimations, object localizations in smart homes and health status monitoring. Hence, the focus of this review is to provide in-depth and comprehensive analysis of data fusion and multiple classifier systems techniques for human activity recognition with emphasis on mobile and wearable devices. First, data fusion methods and modalities were presented and also feature fusion, including deep learning fusion for human activity recognition were critically analysed, and their applications, strengths and issues were identified. Furthermore, the review presents different multiple classifier system design and fusion methods that were recently proposed in literature. Finally, open research problems that require further research and improvements are identified and discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Research works printed but not linked: 32
- J. Wang, Y. Chen, S. Hao, X. Peng, L. Hu, Deep learning for sensor-based activity recognition: a survey, arXiv:1707.03502, (2017). · arXiv
- S.-M. Lee, S.M. Yoon, H. Cho, Human activity recognition from accelerometer data using Convolutional Neural Network, in, Proceedings of the IEEE, pp. 131–134.
- Chen, 2011, An algorithm of mobile sensors data fusion tracking for wireless sensor networks, Wirel. Person. Commun., 58, 197, 10.1007/s11277-009-9888-8 · doi:10.1007/s11277-009-9888-8
- Tsai, 2014, A framework for fusion of human sensor and physical sensor data, IEEE Trans. Syst. Man. Cybernet., 44, 1248, 10.1109/TSMC.2014.2309090 · doi:10.1109/tsmc.2014.2309090
- Chen, 2016, IEEE, an improved algorithm for human activity recognition using wearable sensors, 248
- Berenguer, 2017, Evolution of activities of daily living using inertia measurements: the lunch and dinner activities, J. Int. Soc. Telemed. eHealth, 5, 10
- Chetty, 2014, IEEE, multimodal activity recognition based on automatic feature discovery, 632
- Khattak, 2011, Intelligent Healthcare service provisioning using ontology with low-level sensory data, KSII Trans. Internet Inf. Syst., 5, 2016
- Shoaib, 2016, Complex human activity recognition using smartphone and wrist-worn motion sensors, Sensors, 16, 426, 10.3390/s16040426 · DOI · Paper page
- Fong, 2017, Training classifiers with shadow features for sensor-based human activity recognition, Sensors, 17
- Li, 2017, Elitist binary wolf search algorithm for heuristic feature selection in high-dimensional bioinformatics datasets, Sci. Rep., 7, 4354, 10.1038/s41598-017-04037-5 · DOI
- Abeyruwan, 2016, Semi-automatic extraction of training examples from sensor readings for fall detection and posture monitoring, IEEE Sens. J., 16, 5406, 10.1109/JSEN.2016.2559804 · doi:10.1109/jsen.2016.2559804
- Ravi, 2016, A deep learning approach to on-node sensor data analytics for mobile or wearable devices, IEEE J. Biomed. Health Inf.
- M.A. Alsheikh, A. Selim, D. Niyato, L. Doyle, S. Lin, H.-P. Tan, Deep Activity Recognition Models with Triaxial Accelerometers, arXiv:1511.04664, (2015). · arXiv
- Ravì, 2017, A deep learning approach to on-node sensor data analytics for mobile or wearable devices, IEEE J. Biomed. Health Inf., 21, 56, 10.1109/JBHI.2016.2633287 · DOI · Paper page
- A. Sathyanarayana, S. Joty, L. Fernandez-Luque, F. Ofli, J. Srivastava, A. Elmagarmid, S. Taheri, T. Arora, Impact of physical activity on sleep: a deep learning based exploration, arXiv:1607.07034, (2016). · arXiv
- J. Chung, C. Gulcehre, K. Cho, Y. Bengio, Empirical evaluation of gated recurrent neural networks on sequence modeling, arXiv:1412.3555, (2014). · arXiv
- X. Li, Y. Zhang, J. Zhang, S. Chen, I. Marsic, R.A. Farneth, R.S. Burd, Concurrent activity recognition with multimodal CNN-LSTM structure, arXiv:1702.01638, (2017). · arXiv
- Ordóñez, 2016, Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition, Sensors, 16, 115, 10.3390/s16010115 · DOI · Paper page
- M. Chen, Z. Xu, K. Weinberger, F. Sha, Marginalized denoising autoencoders for domain adaptation, arXiv:1206.4683, (2012). · arXiv
- C.-Y. Ma, M.-H. Chen, Z. Kira, G. AlRegib, TS-LSTM and temporal-inception: exploiting spatiotemporal dynamics for activity recognition, arXiv:1703.10667, (2017). · arXiv
- Ijjina, 2016, Hybrid deep neural network model for human action recognition, Appl. Soft Comput., 46, 936, 10.1016/j.asoc.2015.08.025 · DOI
- Khan, 2017, Detecting unseen falls from wearable devices using channel-wise ensemble of autoencoders, Expert Syst. Appl., 87, 280, 10.1016/j.eswa.2017.06.011 · DOI
- Morales, 2017, Physical activity recognition by smartphones, a survey, Biocybernet. Biomed. Eng., 37, 388, 10.1016/j.bbe.2017.04.004 · DOI
- S. Yao, S. Hu, Y. Zhao, A. Zhang, T. Abdelzaher, DeepSense: a unified deep learning framework for time-series mobile sensing data processing, arXiv:1611.01942, (2016). · arXiv
- M. Alzantot, S. Chakraborty, M.B. Srivastava, SenseGen: a deep learning architecture for synthetic sensor data generation, arXiv:1701.08886, (2017). · arXiv
- Fatima, 2013, A genetic algorithm-based classifier ensemble optimization for activity recognition in smart homes, TIIS, 7, 2853, 10.3837/tiis.2013.11.018 · doi:10.3837/tiis.2013.11.018
- Rodriguez, 2016, Ensemble of One-Class Classifiers for personal risk detection based on wearable sensor data, Sensors (Basel, Switzerland), 16, 10.3390/s16101619 · doi:10.3390/s16101619
- Mazaar, 2016, ACM, Ensemble based-feature selection on human activity recognition, 81
- Bulling, 2014, A tutorial on human activity recognition using body-worn inertial sensors, ACM Comput. Surv., 46, 1, 10.1145/2499621 · DOI · Paper page
- H. Inoue, H. Narihisa, Optimizing a multiple classifier system, Pacific Rim International Conference on Artificial Intelligence PRICAI 2002: PRICAI 2002: Trends in Artificial Intelligence pp. 285–294. · doi:10.1007/3-540-45683-x_32
- Shoaib, 2016, Complex human activity recognition using smartphone and wrist-worn motion sensors, Sensors, 16
Cited by
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
Qiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
Ramanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455
Demrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368
Murtaza, G., Shuib, L., Abdul Wahab, A. W., Mujtaba, G., Mujtaba, G., Nweke, H. F., Al-garadi, M. A., Zulfiqar, F., Raza, G., & Azmi, N. A. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09716-5 · Cited by 342
Self-citation
Metadata
- Authors
- Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 46
- Pages
- 147-170
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2888949514
- Cited by
- 394
- References
- 273
- FWCI
- 20.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions. https://app.cochat.ai/papers/10.1016/j.inffus.2018.06.002
- The paper
- Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A. (2019). Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions. Information Fusion. https://doi.org/10.1016/j.inffus.2018.06.002
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.