The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Recent trends in machine learning for human activity recognition—A survey
Open accessAbstract
There has been an upsurge recently in investigating machine learning techniques for activity recognition (AR) problems as they have been very effective in extracting and learning knowledge from the activity datasets. The technique ranges from heuristically derived hand‐crafted feature‐based traditional machine learning algorithms to the recently developed hierarchically self‐evolving feature‐based deep learning algorithms. AR continues to remain a challenging problem in uncontrolled smart environments despite the amount of work contributed by the researcher in this field. The complex, volatile, and chaotic nature of the activity data presents numerous challenges that influence the performance of the AR systems in the wild. In this article, we present a comprehensive overview of recent machine learning and data mining techniques generally employed for AR and the underpinning problems and challenges associated with the existing systems. We also articulate the recent advances and state‐of‐the‐art techniques in this domain in an attempt to identify the possible directions for future AR research. This article is categorized under:Application Areas > Science and Technology Algorithmic Development > Spatial and Temporal Data Mining Technologies > Machine Learning Fundamental Concepts of Data and Knowledge > Motivation and Emergence of Data Mining
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 1×
“It recognized personalized user's activities using active learning, employed ensemble classifier to train the model, and evaluated the model using OPPORTUNITY (Roggen et al., 2009), WISDM (Kwapisz et al., 2011), and smartphone accelerometer datasets (Do et al., 2012).”
MethodDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“Ordóñez and Roggen (2016) have proposed a novel deep network comprising of convolutional and LSTM layers.”
BackgroundA Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662
When and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 1×
“Barnett and Ceci (2002) provided taxonomy of features that influences transfer learning in humans.”
BackgroundDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 2×
“Initial research on HAR has considered HAR to be a conventional pattern recognition problem (Wang, Chen, Hao, Peng, & Hu, 2017).”
BackgroundMethod(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 2×
“In HAR systems designed using shallow learning, the frequently used feature heuristics are dependent on the domain knowledge of the researcher and the performance of the machine learning techniques is highly dependent on the data representation (Bengio, 2013 Hammerla, Halloran, and Ploetz (2016) have explored DNN, CNN…”
MethodThe influence of improvement in one mental function upon the efficiency of other functions. (I).
Woodworth, R. S., & Thorndike, E. L. (1901) · Psychological Review · doi:10.1037/h0074898 · Cited by 1,223
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
(2015) · Cited by 989
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
mHealthDroid: A Novel Framework for Agile Development of Mobile Health Applications
Banos, O., Garcia, R., Holgado-Terriza, J. A., Damas, M., Pomares, H., Rojas, I., Saez, A., & Villalonga, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13105-4_14 · Cited by 583
Comparative study on classifying human activities with miniature inertial and magnetic sensors
Altun, K., Barshan, B., & Tunçel, O. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.04.019 · Cited by 564
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Deep Learning of Representations: Looking Forward
Bengio, Y. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39593-2_1 · Cited by 513
From action to activity: Sensor-based activity recognition
Liu, Y., Nie, L., Liu, L., & Rosenblum, D. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.096 · Cited by 486
Transfer learning for activity recognition: a survey
Cook, D., Feuz, K. D., & Krishnan, N. C. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0665-3 · Cited by 447
Discovery of activity patterns using topic models
Huynh, T., Fritz, M., & Schiele, B. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409638 · Cited by 442
Assessing the Quality of Activities in a Smart Environment
Schmitter-Edgecombe, M., & Cook, D. J. (2009) · Methods of Information in Medicine · doi:10.3414/me0592 · Cited by 403
Wearable Activity Tracking in Car Manufacturing
Stiefmeier, T., Roggen, D., Ogris, G., Lukowicz, P., & Tr, G. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.40 · Cited by 367
Barshan, B., & Yuksek, M. C. (2014) · The Computer Journal · doi:10.1093/comjnl/bxt075 · Cited by 346
Analyzing features for activity recognition
Huynh, T., & Schiele, B. (2005) · Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies · doi:10.1145/1107548.1107591 · Cited by 339
Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer
Gupta, P., & Dallas, T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2307069 · Cited by 335
Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection
Zappi, P., Lombriser, C., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., & Tröster, G. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77690-1_2 · Cited by 329
Cognitive Development and Learning in Instructional Contexts
Byrnes, J. P. (1995) · Cited by 321
Simple and Complex Activity Recognition through Smart Phones
Dernbach, S., Das, B., Krishnan, N. C., Thomas, B. L., & Cook, D. J. (2012) · 2012 Eighth International Conference on Intelligent Environments · doi:10.1109/ie.2012.39 · Cited by 312
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2016) · 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2016.7516235 · Cited by 269
Stratified Transfer Learning for Cross-domain Activity Recognition
Wang, J., Chen, Y., Hu, L., Peng, X., & Yu, P. S. (2018) · 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom.2018.8444572 · Cited by 253
Discrimination of walking patterns using wavelet-based fractal analysis
Sekine, M., Tamura, T., Akay, M., Fujimoto, T., Togawa, T., & Fukui, Y. (2002) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2002.802879 · Cited by 201
Scaling Human Activity Recognition via Deep Learning-based Domain Adaptation
Khan, M. A. A. H., Roy, N., & Misra, A. (2018) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2018.8444585 · Cited by 185
Self-citationFrom smart to deep: Robust activity recognition on smartwatches using deep learning
Bhattacharya, S., & Lane, N. D. (2016) · 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops) · doi:10.1109/percomw.2016.7457169 · Cited by 174
Cross-person activity recognition using reduced kernel extreme learning machine
Deng, W.-Y., Zheng, Q.-H., & Wang, Z.-M. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.01.008 · Cited by 163
Weakly Supervised Recognition of Daily Life Activities with Wearable Sensors
Stikic, M., Larlus, D., Ebert, S., & Schiele, B. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.36 · Cited by 158
SenseGen: A deep learning architecture for synthetic sensor data generation
Alzantot, M., Chakraborty, S., & Srivastava, M. (2017) · 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2017.7917555 · Cited by 153
CNN based approach for activity recognition using a wrist-worn accelerometer
Panwar, M., Sristi, R. D., Konkimalla, C. P., Biswas, D., Acharyya, A., Maharatna, K., Gautam, A., & Naik, G. R. (2017) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8037349 · Cited by 137
Ambient and smartphone sensor assisted ADL recognition in multi-inhabitant smart environments
Roy, N., Misra, A., & Cook, D. J. (2015) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-015-0294-7 · Cited by 132
Self-citationMultimodal Wearable Sensing for Fine-Grained Activity Recognition in Healthcare
De, D., Bharti, P., Das, S. K., & Chellappan, S. (2015) · IEEE Internet Computing · doi:10.1109/mic.2015.72 · Cited by 129
Autonomous unobtrusive detection of mild cognitive impairment in older adults
Akl, A., Taati, B., & Mihailidis, A. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2389149 · Cited by 126
A semi-supervised learning approach for robust indoor-outdoor detection with smartphones
Radu, V., Katsikouli, P., Sarkar, R., & Marina, M. K. (2014) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/2668332.2668347 · Cited by 125
NuActiv: recognizing unseen new activities using semantic attribute-based learning
Cheng, H.-T., Sun, F.-T., Griss, M., Davis, P., Li, J., & You, D. (2013) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2462456.2464438 · Cited by 121
Riboni, D., Sztyler, T., Civitarese, G., & Stuckenschmidt, H. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2971648.2971691 · Cited by 108
Adaptive mobile activity recognition system with evolving data streams
Abdallah, Z. S., Gaber, M. M., Srinivasan, B., & Krishnaswamy, S. P. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.09.074 · Cited by 105
Bächlin, M., Roggen, D., Tröster, G., Plotnik, M., Inbar, N., Meidan, I., Herman, T., Brozgol, M., Shaviv, E., Giladi, N., et al. (2009) · International Symposium on Wearable Computers · doi:10.1109/iswc.2009.14 · Cited by 100
KCAR: A knowledge-driven approach for concurrent activity recognition
Ye, J., Stevenson, G., & Dobson, S. (2014) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2014.02.003 · Cited by 94
OPPORTUNITY: Towards opportunistic activity and context recognition systems
Roggen, D., Förster, K., Calatroni, A., Holleczek, T., Fang, Y., Tröster, G., Ferscha, A., Holzmann, C., Riener, A., Lukowicz, P., et al. (2009) · IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM) · doi:10.1109/wowmom.2009.5282442 · Cited by 88
Probabilistic ontology based activity recognition in smart homes using Markov Logic Network
Gayathri, K., Easwarakumar, K. S., & Elias, S. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.01.025 · Cited by 88
Activity recognition: linking low-level sensors to high-level intelligence
Yang, Q. (2009) · Cited by 73
Tracking Activities in Complex Settings Using Smart Environment Technologies.
Singla, G., Cook, D. J., & Schmitter‐Edgecombe, M. (2009) · PubMed · Cited by 71
Slice&Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers
Pham, C., & Olivier, P. L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-05408-2_4 · Cited by 69
Active learning enabled activity recognition
Hossain, H. M. S., Roy, N., & Khan, M. A. A. H. (2016) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2016.7456524 · Cited by 62
Self-citationUsing Ultrasonic Hand Tracking to Augment Motion Analysis Based Recognition of Manipulative Gestures
Ogris, G., Stiefmeier, T., Junker, H., et al. (2005) · Proceedings · doi:10.1109/iswc.2005.54 · Cited by 55
Automated Functional and Behavioral Health Assessment of Older Adults with Dementia
Alam, M. A. U., Roy, N., Holmes, S., Gangopadhyay, A., & Galik, E. M. (2016) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1109/chase.2016.16 · Cited by 48
Self-citationInfrastructure-assisted smartphone-based ADL recognition in multi-inhabitant smart environments
Roy, N., Misra, A., & Cook, D. J. (2013) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2013.6526712 · Cited by 47
Self-citationA Survey on Wi-Fi Based Contactless Activity Recognition
Ma, J., Wang, H., Zhang, D., Wang, Y., & Wang, Y. (2016) · IEEE Smart World Congress and International Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People (SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP) · doi:10.1109/uic-atc-scalcom-cbdcom-iop-smartworld.2016.0170 · Cited by 46
MIMU-Wear: Ontology-based sensor selection for real-world wearable activity recognition
Villalonga, C., Pomares, H., Rojas, I., & Baños, O. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.09.125 · Cited by 40
Deep Learning for Human Activity Recognition
San, P. P., Kakar, P., Li, X., Krishnaswamy, S. P., Yang, J.-B., & Nguyen, M. N. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809393-1.00009-x · Cited by 35
TransAct: Transfer learning enabled activity recognition
Khan, M. A. A. H., & Roy, N. (2017) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2017.7917621 · Cited by 35
Self-citationDesigning and evaluating active learning methods for activity recognition
Bagaveyev, S., & Cook, D. J. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2638728.2641674 · Cited by 33
HealthyLife: An Activity Recognition System with Smartphone Using Logic-Based Stream Reasoning
Do, T. M., Loke, S. W., & Liu, F. (2013) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-40238-8_16 · Cited by 32
Synchronous dynamic view learning
Rokni, S. A., & Ghasemzadeh, H. G. (2017) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/3055031.3055087 · Cited by 30
Learning deep features for kNN-based human activity recognition.
Sani, S., Wiratunga, N., & Massie, S. (2017) · Open Access Institutional Repository at Robert Gordon University (Robert Gordon University) · Cited by 30
Active transfer learning for activity recognition
Diethe, T., Twomey, N., & Flach, P. A. (2016) · Bristol Research (University of Bristol) · Cited by 28
Alam, M. A. U., Roy, N., Misra, A., et al. (2016) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2016.61 · Cited by 28
Self-citationWoznowski, P., King, R., Harwin, W., & Craddock, I. J. (2016) · International Conference on Internet of Things, Big Data and Security (IoTBDS) · doi:10.5220/0005932503690377 · Cited by 27
Active learning with uncertainty sampling for large scale activity recognition in smart homes
Alemdar, H. O., van Kasteren, T. L. M., & Ersoy, C. (2017) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-170427 · Cited by 25
Faridee, A. Z. M., Ramamurthy, S. R., Hossain, H. M. S., & Roy, N. (2018) · IEEE Workshop on Mobile Computing Systems and Applications (WMCSA) · doi:10.1145/3177102.3177116 · Cited by 22
Self-citationUnTran: Recognizing Unseen Activities with Unlabeled Data Using Transfer Learning
Khan, M. A. A. H., & Roy, N. (2018) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi.2018.00014 · Cited by 22
Self-citationInfrastructure-less Occupancy Detection and Semantic Localization in Smart Environments
Khan, M. A. A. H., Hossain, H. M. S., & Roy, N. (2015) · EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous) · doi:10.4108/eai.22-7-2015.2260062 · Cited by 19
Self-citationTransfer Learning on High Variety Domains for Activity Recognition
Ying, J. J.-C., Lin, B.-H., Tseng, V. S. M., & Hsieh, S. (2015) · ASE BigData & SocialInformatics · doi:10.1145/2818869.2818890 · Cited by 11
Self-Adaptation of Activity Recognition Systems to New SensorsPreprint
Bannach, D., Jänicke, M., Rey, V. F., Tomforde, S., Sick, B., & Lukowicz, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08528 · Cited by 2
Research works printed but not linked: 3
- (IE) 2012 8th International Conference (pp. 214-221). IEEE.
- Khan M. A. A. H. Kukkapalli R. Waradpande P. Kulandaivel S. Banerjee N. Roy N. &Robucci R. (2016).Ram: Radar‐based activity monitor. Paper presented at the meeting of the INFOCOM 2016‐The 35th Annual IEEE International Conference on Computer Communications IEEE (pp. 1–9). IEEE. · DOI
- Pathak N. Khan M. A. A. H. &Roy N. (2015).Acoustic based appliance state identifications for fine‐grained energy analytics. Paper presented at the meeting of the Pervasive Computing and Communications (PerCom) 2015 I.E. International Conference (pp. 63–70). IEEE. · doi:10.1109/percom.2015.7146510
Cited by
Sensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730
Qiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
Ramanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455
Demrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368
LSTM Networks Using Smartphone Data for Sensor-Based Human Activity Recognition in Smart Homes
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Sensors · doi:10.3390/s21051636 · Cited by 335
Metadata
- Authors
- Ramasamy Ramamurthy, S., & Roy, N.
- Venue
- WIREs Data Mining and Knowledge Discovery
- Publisher
- Wiley
- Published
- 2018-03-28
- Volume
- 8
- Issue
- 4
- ISSN
- 1942-4787 (ISSN-L)
- 1942-4795
- OpenAlex
- W2794717185
- Cited by
- 299
- References
- 73
- FWCI
- 15.83
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Alzheimer's Association (AARG‐17‐533039)
- Office of Naval Research (N00014‐15‐1‐2229)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.