CoChat
Sign Up
PreprintCited by 21Context-Aware Activity Recognition SystemsIoT-based Smart Home SystemsHuman Mobility and Location-Based Analysis

The DOI matches its DataCite record.

Layout Agnostic Human Activity Recognition in Smart Homes through Textual Descriptions Of Sensor Triggers (TDOST)

Open access
Thukral, Megha, Dhekane, Sourish Gunesh, Hiremath, Shruthi K., Haresamudram, Harish, Ploetz, Thomas·2024·arXiv
DOI 10.48550/arxiv.2405.12368arXiv 2405.12368
Open this paper in CoChat — free account

Abstract

Human activity recognition (HAR) using ambient sensors in smart homes has numerous applications for human healthcare and wellness. However, building general-purpose HAR models that can be deployed to new smart home environments requires a significant amount of annotated sensor data and training overhead. Most smart homes vary significantly in their layouts, i.e., floor plans and the specifics of sensors embedded, resulting in low generalizability of HAR models trained for specific homes. We address this limitation by introducing a novel, layout-agnostic modeling approach for HAR systems in smart homes that utilizes the transferrable representational capacity of natural language descriptions of raw sensor data. To this end, we generate Textual Descriptions Of Sensor Triggers (TDOST) that encapsulate the surrounding trigger conditions and provide cues for underlying activities to the activity recognition models. Leveraging textual embeddings, rather than raw sensor data, we create activity recognition systems that predict standard activities across homes without either (re-)training or adaptation on target homes. Through an extensive evaluation, we demonstrate the effectiveness of TDOST-based models in unseen smart homes through experiments on benchmarked CASAS datasets. Furthermore, we conduct a detailed analysis of how the individual components of our approach affect downstream activity recognition performance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2405.12368

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 97

  1. [1][1] Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023). - · arXiv
  2. [2][2] Rebecca Adaimi and Edison Thomaz. 2019. Leveraging active learning and conditional mutual information to minimize data annotation in human activity recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1-23.
  3. [3][3] Nidhi Agarwal, Akanksha Sondhi, Khyati Chopra, and Ghanapriya Singh. 2021. Transfer learning: Survey and classification. Innovations in Communication and Computational Sciences: Proceedings of ICSICCS 2020 (2021), 145-155. -
  4. [4][4] Fadi Al Machot, Mohammed R. Elkobaisi, and Kyandoghere Kyamakya. 2020. Zero-shot human activity recognition using non-visual sensors. Sensors 20, 3 (2020), 825. -
  5. [5][5] Muhammad Raisul Alam, Mamun Bin Ibne Reaz, and Mohd Alauddin Mohd Ali. 2012. A review of smart homes-Past, present, and future. IEEE transactions on systems, man, and cybernetics, part C (applications and reviews) 42, 6 (2012), 1190-1203.
  6. [6][6] Hande Alemdar, Halil Ertan, Ozlem Durmaz Incel, and Cem Ersoy. 2013. ARAS human activity datasets in multiple homes with multiple residents. In 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops . IEEE, 232-235. -
  7. [7][7] Ardo Allik, Kristjan Pilt, Deniss Karai, Ivo Fridolin, Mairo Leier, and Gert Jervan. 2019. Optimization of physical activity recognition for real-time wearable systems: effect of window length, sampling frequency and number of features. Applied Sciences 9, 22 (2019), 4833. -
  8. [8][8] Samaneh Aminikhanghahi and Diane J Cook. 2017. Using change point detection to automate daily activity segmentation. In 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) . IEEE, 262-267. -
  9. [9][9] Samaneh Aminikhanghahi, Tinghui Wang, and Diane J Cook. 2018. Real-time change point detection with application to smart home time series data. IEEE Transactions on Knowledge and Data Engineering 31, 5 (2018), 1010-1023. -
  10. [10][10] Plamen P Angelov, Eduardo A Soares, Richard Jiang, Nicholas I Arnold, and Peter M Atkinson. 2021. Explainable artificial intelligence: an analytical review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 11, 5 (2021), e1424. -
  11. [11][11] Kevin Bascol, Rémi Emonet, and Elisa Fromont. 2019. Improving domain adaptation by source selection. In 2019 IEEE International Conference on Image Processing (ICIP) . IEEE, 3043-3047. This manuscript is under review. Please write to mthukral3@gatech.edu or sourish.dhekane@gatech.edu for up-to-date information Smart -
  12. [12][12] Vinay Bettadapura, Grant Schindler, Thomas Plötz, and Irfan Essa. 2013. Augmenting bag-of-words: Data-driven discovery of temporal and structural information for activity recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 2619-2626. -
  13. [13][13] Sudershan Boovaraghavan, Prasoon Patidar, and Yuvraj Agarwal. 2023. TAO: Context Detection from Daily Activity Patterns Using Temporal Analysis and Ontology. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1-32. -
  14. [14][14] Damien Bouchabou, Christophe Lohr, Ioannis Kanellos, and Sao Mai Nguyen. 2021. Human Activity Recognition (HAR) in smart homes. arXiv preprint arXiv:2112.11232 (2021). - · arXiv
  15. [15][15] Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit Leduc, and Ioannis Kanellos. 2021. Fully convolutional network bootstrapped by word encoding and embedding for activity recognition in smart homes. In Deep Learning for Human Activity Recognition: Second International Workshop, DL-HAR 2020, Held in Conjunction with IJCAI-PRICAI 2020, Kyoto, Japan, January 8, 2021, Proceedings 2 . Springer, 111-125. -
  16. [16][16] Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit LeDuc, and Ioannis Kanellos. 2021. A survey of human activity recognition in smart homes based on IoT sensors algorithms: Taxonomies, challenges, and opportunities with deep learning. Sensors 21, 18 (2021), 6037. -
  17. [17][17] Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit LeDuc, and Ioannis Kanellos. 2021. Using language model to bootstrap human activity recognition ambient sensors based in smart homes. Electronics 10, 20 (2021), 2498. -
  18. [18][18] Marie Chan, Daniel Estève, Christophe Escriba, and Eric Campo. 2008. A review of smart homes-Present state and future challenges. Computer methods and programs in biomedicine 91, 1 (2008), 55-81. -
  19. [19][19] Hang Chang, Ju Han, Cheng Zhong, Antoine M Snijders, and Jian-Hua Mao. 2017. Unsupervised transfer learning via multi-scale convolutional sparse coding for biomedical applications. IEEE transactions on pattern analysis and machine intelligence 40, 5 (2017), 1182-1194. -
  20. [20][20] Youngjae Chang, Akhil Mathur, Anton Isopoussu, Junehwa Song, and Fahim Kawsar. 2020. A systematic study of unsupervised domain adaptation for robust human-activity recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1-30. -
  21. [21][21] David Chatting. 2023. Automated Indifference. Interactions 30, 2 (2023), 22-26. -
  22. [22][22] Hui Chen, Charles Gouin-Vallerand, Kévin Bouchard, Sébastien Gaboury, Mélanie Couture, Nathalie Bier, and Sylvain Giroux. 2023. Leveraging Self-Supervised Learning for Human Activity Recognition with Ambient Sensors. In Proceedings of the 2023 ACM Conference on Information Technology for Social Good . 324-332. -
  23. [23][23] Hui Chen, Charles Gouin-Vallerand, Kévin Bouchard, Sébastien Gaboury, Mélanie Couture, Nathalie Bier, and Sylvain Giroux. 2024. Enhancing Human Activity Recognition in Smart Homes with Self-Supervised Learning and Self-Attention. Sensors 24, 3 (2024), 884. -
  24. [24][24] Liming Chen and Chris Nugent. 2009. Ontology-based activity recognition in intelligent pervasive environments. International Journal of Web Information Systems 5, 4 (2009), 410-430. -
  25. [25][25] Liming Chen and Chris D Nugent. 2019. Human activity recognition and behaviour analysis . Springer. -
  26. [26][26] Yi-ting Chiang and Jane Yung-jen Hsu. 2012. Knowledge transfer in activity recognition using sensor profile. In 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing . IEEE, 180-187. -
  27. [27][27] Diane J Cook. 2010. Learning setting-generalized activity models for smart spaces. IEEE intelligent systems 2010, 99 (2010), 1. -
  28. [28][28] Diane J Cook. 2020. AL Activity Learning-Smart Home. Retrieved April 28 (2020), 2023. -
  29. [29][29] Diane J Cook, Aaron S Crandall, Brian L Thomas, and Narayanan C Krishnan. 2012. CASAS: A smart home in a box. Computer 46, 7 (2012), 62-69. -
  30. [30][30] Diane J Cook, Narayanan C Krishnan, and Parisa Rashidi. 2013. Activity discovery and activity recognition: A new partnership. IEEE transactions on cybernetics 43, 3 (2013), 820-828. -
  31. [31][31] Diane J Cook, Michael Youngblood, Edwin O Heierman, Karthik Gopalratnam, Sira Rao, Andrey Litvin, and Farhan Khawaja. 2003. MavHome: An agent-based smart home. In Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003.(PerCom 2003). IEEE, 521-524. -
  32. [32][32] Gabriela Csurka. 2017. Domain adaptation for visual applications: A comprehensive survey. arXiv preprint arXiv:1702.05374 (2017). - · arXiv
  33. [33][33] Jessamyn Dahmen, Brian L Thomas, Diane J Cook, and Xiaobo Wang. 2017. Activity learning as a foundation for security monitoring in smart homes. Sensors 17, 4 (2017), 737. -
  34. [34][34] L Minh Dang, Kyungbok Min, Hanxiang Wang, Md Jalil Piran, Cheol Hee Lee, and Hyeonjoon Moon. 2020. Sensor-based and vision-based human activity recognition: A comprehensive survey. Pattern Recognition 108 (2020), 107561. -
  35. [35][35] Devleena Das, Yasutaka Nishimura, Rajan P Vivek, Naoto Takeda, Sean T Fish, Thomas Ploetz, and Sonia Chernova. 2023. Explainable activity recognition for smart home systems. ACM Transactions on Interactive Intelligent Systems 13, 2 (2023), 1-39. -
  36. [36][36] Oscar Day and Taghi M Khoshgoftaar. 2017. A survey on heterogeneous transfer learning. Journal of Big Data 4 (2017), 1-42. -
  37. [37][37] Sourish Gunesh Dhekane and Thomas Ploetz. 2024. Transfer Learning in Human Activity Recognition: A Survey. arXiv preprint arXiv:2401.10185 (2024). This manuscript is under review. Please write to mthukral3@gatech.edu or sourish.dhekane@gatech.edu for up-to-date information - · arXiv
  38. [38][38] Labiba Gillani Fahad, Syed Fahad Tahir, and Muttukrishnan Rajarajan. 2014. Activity recognition in smart homes using clustering based classification. In 2014 22nd International conference on pattern recognition . IEEE, 1348-1353. -
  39. [39][39] Abolfazl Farahani, Sahar Voghoei, Khaled Rasheed, and Hamid R Arabnia. 2021. A brief review of domain adaptation. Advances in data science and information engineering: proceedings from ICDATA 2020 and IKE 2020 (2021), 877-894. -
  40. [40][40] Benish Fida, Ivan Bernabucci, Daniele Bibbo, Silvia Conforto, Antonino Proto, and Maurizio Schmid. 2014. The effect of window length on the classification of dynamic activities through a single accelerometer. In Biomedical Engineering. In Proceedings of the IASTED International Conference Biomedical Engineering (BioMed), Zurich, Switerzland . 23-25. -
  41. [41][41] Benish Fida, Ivan Bernabucci, Daniele Bibbo, Silvia Conforto, and Maurizio Schmid. 2015. Varying behavior of different window sizes on the classification of static and dynamic physical activities from a single accelerometer. Medical engineering & physics 37, 7 (2015), 705-711. -
  42. [42][42] Alireza Ghods and Diane J Cook. 2019. Activity2vec: Learning adl embeddings from sensor data with a sequence-to-sequence model. arXiv preprint arXiv:1907.05597 (2019). - · arXiv
  43. [44][44] Liang Guo, Yaguo Lei, Saibo Xing, Tao Yan, and Naipeng Li. 2018. Deep convolutional transfer learning network: A new method for intelligent fault diagnosis of machines with unlabeled data. IEEE Transactions on Industrial Electronics 66, 9 (2018), 7316-7325. -
  44. [45][45] Junxian He, Chunting Zhou, Xuezhe Ma, Taylor Berg-Kirkpatrick, and Graham Neubig. 2021. Towards a unified view of parameterefficient transfer learning. arXiv preprint arXiv:2110.04366 (2021). - · arXiv
  45. [46][46] Sumi Helal, William Mann, Hicham El-Zabadani, Jeffrey King, Youssef Kaddoura, and Erwin Jansen. 2005. The gator tech smart house: A programmable pervasive space. Computer 38, 3 (2005), 50-60. -
  46. [47][47] Shruthi K Hiremath, Yasutaka Nishimura, Sonia Chernova, and Thomas Plötz. 2022. Bootstrapping human activity recognition systems for smart homes from scratch. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1-27. -
  47. [48][48] Shruthi K Hiremath and Thomas Plötz. 2020. Deriving effective human activity recognition systems through objective task complexity assessment. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1-24. -
  48. [49][49] Shruthi K Hiremath and Thomas Plötz. 2023. The Lifespan of Human Activity Recognition Systems for Smart Homes. Sensors 23, 18 (2023), 7729. -
  49. [50][50] Clare J Hooper, Anne Preston, Madeline Balaam, Paul Seedhouse, Daniel Jackson, Cuong Pham, Cassim Ladha, Karim Ladha, Thomas Plötz, and Patrick Olivier. 2012. The french kitchen: Task-based learning in an instrumented kitchen. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing . 193-202. -
  50. [51][51] Enamul Hoque and John Stankovic. 2012. AALO: Activity recognition in smart homes using Active Learning in the presence of Overlapped activities. In 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops . IEEE, 139-146. -
  51. [52][52] Asmaul Hosna, Ethel Merry, Jigmey Gyalmo, Zulfikar Alom, Zeyar Aung, and Mohammad Abdul Azim. 2022. Transfer learning: a friendly introduction. Journal of Big Data 9, 1 (2022), 102. -
  52. [53][53] Derekhao Hu and Qiang Yang. 2011. Transfer learning for activity recognition via sensor mapping. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Barcelona, Catalonia, Spain . 1962. -
  53. [54][54] Stephen S Intille, Ling Bao, Emmanuel Munguia Tapia, and John Rondoni. 2004. Acquiring in situ training data for context-aware ubiquitous computing applications. In Proceedings of the SIGCHI conference on Human factors in computing systems . 1-8. -
  54. [55][55] Stephen S Intille, Kent Larson, Jennifer Beaudin, E Munguia Tapia, Pallavi Kaushik, Jason Nawyn, and Thomas J McLeish. 2005. The PlaceLab: A live-in laboratory for pervasive computing research (video). Proceedings of PERVASIVE 2005 Video Program (2005). -
  55. [56][56] Shashank Mohan Jain. 2022. Hugging face. In Introduction to transformers for NLP: With the hugging face library and models to solve problems . Springer, 51-67. -
  56. [57][57] Md Abdullah Al Hafiz Khan and Nirmalya Roy. 2018. Untran: Recognizing unseen activities with unlabeled data using transfer learning. In 2018 IEEE/ACM Third International Conference on Internet-of-Things Design and Implementation (IoTDI) . IEEE, 37-47. -
  57. [58][58] Julie A Kientz, Shwetak N Patel, Brian Jones, ED Price, Elizabeth D Mynatt, and Gregory D Abowd. 2008. The georgia tech aware home. In CHI'08 extended abstracts on Human factors in computing systems . 3675-3680. -
  58. [59][59] Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). - · arXiv
  59. [60][60] Barış Koçer and Ahmet Arslan. 2010. Genetic transfer learning. Expert Systems with Applications 37, 10 (2010), 6997-7002. -
  60. [61][61] Farzana Kulsoom, Sanam Narejo, Zahid Mehmood, Hassan Nazeer Chaudhry, Ayesha Butt, and Ali Kashif Bashir. 2022. A review of machine learning-based human activity recognition for diverse applications. Neural Computing and Applications 34, 21 (2022), 18289-18324. -
  61. [62][62] Linjie Li, Zhe Gan, Yu Cheng, and Jingjing Liu. 2019. Relation-aware graph attention network for visual question answering. In Proceedings of the IEEE/CVF international conference on computer vision . 10313-10322. -
  62. [63][63] Yuhang Li, Xin Dong, Chen Chen, Jingtao Li, Yuxin Wen, Michael Spranger, and Lingjuan Lyu. 2024. Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization. arXiv preprint arXiv:2403.19866 (2024). This manuscript is under review. Please write to mthukral3@gatech.edu or sourish.dhekane@gatech.edu for up-to-date information - · arXiv
  63. [64][64] Daniele Liciotti, Michele Bernardini, Luca Romeo, and Emanuele Frontoni. 2020. A sequential deep learning application for recognising human activities in smart homes. Neurocomputing 396 (2020), 501-513. -
  64. [65][65] Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. 2024. Visual instruction tuning. Advances in neural information processing systems 36 (2024). -
  65. [66][66] Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019). - · arXiv
  66. [67][67] Andreas Maurer, Massi Pontil, and Bernardino Romera-Paredes. 2013. Sparse coding for multitask and transfer learning. In International conference on machine learning . PMLR, 343-351. -
  67. [68][68] Plinio P Morita, Kirti Sundar Sahu, and Arlene Oetomo. 2023. Health monitoring using smart home technologies: Scoping review. JMIR mHealth and uHealth 11 (2023), e37347. -
  68. [69][69] Jianmo Ni, Gustavo Hernandez Abrego, Noah Constant, Ji Ma, Keith B Hall, Daniel Cer, and Yinfei Yang. 2021. Sentence-t5: Scalable sentence encoders from pre-trained text-to-text models. arXiv preprint arXiv:2108.08877 (2021). - · arXiv
  69. [70][70] Francisco Javier Ordóñez and Daniel Roggen. 2016. Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors 16, 1 (2016), 115. -
  70. [71][71] Sinno Jialin Pan and Qiang Yang. 2009. A survey on transfer learning. IEEE Transactions on knowledge and data engineering 22, 10 (2009), 1345-1359. -
  71. [72][72] Archit Parnami and Minwoo Lee. 2022. Learning from few examples: A summary of approaches to few-shot learning. arXiv preprint arXiv:2203.04291 (2022). - · arXiv
  72. [73][73] Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019). -
  73. [74][74] Xin Qin, Yiqiang Chen, Jindong Wang, and Chaohui Yu. 2019. Cross-dataset activity recognition via adaptive spatial-temporal transfer learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (2019), 1-25. -
  74. [75][75] Bronagh Quigley, Mark Donnelly, George Moore, and Leo Galway. 2018. A comparative analysis of windowing approaches in dense sensing environments. In Proceedings , Vol. 2. MDPI, 1245. -
  75. [76][76] Rajat Raina, Alexis Battle, Honglak Lee, Benjamin Packer, and Andrew Y Ng. 2007. Self-taught learning: transfer learning from unlabeled data. In Proceedings of the 24th international conference on Machine learning . 759-766. -
  76. [77][77] Nazneen Fatema Rajani, Bryan McCann, Caiming Xiong, and Richard Socher. 2019. Explain yourself! leveraging language models for commonsense reasoning. arXiv preprint arXiv:1906.02361 (2019). - · arXiv
  77. [78][78] Parisa Rashidi and Diane J Cook. 2009. Keeping the resident in the loop: Adapting the smart home to the user. IEEE Transactions on systems, man, and cybernetics-part A: systems and humans 39, 5 (2009), 949-959. -
  78. [79][79] Parisa Rashidi and Diane J Cook. 2011. Domain selection and adaptation in smart homes. In International Conference on Smart Homes and Health Telematics . Springer, 17-24. -
  79. [80][80] Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084 (2019). - · arXiv
  80. [81][81] Yarden Rotem, Nathaniel Shimoni, Lior Rokach, and Bracha Shapira. 2022. Transfer learning for time series classification using synthetic data generation. In International Symposium on Cyber Security, Cryptology, and Machine Learning . Springer, 232-246. -
  81. [82][82] Andrea Rosales Sanabria, Franco Zambonelli, and Juan Ye. 2021. Unsupervised domain adaptation in activity recognition: A GAN-based approach. IEEE Access 9 (2021), 19421-19438. -
  82. [83][83] Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. ArXiv abs/1910.01108 (2019). - · arXiv
  83. [84][84] Mohamed Sedky, Christopher Howard, Talal Alshammari, and Nasser Alshammari. 2018. Evaluating machine learning techniques for activity classification in smart home environments. International Journal of Information Systems and Computer Sciences 12, 2 (2018), 48-54. -
  84. [86][86] Deepika Singh, Erinc Merdivan, Sten Hanke, Johannes Kropf, Matthieu Geist, and Andreas Holzinger. 2017. Convolutional and recurrent neural networks for activity recognition in smart environment. In Towards Integrative Machine Learning and Knowledge Extraction: BIRS Workshop, Banff, AB, Canada, July 24-26, 2015, Revised Selected Papers . Springer, 194-205. -
  85. [87][87] Jake Snell, Kevin Swersky, and Richard Zemel. 2017. Prototypical networks for few-shot learning. Advances in neural information processing systems 30 (2017). -
  86. [88][88] Qianru Sun, Yaoyao Liu, Tat-Seng Chua, and Bernt Schiele. 2019. Meta-transfer learning for few-shot learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 403-412. -
  87. [89][89] Flood Sung, Yongxin Yang, Li Zhang, Tao Xiang, Philip HS Torr, and Timothy M Hospedales. 2018. Learning to compare: Relation network for few-shot learning. In Proceedings of the IEEE conference on computer vision and pattern recognition . 1199-1208. This manuscript is under review. Please write to mthukral3@gatech.edu or sourish.dhekane@gatech.edu for up-to-date information -
  88. [91][91] Tianyang Wang, Jun Huan, and Michelle Zhu. 2019. Instance-based deep transfer learning. In 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) . IEEE, 367-375. -
  89. [92][92] Yaqing Wang, Quanming Yao, James T Kwok, and Lionel M Ni. 2020. Generalizing from a few examples: A survey on few-shot learning. ACM computing surveys (csur) 53, 3 (2020), 1-34. -
  90. [93][93] Karl Weiss, Taghi M Khoshgoftaar, and DingDing Wang. 2016. A survey of transfer learning. Journal of Big data 3 (2016), 1-40. -
  91. [94][94] Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. 2019. Huggingface's transformers: State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771 (2019). - · arXiv
  92. [95][95] Renzhi Wu, Nilaksh Das, Sanya Chaba, Sakshi Gandhi, Duen Horng Chau, and Xu Chu. 2022. A cluster-then-label approach for few-shot learning with application to automatic image data labeling. ACM Journal of Data and Information Quality (JDIQ) 14, 3 (2022), 1-23. -
  93. [96][96] Xiaohua Zhai, Avital Oliver, Alexander Kolesnikov, and Lucas Beyer. 2019. S4l: Self-supervised semi-supervised learning. In Proceedings of the IEEE/CVF international conference on computer vision . 1476-1485. -
  94. [97][97] Nanxuan Zhao, Zhirong Wu, Rynson WH Lau, and Stephen Lin. 2020. What makes instance discrimination good for transfer learning? arXiv preprint arXiv:2006.06606 (2020). - · arXiv
  95. [98][98] Jie Zhou, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, and Maosong Sun. 2020. Graph neural networks: A review of methods and applications. AI open 1 (2020), 57-81. -
  96. [99][99] Xuhui Zhou, Yue Zhang, Leyang Cui, and Dandan Huang. 2020. Evaluating commonsense in pre-trained language models. In Proceedings of the AAAI conference on artificial intelligence , Vol. 34. 9733-9740. -
  97. [100][100] Fuzhen Zhuang, Zhiyuan Qi, Keyu Duan, Dongbo Xi, Yongchun Zhu, Hengshu Zhu, Hui Xiong, and Qing He. 2020. A comprehensive survey on transfer learning. Proc. IEEE 109, 1 (2020), 43-76. This manuscript is under review. Please write to mthukral3@gatech.edu or sourish.dhekane@gatech.edu for up-to-date information Table 4. Mapping of activities into the common activity set

Cited by

Sorted by citations

Metadata

Authors
Thukral, M., Dhekane, S. G., Hiremath, S. K., Haresamudram, H., & Ploetz, T.
Affiliations
Georgia Institute of Technology (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
9
Issue
1
Pages
1-38
ISSN
2474-9567 (ISSN-L)
DOI
10.48550/arxiv.2405.12368
arXiv
2405.12368
OpenAlex
W4408148027
Cited by
21
References
0
Citations by year
2026: 12 · 2025: 9
FWCI
7.42
Type
journal article
Language
en
Open access
Licence
Locations
  • Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Universitas Brawijaya (2112633, 87483789)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
  • Social Sciences › Transportation › Human Mobility and Location-Based Analysis
Keywords
human activity recognition, home automation, ambient sensors, natural language descriptions, text embeddings, domain generalization, transfer learning, healthcare monitoring, CASAS

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review