Context Recognition In-the-Wild: Unified Model for Multi-Modal Sensors and Multi-Label Classification
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Automatic recognition of behavioral context (location, activities, body-posture etc.) can serve health monitoring, aging care, and many other domains. Recognizing context in-the-wild is challenging because of great variability in behavioral patterns, and it requires a complex mapping from sensor features to predicted labels. Data collected in-the-wild may be unbalanced and incomplete, with cases of missing labels or missing sensors. We propose using the multiple layer perceptron (MLP) as a multi-task model for context recognition. Based on features from multi-modal sensors, the model simultaneously predicts many diverse context labels. We analyze the advantages of the model's hidden layers, which are shared among all sensors and all labels, and provide insight to the behavioral patterns that these hidden layers may capture. We demonstrate how recognition of new labels can be improved when utilizing a model that was trained for an initial set of labels, and show how to train the model to withstand missing sensors. We evaluate context recognition on the previously published ExtraSensory Dataset, which was collected in-the-wild. Compared to previously suggested models, the MLP improves recognition, even with fewer parameters than a linear model. The ability to train a good model using data that has incomplete, unbalanced labeling and missing sensors encourages further research with uncontrolled, in-the-wild behavior.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
(2014) · Cited by 33,419
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 3×
“[7] targeted six body states and used a built-in accelerometer in a smartphone that was placed in the participants’ front pant pocket.”
Method(2011) · Cited by 2,752
The Balanced Accuracy and Its Posterior Distribution
Brodersen, K. H., Ong, C. S., Stephan, K. E., & Buhmann, J. M. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.764 · Cited by 1,816 · cited 1×
“A convenient way to consider both sensitivity and specificity is simply to average them, resulting in the balanced accuracy metric [1], whose chance level is always 0.”
BackgroundProceedings of the 29th International Conference on Machine Learning (ICML-12)
Langford, J. C., & Pineau, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4676 · Cited by 1,618
Ermes, M., Parkka, J., Mantyjarvi, J., & Korhonen, I. (2008) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2007.899496 · Cited by 707 · cited 3×
“[3] addressed some aspects of in-the-wild behavior.”
BackgroundMethodDetecting activities of daily living in first-person camera views
Pirsiavash, H., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248010 · Cited by 649 · cited 7×
“We perform the action-recognition task that they describe in [15], where each item is a pre-segmented clip annotated with a single action out of eighteen.”
BackgroundMethodInfluentialOptimal Thresholding of Classifiers to Maximize F1 Measure
Lipton, Z. C., Elkan, C., & Naryanaswamy, B. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-662-44851-9_15 · Cited by 596 · cited 1×
“This effect can result in misleading conclusions when comparing two systems [9].”
ResultRecognizing Detailed Human Context in the Wild from Smartphones and Smartwatches
Vaizman, Y., Ellis, K., & Lanckriet, G. (2017) · IEEE Pervasive Computing · doi:10.1109/mprv.2017.3971131 · Cited by 324
Self-citationRecognizing human motion with multiple acceleration sensors
Mantyjarvi, J., Himberg, J., & Seppanen, T. (2002) · 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236) · doi:10.1109/icsmc.2001.973004 · Cited by 323 · cited 3×
“Previous studies used MLP for the multi-class setting, where the purpose was selecting a single activity (the one with highest probability output) out of a set of mutually-exclusive options [3, 4, 7, 12, 16].”
Method
Research works printed but not linked: 1
- 10.5555/2627435.2670313 · doi:10.5555/2627435.2670313
Cited by
Robust human locomotion and localization activity recognition over multisensory
Khan, D., Alonazi, M., Abdelhaq, M., Mudawi, N. A., Algarni, A. M., Jalal, A., & Liu, H. (2024) · Frontiers in Physiology · doi:10.3389/fphys.2024.1344887 · Cited by 220
Cruciani, F., Vafeiadis, A., Nugent, C., Cleland, I., McCullagh, P., Votis, K., Giakoumis, D., Tzovaras, D., Chen, L., & Hamzaoui, R. (2020) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-020-00026-2 · Cited by 142
“The data-set, however, contained recordings where the feature vector per recording was larger than the (≈ 430 ) × 13 , as described in the original paper (Vaizman 2017).”
MethodInternet of Things (IoT) Based Activity Recognition Strategies in Smart Homes: A Review
Babangida, L., Perumal, T., Mustapha, N., & Yaakob, R. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3161797 · Cited by 149
ExtraSensory App: Data Collection In-the-Wild with Rich User Interface to Self-Report Behavior
Vaizman, Y., Ellis, K., Lanckriet, G., & Weibel, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174128 · Cited by 115
Self-citationColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
Real-time Arm Skeleton Tracking and Gesture Inference Tolerant to Missing Wearable Sensors
Liu, Y., Li, Z., Liu, Z., & Wu, K. (2019) · Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3307334.3326109 · Cited by 71
Advanced IoT-Based Human Activity Recognition and Localization Using Deep Polynomial Neural Network
Khan, D., Alshahrani, A. S., Almjally, A., Mudawi, N. A., Algarni, A. M., Alnowaiser, K., & Jalal, A. (2024) · IEEE Access · doi:10.1109/access.2024.3420752 · Cited by 74
Intelligent Localization and Deep Human Activity Recognition through IoT Devices
Alazeb, A., Azmat, U., Mudawi, N. A., Alshahrani, A. S., Alotaibi, S. S., Almujally, N. A., & Jalal, A. (2023) · Sensors · doi:10.3390/s23177363 · Cited by 64
A Wearable Inertial Sensor Approach for Locomotion and Localization Recognition on Physical Activity
Khan, D., Mudawi, N. A., Abdelhaq, M., Alazeb, A., Alotaibi, S. S., Algarni, A. M., & Jalal, A. (2024) · Sensors · doi:10.3390/s24030735 · Cited by 68
SAMoSA: Sensing Activities with Motion and Subsampled Audio
Mollyn, V., Ahuja, K., Verma, D., Harrison, C., & Goel, M. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550284 · Cited by 82
Tarafdar, P., & Bose, I. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113426 · Cited by 54
FLAME: Federated Learning across Multi-device Environments
Cho, H., Mathur, A., & Kawsar, F. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550289 · Cited by 79
A Method for Sensor-Based Activity Recognition in Missing Data Scenario
Hossain, T., Ahad, M. A. R., & Inoue, S. (2020) · Sensors · doi:10.3390/s20143811 · Cited by 52
Real‐world multimodal lifelog dataset for human behavior study
Chung, S., Jeong, C. Y., Lim, J., Lim, J., Noh, K. J., Kim, G., & Jeong, H. (2021) · ETRI Journal · doi:10.4218/etrij.2020-0446 · Cited by 48
Investigating the Role of Context in Perceived Stress Detection in the Wild
Mishra, V., Tian, H., Sun, S. Y., Walter, K. N., Ball, M. J., Chen, C.-H., & Zhu, X. (2018) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3267305.3267537 · Cited by 40
Leveraging Sound and Wrist Motion to Detect Activities of Daily Living with Commodity Smartwatches
Bhattacharya, S., Adaimi, R., & Thomaz, E. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534582 · Cited by 55
Mudawi, N. A., Azmat, U., Alazeb, A., Alhasson, H. F., Alabdullah, B. I., Rahman, H., Liu, H., & Jalal, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-94689-5 · Cited by 41
Ehatisham-ul-Haq, M., & Azam, M. A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.003 · Cited by 37
Semi-supervised learning for human activity recognition using adversarial autoencoders
Balabka, D. (2019) · Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers · doi:10.1145/3341162.3344854 · Cited by 36
Ohn-Bar, E., Guerreiro, J., Kitani, K., & Asakawa, C. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3264941 · Cited by 32
“, task performance time, reaction time, motion analysis) has been long-studied in interactive and ubiquitous technologies [23, 24, 57, 59, 62, 70].”
BackgroundEhatisham-ul-Haq, M., Azam, M. A., Amin, Y., & Naeem, U. (2020) · IEEE Access · doi:10.1109/access.2020.2964237 · Cited by 34
ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the Body
Mahmud, S., Parikh, V., Liang, Q., Li, K., Zhang, R., Ajit, A., Gunda, V., Agarwal, D., Guimbretière, F. V., & Zhang, C. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699752 · Cited by 42
Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition
Miao, S., Chen, L., & Hu, R. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3631415 · Cited by 23
Federated Meta-Learning with Attention for Diversity-Aware Human Activity Recognition
Shen, Q., Feng, H., Song, R., Song, D., & Xu, H. (2023) · Sensors · doi:10.3390/s23031083 · Cited by 31
“The work in [36] treats the task of activity recognition as a multi-label classification problem and uses MLP as the classifier, which improves accurate recognition with fewer parameters.”
BackgroundChen, L., Hu, R., Wu, M., & Zhou, X. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610909 · Cited by 36
Synthesizing and Reconstructing Missing Sensory Modalities in Behavioral Context Recognition
Saeed, A., Ozcelebi, T., & Lukkien, J. (2018) · Sensors · doi:10.3390/s18092967 · Cited by 22
Frank, A. E., Kubota, A., & Riek, L. D. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968615 · Cited by 24
A closer look at quality-aware runtime assessment of sensing models in multi-device environments
Min, C., Montanari, A., Mathur, A., & Kawsar, F. (2019) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3356250.3360043 · Cited by 30
Federated Multi-task Learning with Hierarchical Attention for Sensor Data Analytics
Chen, Y., Ning, Y., Chai, Z., & Rangwala, H. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207508 · Cited by 32
Smart user experience medical app interface design based on mobile devices
Zhang, Q., & Liu, Y. (2021) · Expert Systems · doi:10.1111/exsy.12808 · Cited by 21
Handling Missing Sensors in Topology-Aware IoT Applications with Gated Graph Neural Network
Liu, S., Yao, S., Huang, Y., Liu, D., Shao, H., Zhao, Y., Li, J., Wang, T., Wang, R., Yang, C., et al. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411818 · Cited by 20
High-Performance Real-Time Human Activity Recognition Using Machine Learning
Pardhu, T., Acharya, B., & Moreira, F. (2024) · Mathematics · doi:10.3390/math12223622 · Cited by 26
Yang, X., Xu, Z., Liu, H., Shull, P. B., Redmond, S. J., Liu, G., & Wang, C. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3400022 · Cited by 21
HabitSense: A Privacy-Aware, AI-Enhanced Multimodal Wearable Platform for mHealth Applications
Fernandes, G. J., Zheng, J., Pedram, M., Romano, C., Shahabi, F., Rothrock, B., Cohen, T., Zhu, H., Butani, T. S., Hester, J. D., et al. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678591 · Cited by 29
Zhao, Y., Guo, S., Chen, Z., Shen, Q., Meng, Z., & Xu, H. (2022) · Applied Sciences · doi:10.3390/app12115408 · Cited by 20
Inferring Transportation Mode and Human Activity from Mobile Sensing in Daily Life
Liono, J., Abdallah, Z. S., Qin, A. K., & Salim, F. D. (2018) · EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous) · doi:10.1145/3286978.3287006 · Cited by 19
Augmented Adversarial Learning for Human Activity Recognition with Partial Sensor Sets
Kang, H., Huang, Q., & Zhang, Q. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550285 · Cited by 16
Temporal Action Localization for Inertial-based Human Activity Recognition
Bock, M., Moeller, M., & Laerhoven, K. V. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699770 · Cited by 29
Intelligent biosensors for human movement rehabilitation and intention recognition
Rafiq, M., Almujally, N. A., Algarni, A. M., Alshehri, M., Alqahtani, Y., Jalal, A., & Liu, H. (2025) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2025.1558529 · Cited by 16
Using Smartphone Accelerometer for Human Physical Activity and Context Recognition in-the-Wild
Ehatisham-ul-Haq, M., Azam, M. A., Asim, Y., Amin, Y., Naeem, U., & Khalid, A. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.10.007 · Cited by 16
Advancing Activity Recognition With Multimodal Fusion and Transformer Techniques
Aidarova, S., Nurmakhan, T., Myrzakhan, R., Fazli, S., & Yazıcı, A. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3555663 · Cited by 18
Context-Aware Complex Human Activity Recognition Using Hybrid Deep Learning Models
Omolaja, A., Otebolaku, A., & Alfoudi, A. S. D. (2022) · Applied Sciences · doi:10.3390/app12189305 · Cited by 21
A Deep Learning Framework for Healthy Lifestyle Monitoring and Outdoor Localization
Rafiq, M., Alshammari, N. S., Alhasson, H. F., AlHammadi, D. A., Alshehri, M., Jalal, A., & Liu, H. (2025) · IEEE Access · doi:10.1109/access.2025.3573439 · Cited by 14
A Comparative Study on Missing Data Handling Using Machine Learning for Human Activity Recognition
Hossain, T., & Inoue, S. (2019) · International Conference on Informatics, Electronics & Vision (ICIEV) · doi:10.1109/iciev.2019.8858520 · Cited by 18
Understanding practices and needs of researchers in human state modeling by passive mobile sensing
Xu, X., Mankoff, J. C., & Dey, A. K. (2021) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-021-00072-4 · Cited by 19
HAR-GCNN: Deep Graph CNNs for Human Activity Recognition From Highly Unlabeled Mobile Sensor Data
Mohamed, A., Lejarza, F., Cahail, S., Claudel, C., & Thomaz, E. (2022) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops53856.2022.9767342 · Cited by 21
Zhang, L., Zhang, W., & Japkowicz, N. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412851 · Cited by 13
Le, H., Lakshminarayanan, R., Li, J., Mishra, V., & Intille, S. S. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678584 · Cited by 18
Context recognition and ubiquitous computing in smart cities: a systematic mapping
do Nascimento, L. V., Machado, G. M., Maran, V., & de Oliveira, J. P. M. (2021) · Computing · doi:10.1007/s00607-020-00878-7 · Cited by 15
Multi-Resident Activity Recognition with Unseen Classes in Smart Homes
Wang, W., & Miao, C. (2018) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/smartworld.2018.00147 · Cited by 13
DeepContext: Parameterized Compatibility-Based Attention CNN for Human Context Recognition
Alajaji, A. S., Gerych, W., Chandrasekaran, K., Buquicchio, L., Agu, E., & Rundensteiner, E. A. (2020) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc.2020.00015 · Cited by 12
“, walking and talking on the phone), DeepContext formulates the HCR problem as a multi-label classification problem in a manner similar to Vaizman et al [26].”
BackgroundMethodResultInfluentialBhattarai, U., Maraseni, T., Devkota, L. P., & Apan, A. (2023) · Energy and AI · doi:10.1016/j.egyai.2023.100303 · Cited by 11
DELFI: Mislabelled Human Context Detection Using Multi-Feature Similarity Linking
Mansoor, H., Gerych, W., Buquicchio, L., Chandrasekaran, K., Agu, E., & Rundensteiner, E. A. (2019) · IEEE Visualization in Data Science (VDS) · doi:10.1109/vds48975.2019.8973382 · Cited by 11
ARGUS: Interactive visual analysis of disruptions in smartphone-detected Bio-Behavioral Rhythms
Mansoor, H., Gerych, W., Alajaji, A. S., Buquicchio, L., Chandrasekaran, K., Agu, E., & Rundensteiner, E. A. (2021) · Visual Informatics · doi:10.1016/j.visinf.2021.07.001 · Cited by 11
Rajak, S., Bose, D., Saha, A., & Chowdhury, C. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12261-z · Cited by 11
Poli, A., Spinsante, S., Nugent, C., & Cleland, I. (2019) · Computer communications and networks · doi:10.1007/978-3-030-25590-9_7 · Cited by 10
On the Homogenization of Heterogeneous Inertial-Based Databases for Human Activity Recognition
Ferrari, A., Mobilio, M., Micucci, D., & Napoletano, P. (2019) · IEEE World Congress on Services (SERVICES) · doi:10.1109/services.2019.00084 · Cited by 12
“walking physical activity [15], [16], [17] dynamic activity [18], [19] ADL [20], [18], [21] simple activity [22], [23] basic and common activities in people’s daily living [24] common activities in people’s daily living [25] daily living human activities [26] basic movement [27] daily activity [28], [29] body state [3…”
BackgroundEnd-to-End Multi-Modal Behavioral Context Recognition in a Real-Life Setting
Saeed, A., Özçelebi, T., Trajanovski, S., & Lukkien, J. J. (2019) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011194 · Cited by 10
“The models achieved this performance without any sophisticated pre-processing, manual feature extraction or utilization of smart-watch accelerometer as opposed to [17].”
BackgroundMethodInfluentialPattamaset, S., & Choi, J. S. (2020) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147720929828 · Cited by 9
A Smart Chair Design for Recognizing Human-Object Interactions using Pressure Sensors
Usman, M., Noor, Z., Farooq, I., Arsalan, A., Ehatisham-ul-Haq, M., & Raheel, A. (2020) · IEEE International Multitopic Conference (INMIC) · doi:10.1109/inmic50486.2020.9318102 · Cited by 9
PATCH: A Plug-in Framework of Non-blocking Inference for Distributed Multimodal System
Wang, J., Wang, G., Zhang, X., Liu, L., Zeng, H., Xiao, L., Cao, Z., Gu, L., & Li, T. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610885 · Cited by 18
SensiX: A System for Best-effort Inference of Machine Learning Models in Multi-device Environments
Min, C., Mathur, A., Montanari, A., & Kawsar, F. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3173914 · Cited by 10
On-device modeling of user’s social context and familiar places from smartphone-embedded sensor data
Campana, M. G., & Delmastro, F. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103438 · Cited by 9
Heterogeneous Hyper-Graph Neural Networks for Context-Aware Human Activity Recognition
Ge, W., Mou, G., Agu, E., & Lee, K. (2023) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops56833.2023.10150328 · Cited by 10
Improving Experience Sampling with Multi-view User-driven Annotation Prediction
Liono, J., Salim, F. D., van Berkel, N., Kostakos, V., & Qin, A. K. (2019) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2019.8767394 · Cited by 8
Sinkhole Attack in Multi-sink Paradigm: Detection and Performance Evaluation in RPL based IoT
Iqbal, M. M., Ahmed, A., & Khadam, U. (2020) · International Conference on Computing and Information Technology (ICCIT) · doi:10.1109/iccit-144147971.2020.9213797 · Cited by 14
Feasibility and Utility of Multimodal Micro Ecological Momentary Assessment on a Smartwatch
Le, H., Potter, V., Lakshminarayanan, R., Mishra, V., & Intille, S. S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714086 · Cited by 13
Khayami, H., Wang, L., Kim, Y., Lee, B., Conroy, D. E., Lazar, A., Choe, E. K., & Kacorri, H. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3731749 · Cited by 8
Zheng, H. M., Mahapasuthanon, P., Chen, Y., Rangwala, H., Evmenova, A. S., & Motti, V. G. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471220 · Cited by 9
“The dataset generated by Vaizman et al. (2018) tracked users’ behavior in activities such as walking, sitting, and laying down, using self-reported context labels [62].”
Fatima, S. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3476475 · Cited by 9
Employing Environmental Data and Machine Learning to Improve Mobile Health Receptivity
Theilig, M.-M., Korbel, J. J., Mayer, G., Hoffmann, C., & Zarnekow, R. (2019) · IEEE Access · doi:10.1109/access.2019.2958474 · Cited by 11
Synergy: Towards On-Body AI via Tiny AI Accelerator Collaboration on Wearables
Gong, T., Jang, S. Y., Acer, U. G., Kawsar, F., & Min, C. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3564314 · Cited by 20
CRUFT: Context Recognition under Uncertainty using Fusion and Temporal Learning
Ge, W., & Agu, E. (2020) · International Conference on Machine Learning and Applications · doi:10.1109/icmla51294.2020.00122 · Cited by 9
ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs
Ditthapron, A., Lammert, A. C., & Agu, E. (2022) · IEEE Access · doi:10.1109/access.2023.3271409 · Cited by 7
Tian, J.-L., Saddik, A. E., Xu, X., Li, D.-S., Cao, Z., & Shen, H. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3362948 · Cited by 5
Smartphone Health Biomarkers: Positive Unlabeled Learning of In-the-Wild Contexts
Alajaji, A. S., Gerych, W., Buquicchio, L., Chandrasekaran, K., Mansoor, H., Agu, E., & Rundensteiner, E. A. (2021) · IEEE Pervasive Computing · doi:10.1109/mprv.2021.3051869 · Cited by 6
Exploring the Impact of the NULL Class on In-the-Wild Human Activity Recognition
Cherian, J., Ray, S., Taele, P., Koh, J. I., & Hammond, T. (2024) · Sensors · doi:10.3390/s24123898 · Cited by 6
AutoAct: An Auto Labeling Approach Based on Activities of Daily Living in the Wild Domain
Hassan, I., Mursalin, A., Salam, R. B., Sakib, N., & Haque, H. M. Z. (2021) · International Conference on Informatics, Electronics & Vision (ICIEV) · doi:10.1109/icievicivpr52578.2021.9564211 · Cited by 6
Hierarchical human activity recognition with fusion of audio and multiple inertial sensor modalities
Yılmaz, T. A., Yatbaz, H. Y., Ever, E., & Yazici, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-29801-w · Cited by 3
Semantically Encoding Activity Labels for Context-Aware Human Activity Recognition
Ge, W., Mou, G., Agu, E., & Lee, K. (2025) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom64205.2025.00039 · Cited by 5
A Study on the Influence of Sensors in Frequency and Time Domains on Context Recognition
de Souza, P., Silva, D., de Andrade, I., Dias, J., Lima, J. P., Teichrieb, V., Quintino, J. P., da Silva, F. Q. B., & Santos, A. L. M. (2023) · Sensors · doi:10.3390/s23125756 · Cited by 4
“[9,19] created a mobile application for HAR using wearable sensors such as accelerometers, gyroscopes, and magnetometers.”
BackgroundMethodInfluentialDitthapron, A., Lammert, A. C., & Agu, E. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3290820 · Cited by 4
Towards Adaptive Asynchronous Federated Learning for Human Activity Recognition
Gajanin, R., Danilenka, A., Morichetta, A., & Nastić, S. (2024) · International Conference on the Internet of Things (IoT) · doi:10.1145/3703790.3703795 · Cited by 8
COMPASS: Unsupervised and online clustering of complex human activities from smartphone sensors
Campana, M. G., & Delmastro, F. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115124 · Cited by 4
“…have been studied, including Decision Trees (Fallahzadeh et al., 2016), Support Vector Machines (Li & Chung, 2015), Artificial Neural Networks (Vaizman et al., 2018b), or ensembles of different classifiers trained on specific context information and then combined with a meta-classifier to…”
MethodDetecting Mobile Crowdsensing Context in the Wild
Agarwal, R., Chopra, S., Christophides, V., Georgantas, N., & Issarny, V. (2019) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2019.00-60 · Cited by 4
“Detecting sensing context in the wild is a challenging task as it requires mapping a large variety of features extracted from incomplete and unbalanced sensor data to a number of predicted context labels [5] using very limited ground truth.”
BackgroundSensorQA: A Question Answering Benchmark for Daily-Life Monitoring
Reichman, B., Yu, X., Hu, L., Truxal, J., Jain, A., Chandrupatla, R., Rosing, T., & Heck, L. P. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722074 · Cited by 17
IoT-Based Smartphone Sensors for Accurate Locomotion and Localization Recognition
Rafiq, M., & Jalal, A. (2025) · International Conference on Advancements in Computational Sciences (ICACS) · doi:10.1109/icacs64902.2025.10937886 · Cited by 4
Understanding Human Daily Experience Through Continuous Sensing: ETRI Lifelog Dataset 2024
Oh, S. W., Jeong, H., Chung, S., Lim, J., Noh, K. J., Lee, S., & Jung, G. (2025) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc66702.2025.11388616 · Cited by 4
Less is more: Efficient behavioral context recognition using Dissimilarity-Based Query Strategy
Akram, A., Farhan, A. A., & Basharat, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0286919 · Cited by 3
“Smart devices with built-in sensors have the potential to capture useful information for understanding human behavior [8, 9, 12].”
BackgroundAdversarial Human Context Recognition: Evasion Attacks and Defenses
Alajaji, A. S., Gerych, W., Chandrasekaran, K., Buquicchio, L., Agu, E., & Rundensteiner, E. A. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00036 · Cited by 4
A Data-Driven Study on the Hawthorne Effect in Sensor-Based Human Activity Recognition
Hoelzemann, A., Bock, M., Bastias, E. A. V., Touhami, S. E. O., Nassiri, K., & Laerhoven, K. V. (2023) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3594739.3610743 · Cited by 4
Yang, Z., Zhang, Y., Li, Y., Huang, L., Hu, P., & Lin, Y. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3565250 · Cited by 6
Profiling Instructor Activities Using Smartwatch Sensors in a Classroom
Chowdhury, Z. U., De, P., & Allen, A. A. (2020) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/3374135.3385290 · Cited by 4
Attention-based Multi-task Learning for Sensor Analytics
Chen, Y., & Rangwala, H. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006207 · Cited by 3
“[14] developed a multi-task model with multilayer perceptron (MLP) to recognize different human activities from mobile sensors.”
BackgroundFederated Multi-task Hierarchical Attention Model for Sensor AnalyticsPreprint
Chen, Y., Ning, Y., Chai, Z., & Rangwala, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05142 · Cited by 6
“For the classification datasets, the labels are highly unbalanced and hence we report the F1 score, precision, recall, and Balance Accuracy (BA) from [Vaizman et al., 2018b].”
MethodInfluentialMulti-Modal Subjective Context Modelling and RecognitionPreprint
Shen, Q., Teso, S., Zhang, W., Xu, H., & Giunchiglia, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09671 · Cited by 3
“Existing implementations are quite diverse, and range from shallow models like logistic regression [14] to deep neural networks like feed-forward networks [15], LSTMs [7], and CNNs [12].”
BackgroundIntelligent System for Human Context Recognition
Aziz, S., Khan, M. U., Zahoor, A., & Naqvi, S. Z. H. (2020) · International Conference on Computing and Information Technology (ICCIT) · doi:10.1109/iccit-144147971.2020.9213805 · Cited by 2
Dynimp: Dynamic Imputation for Wearable Sensing Data through Sensory and Temporal Relatedness
Huo, Z., Ji, T., Liang, Y., Huang, S., Wang, Z., Qian, X., & Mortazavi, B. J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747062 · Cited by 3
Martin, M., Meunier, E., Moreau, P., Gadenne, J., Dautel, J., Catherin, F., Pinsky, E., & Rawassizadeh, R. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3631416 · Cited by 2
SensiX: A Platform for Collaborative Machine Learning on the EdgePreprint
Min, C., Mathur, A., Montanari, A., Acer, U. G., & Kawsar, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06035 · Cited by 5
Metadata
- Authors
- Vaizman, Y., Weibel, N., & Lanckriet, G.
- Affiliations
- University of California San Diego (US)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2018-01-08
- Volume
- 1
- Issue
- 4
- Pages
- 1-22
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2783920628
- Cited by
- 122
- References
- 24
- Citations by year
- 2026: 7 · 2025: 18 · 2024: 15 · 2023: 13 · 2022: 15 · 2021: 13 · 2020: 19 · 2019: 16 · 2018: 6
- FWCI
- 6.76
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- context recognition, in-the-wild, multi-task learning, multilayer perceptron, multimodal sensor fusion, missing labels, class imbalance, health monitoring, elderly care, activity recognition, posture recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.