COCOA: Cross Modality Contrastive Learning for Sensor Data
Open accessThe DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Abstract
Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labeled data, and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Contrastive Learning (CL) is one of the most well-known approaches in SSL that attempts to learn general, informative representations of data. CL methods have been mostly developed for applications in computer vision and natural language processing where only a single sensor modality is used. A majority of pervasive computing applications, however, exploit data from a range of different sensor modalities. While existing CL methods are limited to learning from one or two data sources, we propose COCOA (Cross mOdality COntrastive leArning), a self-supervised model that employs a novel objective function to learn quality representations from multisensor data by computing the cross-correlation between different data modalities and minimizing the similarity between irrelevant instances. We evaluate the effectiveness of COCOA against eight recently introduced state-of-the-art self-supervised models, and two supervised baselines across five public datasets. We show that COCOA achieves superior classification performance to all other approaches. Also, COCOA is far more label-efficient than the other baselines including the fully supervised model using only one-tenth of available labeled data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Due to the differences in signal patterns across modalities, modality-specific encoders are used, which improve the model's robustness to missing modalities and its computational efficiency.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [40]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
(2008) · Journal of Machine Learning Research · Cited by 33,051
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 4×
“, images and videos) for purposes such as extracting captions for the images and videos [58, 93], contrasting text against audio [40] for speech recognition, or vision against audio [83].”
BackgroundInfluentialMomentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · cited 4×
“During the last two years there was a rapid progress in contrastive learning methods in the eld of computer vision [11, 12, 32, 38, 85], audio and speech processing [32, 50, 54, 62, 82, 90], and natural language processing domain [9, 20, 23, 25, 28, 54, 89, 91].”
BackgroundMethodInfluentialEmerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638 · cited 3×
“During the last two years there was a rapid progress in contrastive learning methods in the eld of computer vision [11, 12, 32, 38, 85], audio and speech processing [32, 50, 54, 62, 82, 90], and natural language processing domain [9, 20, 23, 25, 28, 54, 89, 91].”
BackgroundMethodResult
Research works printed but not linked: 1
- Ary L Goldberger, Luis AN Amaral, Leon Glass, Jeffrey M Hausdorff, Plamen Ch Ivanov, Roger G Mark, Joseph E Mietus, George B Moody, Chung-Kang Peng, and H Eugene Stanley. 2000. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101, 23 (2000).
Cited by
Deep Learning for Time-Series Prediction in IIoT: Progress, Challenges, and Prospects
Ren, L., Jia, Z., Laili, Y., & Huang, D. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3291371 · Cited by 184
CALDA: Improving Multi-Source Time Series Domain Adaptation With Contrastive Adversarial Learning
Wilson, G., Doppa, J. R., & Cook, D. J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3298346 · Cited by 83
Applications of Self-Supervised Learning to Biomedical Signals: A Survey
Pup, F. D., & Atzori, M. (2023) · IEEE Access · doi:10.1109/access.2023.3344531 · Cited by 43
PRECYSE: Predicting Cybersickness using Transformer for Multimodal Time-Series Sensor Data
Jeong, D., & Han, K. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3659594 · Cited by 53
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33
Logacjov, A., & Bach, K. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107478 · Cited by 41
Diffusion-Model-Based Contrastive Learning for Human Activity Recognition
Xiao, C., Han, Y., Yang, W. P., Hou, Y., Shi, F., & Chetty, K. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3429245 · Cited by 34
Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom56429.2023.10099197 · Cited by 27
Chen, W., Cheng, J., Wang, L., Zhao, W., & Matusik, W. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699747 · Cited by 48
Self-supervised cross-modal visual retrieval from brain activities
Ye, Z., Yao, L., Zhang, Y., & Gustin, S. M. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109915 · Cited by 40
Self-supervised Learning for Accelerometer-based Human Activity Recognition: A Survey
Logacjov, A. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699767 · Cited by 40
Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition
Miao, S., Chen, L., & Hu, R. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3631415 · Cited by 23
E2Usd: Efficient-yet-effective Unsupervised State Detection for Multivariate Time Series
Lai, Z., Li, H., Zhang, D., Zhao, Y. L., Qian, W., & Jensen, C. S. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645593 · Cited by 40
FreqMAE: Frequency-Aware Masked Autoencoder for Multi-Modal IoT Sensing
Kara, D., Kimura, T., Liu, S., Li, J., Liu, D., Wang, T., Wang, R., Chen, Y., Hu, Y., & Abdelzaher, T. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645346 · Cited by 38
Contrastive Self-Supervised Learning for Sensor-Based Human Activity Recognition: A Review
Chen, H., Gouin-Vallerand, C., Bouchard, K., Gaboury, S., Couture, M., Bier, N., & Giroux, S. (2024) · IEEE Access · doi:10.1109/access.2024.3480814 · Cited by 29
Evaluating Large Language Models as Virtual Annotators for Time-Series Physical Sensing Data
Hota, A., Chatterjee, S., & Chakraborty, S. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3696461 · Cited by 39
Virtual Fusion With Contrastive Learning for Single-Sensor-Based Activity Recognition
Nguyen, D., Pham, C., & Le‐Khac, N. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3412397 · Cited by 30
Eom, S., Eom, S.-Y., & Washington, P. Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47679-2_12 · Cited by 23
LifeLearner: Hardware-Aware Meta Continual Learning System for Embedded Computing Platforms
Kwon, Y. D., Chauhan, J., Jia, H., Venieris, S. I., & Mascolo, C. (2023) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3625687.3625804 · Cited by 36
GOAT: A Generalized Cross-Dataset Activity Recognition Framework with Natural Language Supervision
Miao, S., & Chen, L. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699736 · Cited by 27
Ott, F., Rügamer, D., Heublein, L., Bischl, B., & Mutschler, C. (2023) · IEEE Access · doi:10.1109/access.2023.3310819 · Cited by 30
MESEN: Exploit Multimodal Data to Design Unimodal Human Activity Recognition with Few Labels
Xu, L., Gu, C., Tan, R., He, S., & Chen, J. (2023) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3625687.3625782 · Cited by 26
Scaling Representation Learning From Ubiquitous ECG With State-Space Models
Avramidis, K., Kunc, D., Perz, B., Adsul, K., Feng, T., Kazienko, P., Saganowski, S., & Narayanan, S. S. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3416897 · Cited by 25
Haresamudram, H., Essa, I., & Plötz, T. (2024) · Sensors · doi:10.3390/s24041238 · Cited by 14
Cao, M., Wan, J., & Gu, X. (2025) · Sensors · doi:10.3390/s25030896 · Cited by 19
SoK: Behind the Accuracy of Complex Human Activity Recognition Using Deep Learning
Nguyen, D., & Le‐Khac, N. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650322 · Cited by 19
MassNet: A Deep Learning Approach for Body Weight Extraction from A Single Pressure Image
Wu, Z., Wan, Q., Zhao, M., Ke, Y., Fang, Y., Liang, Z., Xie, F., & Cheng, J. (2023) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom56429.2023.10099301 · Cited by 12
Patidar, P., Goel, M., & Agarwal, Y. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610907 · Cited by 20
PhyMask: An Adaptive Masking Paradigm for Efficient Self-Supervised Learning in IoT
Kara, D., Kimura, T., Chen, Y., Li, J., Wang, R., Chen, Y., Wang, T., Liu, S., & Abdelzaher, T. (2024) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3666025.3699325 · Cited by 20
How Much Unlabeled Data is Really Needed for Effective Self-Supervised Human Activity Recognition?
Dhekane, S. G., Haresamudram, H., Thukral, M., & Plötz, T. (2023) · Proceedings of the 2023 International Symposium on Wearable Computers · doi:10.1145/3594738.3611366 · Cited by 9
Wang, T., Li, J., Wang, R., Kara, D., Liu, S., Wertheimer, D., Martin, A. V., Ganti, R., Srivatsa, M., & Abdelzaher, T. (2023) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3625687.3625785 · Cited by 13
MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing
Hu, Y. '., Yeo, H.-S., Yuan, M., Fan, H., Elvitigala, D. S., Hu, W. S., & Quigley, A. J. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610921 · Cited by 9
Zhang, Z., Zhao, D. Y., Liu, R., Tian, K., Yao, Y., Li, Y., & Ma, H. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3398202 · Cited by 9
Learning Disentangled Representation for Multi-Modal Time-Series Sensing Signals
Cai, R., Jiang, Z., Zheng, K., Li, Z., Chen, W., XueXin, C., Shen, Y., Chen, G., Hao, Z., & Zhang, K. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714931 · Cited by 23
FIP: Endowing Robust Motion Capture on Daily Garment by Fusing Flex and Inertial Sensors
Zheng, R., Fang, J., Yuan, Y., Gao, X., Zuo, C., Guo, S., & Luo, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714140 · Cited by 9
Chen, Y., Hu, C., Kimura, T., Li, Q., Liu, S., Wu, F., & Chen, G. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699779 · Cited by 9
The Case for Micro Foundation Models to Support Robust Edge Intelligence
Kimura, T., Misra, A., Chen, Y., Kara, D., Li, J., Wang, T., Wang, R., Bhattacharyya, J., Kim, J., Shenoy, P. J., et al. (2024) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi62246.2024.00014 · Cited by 8
InfoMAE: Pair-Efficient Cross-Modal Alignment for Multimodal Time-Series Sensing Signals
Kimura, T., Li, X., Hanna, O. A., Chen, Y., Chen, Y., Kara, D., Wang, T., Li, J., Ouyang, X., Liu, S., et al. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714853 · Cited by 12
OpenMAE: Efficient Masked Autoencoder for Vibration Sensing with Open-domain Data Enrichment
Hu, C., Chen, Y., Kara, D., Liu, S., Abdelzaher, T., Wu, F., & Chen, G. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729485 · Cited by 6
Multi-View Self-Supervised Learning For Multivariate Variable-Channel Time Series
Brüsch, T., Schmidt, M. N., & Alstrøm, T. S. (2023) · Machine learning for signal processing ... · doi:10.1109/mlsp55844.2023.10285993 · Cited by 5
MultiHGR: Multi-Task Hand Gesture Recognition with Cross-Modal Wrist-Worn Devices
Lyu, M., Zhou, H., Guo, K., Zhou, W., Shen, X., & Gu, Y. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621430 · Cited by 4
Pallapothula, V. K. N., Anand, S., Bhattacharjee, S. D., & Yuan, J. (2025) · Smart Health · doi:10.1016/j.smhl.2025.100571 · Cited by 4
Sun, L. X., Xia, S., Yang, J., & Pei, L. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3583055 · Cited by 3
Wonderwall: A Virtual-to-Real Foundation Model for IMU-based HAR
Miao, S., & Chen, L. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3789688 · Cited by 9
Song, Y., Pitafi, Z. F., Dou, F., Sun, J., Zhang, X., Phillips, B. G., & Song, W. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678514 · Cited by 5
Contrastive Learning-Based User Identification with Limited Data on Smart Textiles
Zhang, Y., Wu, Z., Liang, Z., Xie, F., Wan, Q., Zhao, M., & Cai, X. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831547 · Cited by 3
ACL: Adaptive Edge-Cloud Collaborative Learning for Heterogeneous Devices With Unlabeled Local Data
Zhang, Z., Zhao, D. Y., Liu, R., Yao, Y., Li, X., & Ma, H. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3553971 · Cited by 6
Suite-IN: Aggregating Motion Features from Apple Suite for Robust Inertial Navigation
Sun, L. X., Xia, S., Deng, J., Yang, J., Lai, Z., Wu, Q., & Pei, L. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127228 · Cited by 4
Multimodal Deep Learning for Manufacturing Systems: Recent Progress and Future Trends
Wang, Y., & Yue, X. (2012) · Springer optimization and its applications · doi:10.1007/978-3-031-53092-0_11 · Cited by 3
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3677562 · Cited by 8
Metric-Based Few-Shot Learning With Triplet Selection for Adaptive GNSS Interference Classification
Ott, F., Heublein, L., Feigl, T., Rügamer, A., & Mutschler, C. (2025) · IEEE Journal of Indoor and Seamless Positioning and Navigation · doi:10.1109/jispin.2025.3562140 · Cited by 6
Applications of Self-Supervised Learning to Biomedical Signals: where are we nowPreprint
Pup, F. D., & Atzori, M. (2023) · doi:10.36227/techrxiv.22567021.v1 · Cited by 4
From Vision to Motion: Translating Large-Scale Knowledge for Data-Scarce IMU Applications
Yoon, H., Cha, H., Nguyen, H. C., Gong, T., & Lee, S.-J. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3556998 · Cited by 10
Zheng, Z., Du, J., Zhang, Y., Wang, X., & Guangzhou Meteorological Satellite Ground Station, G. 5. (2025) · Electronic Research Archive · doi:10.3934/era.2025085 · Cited by 2
Oh, K., Park, H., Lee, G. H., & Choi, J. K. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.108058 · Cited by 5
Cross-Modal Federated Learning among Unimodal Devices
Deng, Y., He, N., Li, X., Wu, F., Zhang, Y., & Ren, J. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749467 · Cited by 2
Inertial Sensor-Based Hierarchical Contrastive Multi-View Learning for Human Activity Recognition
Calatrava-Nicolás, F. M., Rey, V. F., Lukowicz, P., & Mozos, Ó. M. (2025) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3715071.3750416 · Cited by 3
Spina, D., Jacek Gwizdka, A., Ji, K., Moshfeghi, Y., Mostafa, J., Ruotsalo, T., Zhang, M., Ahmad, A., Lawati, S. F. D. A., Boonprakong, N., et al. (2025) · ACM SIGIR Forum · doi:10.1145/3769733.3769740 · Cited by 3
Self-citationWeak-Annotation of HAR Datasets using Vision Foundation Models
Bock, M., Laerhoven, K. V., & Moeller, M. (2024) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3675095.3676613 · Cited by 4
Self-supervised Activity Representation Learning with Incremental Data: An Empirical Study
Liu, J., Deldari, S., Xue, H., Nguyen, V., & Salim, F. D. (2023) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm58254.2023.00019 · Cited by 2
Self-citationApplications of Self-Supervised Learning to Biomedical Signals: where are we nowPreprint
Pup, F. D., & Atzori, M. (2023) · doi:10.36227/techrxiv.22567021 · Cited by 4
Applications of Self-Supervised Learning to Biomedical Signals: where are we nowPreprint
Pup, F. D., & Atzori, M. (2023) · doi:10.36227/techrxiv.22567021.v2 · Cited by 2
COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition
Chen, B., Wongso, W., Li, Z., Khaokaew, Y., Xue, H., & Salim, F. D. (2026) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3810218 · Cited by 1
Self-citationSelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replay
Yoon, H., Kwak, J., Tolera, B. A., Dai, G., Li, M., Gong, T., Lee, K., & Lee, S.-J. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722066 · Cited by 6
Guo, K., Tang, H., Xu, T., Zhou, H., Lyu, M., Liu, Z., Wang, X., & Li, X. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3569841 · Cited by 2
Enhancing multivariate spatio-temporal forecasting via complete dynamic causal modeling
Du, K., Yang, X., & Chen, H. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107826 · Cited by 1
DiffPhys: Differential Physics Augmentations for Enhanced Representations
Kara, D., Kimura, T., Sun, D., Li, J., Chen, Y., Hu, Y., Zhao, H., Bhattacharyya, J., & Abdelzaher, T. (2025) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn65249.2025.11134010 · Cited by 1
Calatrava-Nicolás, F. M., Ray, L. S. S., Rey, V. F., Lukowicz, P., & Mozos, Ó. M. (2025) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3714394.3756194 · Cited by 2
SitLLM: Large Language Models for Sitting Posture Health Understanding via Pressure Sensor Data
Gao, J., & Yan, D. (2025) · International Conference on Electronic Communication, Computer Science and Technology (ECCST) · doi:10.1109/eccst68196.2025.11441137 · Cited by 1
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2023) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3594739.3605102 · Cited by 3
Auto-Augmentation Contrastive Learning for Wearable-based Human Activity Recognition
Wu, Q., Shen, J., Fan, F., Gu, Y., Xu, C., & Chen, Y. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385468 · Cited by 3
Fang, K., Wu, H., & Sze, K. S.-F. (2024) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas61083.2024.10798333 · Cited by 1
On Network-Efficient Multimodal Multi-Vantage Foundation Models for Distributed Sensing
Wang, T., Chen, Y., Zhao, H., Lyu, Y., Li, J., Kimura, T., Hu, Y. C., Kara, D., Wigness, M., Twigg, J. N., et al. (2025) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass66014.2025.00017 · Cited by 2
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Ploetz, T. (2024) · arXiv · Cited by 31
Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Ploetz, T. (2022) · arXiv · Cited by 27
Smith, D., Baumgartner, P., McGinness, L. P., Kapoor, R., Rana, M., Rahman, A., Schutt, A., & Tartaglia, E. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4792141
Self-citationContrastive Sensor Excitation for Generalizable Cross-Person Activity Recognition
Tan, Z., Fang, S., Zhu, H., & Yang, C. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650018
Mobility Scooter Riding Behavior Stability Analysis Based on Multimodal Contrastive Learning
Chung, J., Zhang, C., & Chen, T. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825478
Subject Invariant Contrastive Learning for Human Activity Recognition
Yarici, Y., Kokilepersaud, K., Prabhushankar, M., & AlRegib, G. (2025) · Machine learning for signal processing ... · doi:10.1109/mlsp62443.2025.11204249 · Cited by 2
Bhattacharjee, S. D., Chhabria, J., & Pallapothula, V. K. N. (2025) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1145/3721201.3724415
Li, Y., Jin, S., Wu, K., Fan, C., & Zou, Y. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11357131
Align and Adapt: Multimodal Multiview Human Activity Recognition Under Arbitrary View Combinations
Nguyen, D., & Le‐Khac, N. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3718255
Nguyen, D., & Le‐Khac, N. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6216286
RoSe: Robust Vital Sign Sensing with WiFi under Varying Signal Degradation
Zhao, Y., Zhou, X., Chen, N., & Qiu, T. (2026) · ACM Transactions on Sensor Networks · doi:10.1145/3798099
Li, T., Li, Z., Li, D., Wu, J., Chen, Y., Feng, X. T., Ma, Y., Liu, D., & Guo, C. (2025) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb65343.2025.11410654
Zhang, Z., Zhao, D. Y., Zhu, G., Li, X. Q., Li, C., Liu, B., Li, Y., & Ma, H. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3672513 · Cited by 1
Liu, Y., Xu, Z., Li, Z., Liang, Z., Zhang, Z., & Wang, C. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.113481
EEG-Based Cognitive Activity Recognition
Sheng, Q. Z., Liu, Y., & Yao, L. (2026) · Springer eBooks · doi:10.1007/978-3-032-16502-2_7
Song, Y., Chen, J., Zeng, Z., Zhang, Y., Pitafi, Z. F., Phillips, B. G., zhang, X., Dou, F., & Song, W. (2026) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom67906.2026.11524561 · Cited by 1
Shuhui, G., Cao, M., & Wan, J. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01212-8
Frequency-Domain Multi-Modality Transportation Modeling
Deng, J., Liu, H., Li, J., Zhang, B., & Jiang, R. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818022
TRIAD: Ternary Information Routing for Multimodal Time-Series Sensing Signals
Liu, Y., Ma, S., Lu, H. C., Cheng, X., Liu, X., & Huo, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818194
Chen, Y., Chen, Q., Tian, Y., Xing, W., Pi, Y., & Cao, Z. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114645
REMIX: Adaptive Open-Domain Signal Mixing for Efficient Sensing Data Augmentation
Kara, D., Kimura, T., Hu, C., Li, J., Chen, Y., Hu, Y., Zhao, H., Liu, S., & Abdelzaher, T. (2026) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn69946.2026.11662941
READ: Reasoning Like a Cardiologist for Contactless Arrhythmia Diagnosis
Lyu, R., Feng, H., Zhou, A., Ma, H., Zheng, M., Meng, X., Duan, J., Wang, J., Zheng, M., & Shao, C. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831993 · Cited by 1
Metadata
- Authors
- Deldari, S., Xue, H., Saeed, A., Smith, D. V., & Salim, F. D.
- Affiliations
- RMIT University (AU)
- UNSW Sydney (AU)
- Philips (Netherlands) (NL)
- Commonwealth Scientific and Industrial Research Organisation (AU)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2022-09-06
- Volume
- 6
- Issue
- 3
- Pages
- 1-28
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4289550913
- Cited by
- 92
- References
- 95
- Citations by year
- 2026: 14 · 2025: 28 · 2024: 26 · 2023: 23
- FWCI
- 6.33
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion, public-domain)
- arXiv (Cornell University) (submittedVersion)
- Figshare (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- self-supervised learning, contrastive learning, cross-modal contrastive learning, multi-sensor data, cross correlation function, representation learning, label efficiency, Theobroma cacao, wearable sensors, ubiquitous computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.