CoChat

Negative Selection by Clustering for Contrastive Learning in Human Activity Recognition

Open access
Wang, Jinqiang, Zhu, Tao, Chen, Liming Luke, Ning, Huansheng, Wan, Yaping · 2023 · IEEE Internet of Things Journal

The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index; 2 of the 12 sources its claims cite were checked for support.

Abstract

Contrastive learning is an emerging and important self-supervised learning paradigm that has been successfully applied to sensor-based human activity recognition (HAR) because it can achieve competitive performance relative to supervised learning. Contrastive learning methods generally involve instance discrimination, which means that the instances are regarded as negatives of each other, and thus their representations are pulled away from each other during the training process. However, instance discrimination could cause overclustering, meaning that the representations of instances from the same class could be overly separated. To alleviate this overclustering phenomenon, we propose a new contrastive learning framework to select negatives by clustering in HAR, which is named clustering for contrastive learning in human activity recognition (ClusterCLHAR). First, ClusterCLHAR clusters the instance representations, and for each instance, only those from different clusters are regarded as negatives. Second, a new contrastive loss function is proposed to mask the same-cluster instances from the negative pairs. We evaluate ClusterCLHAR on three popular benchmark data sets: 1) USC-HAD; 2) MotionSense; and 3) UCI-HAR, using the mean F1-score as an evaluation metric for downstream tasks. The experimental results show that ClusterCLHAR outperforms all the state-of-the-art methods applied to HAR in self-supervised learning and semi-supervised learning.

Overview

CoChat Summary

TL;DR

ClusterCLHAR is a contrastive learning framework for sensor-based human activity recognition that clusters instance representations and prevents same-cluster samples from being treated as negatives. Across three benchmark datasets, it reports state-of-the-art results in both self-supervised and semi-supervised settings.

Key findings

  • In self-supervised evaluation, ClusterCLHAR achieved mean F1-scores of 58.85 on USC-HAD, 90.95 on MotionSense, and 92.63 on UCI-HAR, exceeding the compared self-supervised methods.
  • With only 1% labeled data and linear evaluation, it reached 77.18 on USC-HAD, 86.69 on MotionSense, and 88.78 on UCI-HAR, improving over the previous best contrastive method by 4.82, 3.3, and 4.89 points, respectively.
  • With 1% labeled data and fine-tuning, it reached 78.09 on USC-HAD, 87.35 on MotionSense, and 90.53 on UCI-HAR, improving over the previous best by 3.39, 1.16, and 3.0 points.
  • Ablation showed clustering choice mattered: best-to-worst gaps were 9.68%, 2.02%, and 4.5% across the three datasets; cluster-number choice produced gaps of 4.59%, 2.03%, and 3.53%. t-SNE visualization indicated tighter grouping of same-class representations than SimCLR.

Methods

  • The framework extends SimCLR with a negative-selection step: representations from one branch are clustered, and instances sharing a cluster label are excluded from negative pairs; a new Cluster-NT-Xent loss masks same-cluster negatives. A hyperparameter α controls what fraction of samples near cluster centers use this strategy.
  • Experiments used TPN as encoder, resampling augmentation, a three-layer MLP projection head with 96 neurons, Adam, temperature 0.1, 200 pretraining epochs, and batch sizes of 1024 for USC-HAD and 256 for MotionSense/UCI-HAR. K-means was used for USC-HAD and MotionSense; BIRCH for UCI-HAR, with cluster count defaulting to the true class count.
  • Data: USC-HAD (14 subjects, 12 activities, 100 Hz), MotionSense (24 participants, 6 activities, 50 Hz), and UCI-HAR (30 subjects, 6 activities, 50 Hz). Evaluation used mean F1-score, five-fold cross-validation, ten repeated runs, and downstream linear or fine-tuned classifiers with 1% or 10% labels.

Limitations

  • The paper states that gains over fully supervised learning with all labels are limited, training time is longer, and clustering quality strongly affects final performance.
  • The text also makes evident that clustering method and cluster number substantially change results, batch size and epoch choices are unstable across datasets, and α = 100 is not always optimal.
  • The study is limited to three benchmark datasets and does not report real-world deployment; the authors state that real-life applications remain future work.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/jiot.2023.3239945

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

1 Valid · 1 Not valid · 7 Not checked · 77 Own results and interpretations

50 more claims

Create a free account to see all 86 claims and to verify the 10 references still open.

See all claims — free account
  • The quote only partly states this claim. 4
  • It may state two separate claims as one. 20
  • Probably not a substantial claim. 12

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 54 references

Cited by

See all 59

Metadata

Authors
Wang, J., Zhu, T., Chen, L. L., Ning, H., & Wan, Y.
Affiliations
  • University of South China (CN)
  • University of Ulster (GB)
  • University of Science and Technology Beijing (CN)
Venue
IEEE Internet of Things Journal
Published
2023-06-15
Volume
10
Issue
12
Pages
10833-10844
ISSN
  • 2327-4662 (ISSN-L)
  • 2372-2541
OpenAlex
W4318148707
Cited by
52
References
52
Citations by year
2026: 8 · 2025: 13 · 2024: 23 · 2023: 7
FWCI
4.64
Type
journal article
Language
en
Open access
Locations
  • IEEE Internet of Things Journal (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Ulster University Research Portal (Ulster University) (submittedVersion, public-domain)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Natural Science Foundation of China (62006110, 62071213)
  • Natural Science Foundation of Hunan Province (2021JJ30574)
  • Research Foundation of Education Bureau of Hunan Province (21C0311, 21B0424)
  • Hengyang Science and Technology Major Project (202250015428)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
Keywords
contrastive learning, human activity recognition, negative selection, clustering, instance discrimination, self-supervised learning, semi-supervised learning, contrastive loss, sensor-based activity recognition

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Negative Selection by Clustering for Contrastive Learning in Human Activity Recognition. https://app.cochat.ai/papers/10.1109/jiot.2023.3239945
The paper
Wang, J., Zhu, T., Chen, L. L., Ning, H., & Wan, Y. (2023). Negative Selection by Clustering for Contrastive Learning in Human Activity Recognition. IEEE Internet of Things Journal. https://doi.org/10.1109/jiot.2023.3239945

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.