Adversarial Multi-view Networks for Activity Recognition
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Human activity recognition (HAR) plays an irreplaceable role in various applications and has been a prosperous research topic for years. Recent studies show significant progress in feature extraction (i.e., data representation) using deep learning techniques. However, they face significant challenges in capturing multi-modal spatial-temporal patterns from the sensory data, and they commonly overlook the variants between subjects. We propose a Discriminative Adversarial MUlti-view Network (DAMUN) to address the above issues in sensor-based HAR. We first design a multi-view feature extractor to obtain representations of sensory data streams from temporal, spatial, and spatio-temporal views using convolutional networks. Then, we fuse the multi-view representations into a robust joint representation through a trainable Hadamard fusion module, and finally employ a Siamese adversarial network architecture to decrease the variants between the representations of different subjects. We have conducted extensive experiments under an iterative left-one-subject-out setting on three real-world datasets and demonstrated both the effectiveness and robustness of our approach.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using Wasserstein GAN and Siamese networks, they demonstrate the ability to generalize to new subjects without sacrificing performance.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [10]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“…segment; 2) concatenate-based fusion, which gets the final representation by concatenating representations of all views; 3) self-attention based fusion, which uses the self-attention mechanism [46] to calculate the importance of each view and merges the re-weighted sub-representations by summing.”
BackgroundHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×
“Such studies [14, 39, 40, 47] typically use deep neural networks, e.g., Convolution Neural Networks (CNN) [37], Long-Short Term Memory (LSTM) [23], as the feature extractor to learn representations of the input sensory segments automatically; then, they map the representations to corresponding…”
MethodGAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243 · cited 1×
“To verify the overall performance of the proposed DAMUN model, we compare our model with the following baseline and state-of-the-arts: • SVM [22]: the traditional support vector machine (SVM) with the radial basis function (RBF) kernel.”
Method(2017) · International Conference on Machine Learning · Cited by 6,382
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Siamese Neural Networks for One-shot Image Recognition
Koch, G. E., Zemel, R. S., & Salakhutdinov, R. (2015) · Cited by 3,740
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147 · cited 2×
“Most early studies in the area aim to recognize human activities from solely accelerometer signals [6, 19, 34].”
BackgroundMethodActivity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 2×
“Most early studies in the area aim to recognize human activities from solely accelerometer signals [6, 19, 34].”
BackgroundMethod
Research works printed but not linked: 11
- Arjovsky Martin, 2017, International conference on machine learning. 214--223
- Chen Kaixuan, 2019, Proceedings of the 28th International Joint Conference on Artificial Intelligence.
- Glorot Xavier, 2010, Proceedings of the thirteenth international conference on artificial intelligence and statistics. 249--256
- Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680. Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680.
- Hammerla Nils Y, 2016, Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. AAAI Press, 1533--1540
- Ioffe Sergey, 2015, International Conference on Machine Learning. 448--456
- Jordao Artur, 2018, Jessica Sena, and William Robson Schwartz.
- Kingma Diederik P, 2014, Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 · arXiv
- Koch Gregory, ICML deep learning workshop
- LeCun Yann, 2015, Deep learning. nature 521, 7553
- Yang Jianbo, 2015, Twenty-Fourth International Joint Conference on Artificial Intelligence.
Cited by
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
Self-citationDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
Self-citationEssa, E., & Abdelmaksoud, I. R. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110867 · Cited by 113
Suh, S., Rey, V. F., & Lukowicz, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110143 · Cited by 107
MM-Fit: Multimodal Deep Learning for Automatic Exercise Logging across Sensing Devices
Strömbäck, D., Huang, S., & Radu, V. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432701 · Cited by 100
“user, adversarial networks have been used [3], which rely on Siamese networks to decrease the variants between the representations of different subjects.”
Method
Metadata
- Authors
- Bai, L., Yao, L., Wang, X., Kanhere, S. S., Guo, B., & Yu, Z.
- Affiliations
- UNSW Sydney (AU)
- University of Technology Sydney (AU)
- Northwestern Polytechnical University (CN)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2020-06-15
- Volume
- 4
- Issue
- 2
- Pages
- 1-22
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3034851746
- Cited by
- 40
- References
- 47
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 5 · 2023: 9 · 2022: 9 · 2021: 6 · 2020: 3
- FWCI
- 2.63
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion, public-domain)
- UTS ePRESS (University of Technology Sydney) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- human activity recognition, multi-view feature extraction, adversarial learning, Siamese network, spatiotemporal patterns, sensor data, interindividual variability, wearable sensors, cross-subject generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Adversarial Multi-view Networks for Activity Recognition. https://app.cochat.ai/papers/10.1145/3397323
- The paper
- Bai, L., Yao, L., Wang, X., Kanhere, S. S., Guo, B., & Yu, Z. (2020). Adversarial Multi-view Networks for Activity Recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. https://doi.org/10.1145/3397323
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.