The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index, and 1 are not checked yet.
Applying Machine Learning for Sensor Data Analysis in Interactive Systems: Common Pitfalls of Pragmatic Use and Ways to Avoid Them
Abstract
With the widespread proliferation of (miniaturized) sensing facilities and the massive growth and popularity of the field of machine learning (ML) research, new frontiers in automated sensor data analysis have been explored that lead to paradigm shifts in many application domains. In fact, many practitioners now employ and rely more and more on ML methods as integral part of their sensor data analysis workflows—thereby not necessarily being ML experts or having an interest in becoming one. The availability of toolkits that can readily be used by practitioners has led to immense popularity and widespread adoption and, in essence, pragmatic use of ML methods. ML having become mainstream helps pushing the core agenda of practitioners, yet it comes with the danger of misusing methods and as such running the risk of leading to misguiding if not flawed results. Based on years of observations in the ubiquitous and interactive computing domain that extensively relies on sensors and automated sensor data analysis, and on having taught and worked with numerous students in the field, in this article I advocate a considerate use of ML methods by practitioners, i.e., non-ML experts, and elaborate on pitfalls of an overly pragmatic use of ML techniques. The article not only identifies and illustrates the most common issues, it also offers ways and practical guidelines to avoid these, which shall help practitioners to benefit from employing ML in their core research domains and applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The primary metric of evaluation is the mean (or unweighted) F1-score, as it is more resistant to class imbalance, which commonly occurs in wearable datasets [151].”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [151]
In the citing paper
“The accuracy and weighted F1-score are not utilized as they are affected by the skewed class distributions, whereas the unweighted mean F1-score, while not ideal, is a reasonable strategy [53].”
From Assessing the State of Self-Supervised Human Activity Recognition Using Wearables (2022) · cites this paper as [53]
In the citing paper
“We report the mean of the test set macro F1-scores across 5 folds and 5 random runs (to account for class-imbalance [26]).”
From How Much Unlabeled Data is Really Needed for Effective Self-Supervised Human Activity Recognition? (2023) · cites this paper as [26]
Citations
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877 · cited 1×
“Annotator agreement can be quantized through specific measures, such as kappa statistics (interrater reliability) [50].”
BackgroundRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“ML methods learn representations [5] and models from example data, thereby aiming for generalization beyond those training data such that the resulting models and methods can effectively be used for accurate analysis of unseen, yet related data.”
MethodScikit-learn: Machine Learning in Python
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078195 · Cited by 8,539
Simultaneous Statistical Inference
Miller, R. G. (1981) · Springer Series in Statistics · doi:10.1007/978-1-4613-8122-8 · Cited by 5,604
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
Understanding and Using Context
Dey, A. K. (2001) · Personal and Ubiquitous Computing · doi:10.1007/s007790170019 · Cited by 5,012 · cited 1×
“The main application case for ML in such settings is the analysis of sensor data for capturing and assessing the context a user is in [17].”
BackgroundA survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522 · cited 1×
“In such cases, researchers often resort to an approximative protocol, namely, to k-fold cross validation [3].”
BackgroundA few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“There have been efforts within the core ML research community to illustrate what ML techniques can do [20], as well as to raise awareness of what they cannot [70].”
BackgroundGeneralizing from a Few Examples: A Survey on Few-shot Learning
Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. (2021) · ACM Computing Surveys · doi:10.1145/3386252 · Cited by 3,165
Research works printed but not linked: 22
- Abowd Gregory D., 2012, Proceedings of the International Conference on Ubiquitous Computing (UbiComp’12)
- Cohn Gabe, InProceedings of the International Conference on Pervasive Computing (Pervasive’10)
- Eibe Frank, 2016, Witten
- Froehlich Jon, InProceedings of the International Conference on Ubiquitous Computing (UbiComp’09)
- Hammerla Nils, 2015, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI’15)
- Hill T., 2007, STATISTICS: Methods and Applications. StatSoft
- Indurkhya Nitin, 2010, Damerau
- Jacko Julie A., Evolving Technologies, and Emerging Applications
- Jain A. K., Classification Pattern Recognition and Reduction of Dimensionality. Handbook of Statistics, 2
- Li H., Proceedings of the International Symposium on Wearable Computing (ISWC’18)
- MATLAB., version 7.10.0 (R2010a)
- Duda Richard O., 2001, Stork
- Paszke Adam, Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc
- Patel Shwetak N., InProceedings of the International Conference on Ubiquitous Computing (UbiComp’07)
- Ploetz Thomas, 2011, Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’11)
- Rasmussen Carl Edward, 2001, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 294--300
- Reiss A., Proceedings of the International Symposium on Wearable Computing (ISWC’12)
- Sebe Nicu, 2005, Huang
- Voulodimos Athanasios, 2018, Deep learning for computer vision: A brief review. Comput. Intell. Neurosci
- Wagstaff Kiri L., 2012, Proceedings of the International Conference on Machine Learning (ICML’12)
- Weiser M., 1991, The computer for the 21st century. Sci. Amer. 265, 3
- Witten Ian H., 2016, Pal
Cited by
Don’t push the button! Exploring data leakage risks in machine learning and transfer learning
Apicella, A., Isgrò, F., & Prevete, R. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11326-3 · Cited by 214
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
Self-citationFLAME: Federated Learning across Multi-device Environments
Cho, H., Mathur, A., & Kawsar, F. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550289 · Cited by 79
Cross-Domain HAR: Few-Shot Transfer Learning for Human Activity Recognition
Thukral, M., Haresamudram, H., & Plötz, T. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3704921 · Cited by 69
Self-citation
Metadata
- Authors
- PlÖtz, T.
- Affiliations
- Georgia Institute of Technology (US)
- Corresponding author
- PlÖtz, Thomas
- Venue
- ACM Computing Surveys
- Published
- 2021-07-13
- Volume
- 54
- Issue
- 6
- Pages
- 1-25
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3180073572
- Cited by
- 34
- References
- 53
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 10 · 2023: 6 · 2022: 9 · 2021: 2
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- machine learning, sensor data analysis, interactive systems, ubiquitous computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applying Machine Learning for Sensor Data Analysis in Interactive Systems: Common Pitfalls of Pragmatic Use and Ways to Avoid Them. https://app.cochat.ai/papers/10.1145/3459666
- The paper
- PlÖtz, T. (2022). Applying Machine Learning for Sensor Data Analysis in Interactive Systems: Common Pitfalls of Pragmatic Use and Ways to Avoid Them. ACM Computing Surveys. https://doi.org/10.1145/3459666
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.