Applying Machine Learning for Sensor Data Analysis in Interactive Systems: Common Pitfalls of Pragmatic Use and Ways to Avoid Them
The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
With the widespread proliferation of (miniaturized) sensing facilities and the massive growth and popularity of the field of machine learning (ML) research, new frontiers in automated sensor data analysis have been explored that lead to paradigm shifts in many application domains. In fact, many practitioners now employ and rely more and more on ML methods as integral part of their sensor data analysis workflows—thereby not necessarily being ML experts or having an interest in becoming one. The availability of toolkits that can readily be used by practitioners has led to immense popularity and widespread adoption and, in essence, pragmatic use of ML methods. ML having become mainstream helps pushing the core agenda of practitioners, yet it comes with the danger of misusing methods and as such running the risk of leading to misguiding if not flawed results. Based on years of observations in the ubiquitous and interactive computing domain that extensively relies on sensors and automated sensor data analysis, and on having taught and worked with numerous students in the field, in this article I advocate a considerate use of ML methods by practitioners, i.e., non-ML experts, and elaborate on pitfalls of an overly pragmatic use of ML techniques. The article not only identifies and illustrates the most common issues, it also offers ways and practical guidelines to avoid these, which shall help practitioners to benefit from employing ML in their core research domains and applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The primary metric of evaluation is the mean (or unweighted) F1-score, as it is more resistant to class imbalance, which commonly occurs in wearable datasets [151].”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [151]
In the citing paper
“The accuracy and weighted F1-score are not utilized as they are affected by the skewed class distributions, whereas the unweighted mean F1-score, while not ideal, is a reasonable strategy [53].”
From Assessing the State of Self-Supervised Human Activity Recognition Using Wearables (2022) · cites this paper as [53]
In the citing paper
“We report the mean of the test set macro F1-scores across 5 folds and 5 random runs (to account for class-imbalance [26]).”
From How Much Unlabeled Data is Really Needed for Effective Self-Supervised Human Activity Recognition? (2023) · cites this paper as [26]
Citations
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877 · cited 1×
“Annotator agreement can be quantized through specific measures, such as kappa statistics (interrater reliability) [50].”
BackgroundRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“ML methods learn representations [5] and models from example data, thereby aiming for generalization beyond those training data such that the resulting models and methods can effectively be used for accurate analysis of unseen, yet related data.”
MethodScikit-learn: Machine Learning in Python
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078195 · Cited by 8,539
Simultaneous Statistical Inference
Miller, R. G. (1981) · Springer Series in Statistics · doi:10.1007/978-1-4613-8122-8 · Cited by 5,604
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
Understanding and Using Context
Dey, A. K. (2001) · Personal and Ubiquitous Computing · doi:10.1007/s007790170019 · Cited by 5,012 · cited 1×
“The main application case for ML in such settings is the analysis of sensor data for capturing and assessing the context a user is in [17].”
BackgroundA survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522 · cited 1×
“In such cases, researchers often resort to an approximative protocol, namely, to k-fold cross validation [3].”
BackgroundA few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“There have been efforts within the core ML research community to illustrate what ML techniques can do [20], as well as to raise awareness of what they cannot [70].”
BackgroundGeneralizing from a Few Examples: A Survey on Few-shot Learning
Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. (2021) · ACM Computing Surveys · doi:10.1145/3386252 · Cited by 3,165
Research works printed but not linked: 22
- Abowd Gregory D., 2012, Proceedings of the International Conference on Ubiquitous Computing (UbiComp’12)
- Cohn Gabe, InProceedings of the International Conference on Pervasive Computing (Pervasive’10)
- Eibe Frank, 2016, Witten
- Froehlich Jon, InProceedings of the International Conference on Ubiquitous Computing (UbiComp’09)
- Hammerla Nils, 2015, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI’15)
- Hill T., 2007, STATISTICS: Methods and Applications. StatSoft
- Indurkhya Nitin, 2010, Damerau
- Jacko Julie A., Evolving Technologies, and Emerging Applications
- Jain A. K., Classification Pattern Recognition and Reduction of Dimensionality. Handbook of Statistics, 2
- Li H., Proceedings of the International Symposium on Wearable Computing (ISWC’18)
- MATLAB., version 7.10.0 (R2010a)
- Duda Richard O., 2001, Stork
- Paszke Adam, Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc
- Patel Shwetak N., InProceedings of the International Conference on Ubiquitous Computing (UbiComp’07)
- Ploetz Thomas, 2011, Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’11)
- Rasmussen Carl Edward, 2001, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 294--300
- Reiss A., Proceedings of the International Symposium on Wearable Computing (ISWC’12)
- Sebe Nicu, 2005, Huang
- Voulodimos Athanasios, 2018, Deep learning for computer vision: A brief review. Comput. Intell. Neurosci
- Wagstaff Kiri L., 2012, Proceedings of the International Conference on Machine Learning (ICML’12)
- Weiser M., 1991, The computer for the 21st century. Sci. Amer. 265, 3
- Witten Ian H., 2016, Pal
Cited by
Don’t push the button! Exploring data leakage risks in machine learning and transfer learning
Apicella, A., Isgrò, F., & Prevete, R. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11326-3 · Cited by 217
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
Self-citationFLAME: Federated Learning across Multi-device Environments
Cho, H., Mathur, A., & Kawsar, F. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550289 · Cited by 79
Cross-Domain HAR: Few-Shot Transfer Learning for Human Activity Recognition
Thukral, M., Haresamudram, H., & Plötz, T. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3704921 · Cited by 70
Self-citationAdvancing drug discovery with deep attention neural networks
Lavecchia, A. (2024) · Drug Discovery Today · doi:10.1016/j.drudis.2024.104067 · Cited by 65
CroSSL: Cross-modal Self-Supervised Learning for Time-series through Latent Masking
Deldari, S., Spathis, D., Malekzadeh, M., Kawsar, F., Salim, F. D., & Mathur, A. (2024) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3616855.3635795 · Cited by 56
Semantic Gap in Predicting Mental Wellbeing through Passive Sensing
Swain, V. D., Chen, V., Mishra, S., Mattingly, S. M., Abowd, G. D., & Choudhury, M. D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502037 · Cited by 53
Cross-Domain HAR: Few Shot Transfer Learning for Human Activity Recognition
Thukral, M., Haresamudram, H., & Ploetz, T. (2023) · arXiv · doi:10.48550/arxiv.2310.14390 · Cited by 45
Sanabria, A. R., Zambonelli, F., Dobson, S., & Ye, J. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101477 · Cited by 43
Logacjov, A., & Bach, K. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107478 · Cited by 41
Self-supervised Learning for Accelerometer-based Human Activity Recognition: A Survey
Logacjov, A. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699767 · Cited by 40
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33
Self-citationConverSense: An Automated Approach to Assess Patient-Provider Interactions using Social Signals
Bedmutha, M. S., Tsedenbal, A., Tobar, K., Borsotto, S., Sladek, K. R., Singh, D., Casanova-Pérez, R., Bascom, E., Wood, B. R., Sabin, J., et al. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641998 · Cited by 30
Using Graphs to Perform Effective Sensor-Based Human Activity Recognition in Smart Homes
Srivatsa, P., & Plötz, T. (2024) · Sensors · doi:10.3390/s24123944 · Cited by 28
Self-citationSpatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition
Miao, S., Chen, L., & Hu, R. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3631415 · Cited by 23
DiSalvo, B. J., Bandaru, D., Wang, Q., Li, H., & Plötz, T. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550328 · Cited by 23
Self-citationZhang, H., Yan, Z., Zhang, T., Wang, J., Wang, X., Chen, Y., Zhu, S., Li, Z., Chen, Y., Hong, W., et al. (2024) · ACS Sensors · doi:10.1021/acssensors.4c00664 · Cited by 22
Khowaja, S. A., Khuwaja, P., Dharejo, F. A., Raza, S., Lee, I. H., Naqvi, R. A., & Dev, K. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102044 · Cited by 19
Morshed, M. B., Haresamudram, H., Bandaru, D., Abowd, G. D., & Plötz, T. (2022) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3544794.3558469 · Cited by 17
Self-citationIf only we had more data!: Sensor-Based Human Activity Recognition in Challenging Scenarios
Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops) · doi:10.1109/percomworkshops56833.2023.10150267 · Cited by 16
Self-citationKaufman, R. P., Lee, E., Bedmutha, M. S., Kirsh, D., & Weibel, N. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713188 · Cited by 15
Bedmutha, M. S., Bascom, E., Sladek, K. R., Tobar, K., Casanova-Pérez, R., Andreiu, A., Bhat, A. S., Mangal, S., Wood, B. R., Sabin, J., et al. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae106 · Cited by 12
Federated Learning for Time-Series Healthcare Sensing with Incomplete ModalitiesPreprint
Orzikulova, A., Kwak, J., Shin, J., & Lee, S.-J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.11828 · Cited by 11
Developing a machine learning-based flood risk prediction model for the Indus Basin in Pakistan
Khan, M., Khan, A. U., Ullah, B., & Khan, S. (2024) · Water Practice & Technology · doi:10.2166/wpt.2024.151 · Cited by 10
How Much Unlabeled Data is Really Needed for Effective Self-Supervised Human Activity Recognition?
Dhekane, S. G., Haresamudram, H., Thukral, M., & Plötz, T. (2023) · Proceedings of the 2023 International Symposium on Wearable Computers · doi:10.1145/3594738.3611366 · Cited by 9
Self-citationYu, S., & Peng, X. (2024) · IEEE Access · doi:10.1109/access.2024.3494885 · Cited by 9
Chan, M., Gazi, A. H., Soliman, M. M., Richardson, K. L. S., Abdallah, C. A., Ozmen, G. C., Nikbakht, M. R., & Inan, O. T. (2022) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas54905.2022.9948650 · Cited by 9
Representation Learning for Wearable-Based Applications in the Case of Missing DataPreprint
Jungo, J., Xiang, Y., Gashi, S., & Holz, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.05437 · Cited by 9
Haresamudram, H., Beedu, A., Rabbi, M., Saha, S., Essa, I., & Ploetz, T. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i1.32004 · Cited by 8
Research on badminton take-off recognition method based on improved deep learning
Lianju, L., & Haiying, Z. (2024) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-024-04809-8 · Cited by 8
ColloSSL: Collaborative Self-Supervised Learning for Human Activity RecognitionPreprint
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.00758 · Cited by 7
Large Language Models Memorize Sensor Datasets! Implications on Human Activity Recognition ResearchPreprint
Haresamudram, H., Rajasekhar, H., Shanbhogue, N. M., & Plötz, T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.05900 · Cited by 7
Self-citationHandling Missing Data For Sleep Monitoring Systems
Gashi, S., Alecci, L., Gjoreski, M., Lascio, E. D., Mehrotra, A., Musolesi, M., Debus, M. E., Gasparini, F., & Silvia Santini, B. (2022) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii55700.2022.9953832 · Cited by 6
Hughes, C. M. L., & Zhang, Y. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2026.1700489 · Cited by 5
Game of LLMs: Discovering Structural Constructs in Activities using Large Language Models
Hiremath, S. K., & Plötz, T. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3678444 · Cited by 4
Self-citationZhu, S., Zhang, H., Chi, J. D., Nepal, S., & Saha, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.08590 · Cited by 4
Detecting Canine Mastication: A Wearable Approach
Ramey, C., Krichbaum, S., Mastali, A., Lin, J., Starner, T. E., & Jackson, M. M. (2022) · International Conference on Animal-Computer Interaction (ACI) · doi:10.1145/3565995.3566043 · Cited by 4
Self-supervised learning for data-efficient human activity recognition
Tang, C. I. (2023) · Apollo (University of Cambridge) · doi:10.17863/cam.107522 · Cited by 2
Hybrid Data Driven Deep Learning Framework for Material Property Prediction
Rakesh Kumar, M., Adiraju, R. V., K, L. P., Mahalakshmi, V. J., Balaji, P., & Sahukaru, J. (2025) · Journal of Machine and Computing · doi:10.53759/7669/jmc202505085 · Cited by 1
Droppelmann, G., Varas, E., Villagrán, J., Jorquera, C., & Feijoo, F. (2026) · EFORT Open Reviews · doi:10.1530/eor-2025-0038 · Cited by 1
Liu, X., Li, C., Yang, Y., Li, L., Zeng, W., Huang, Z., Huang, Y., & Hong, Y. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106666 · Cited by 1
Dominance and complementarity in cross-modal representation learning for wearable time series
Kunc, D., Komoszyńska, J., Avramidis, K., Feng, T., Narayanan, S. S., Kazienko, P., & Saganowski, S. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104439 · Cited by 1
Shu, M., Liu, X., & Zhou, H. (2023) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-234284 · Cited by 1
“Therefore, it is more appropriate to use “fusion” to describe the relationship between virtual technology and interactive art [18].”
RetractedAirlangga, G. (2024) · Journal of Information System Research (JOSH) · doi:10.47065/josh.v6i1.6095 · Cited by 1
The Evolution of Wearables: A Survey on Trends, Challenges, and the Emerging Impact of Smart RingsPreprint
Yin, Z., & Flores, H. (2025) · doi:10.36227/techrxiv.175416006.67595484/v1 · Cited by 1
Improving Human-Autonomous Vehicle Interaction in Complex SystemsPreprint
Kaufman, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.17170 · Cited by 1
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Ploetz, T. (2024) · arXiv · Cited by 31
Self-citationChadha, A. A. (2021) · International Journal of Research in Medical Sciences & Technology · doi:10.37648/ijrmst.v11i02.008
Challenges in Using Skin Conductance Responses for Assessments of Information Worker Productivity
Ahmad, A., & Plötz, T. (2023) · International Symposium on Wearable Computers · doi:10.1145/3594738.3611360
Self-citationCross-modal learning from visual information for activity recognition on inertial sensors
Tong, C. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-4jqroa50k
Leng, Z., & Plötz, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02393
Self-citation
Metadata
- Authors
- PlÖtz, T.
- Affiliations
- Georgia Institute of Technology (US)
- Corresponding author
- PlÖtz, Thomas
- Venue
- ACM Computing Surveys
- Published
- 2021-07-13
- Volume
- 54
- Issue
- 6
- Pages
- 1-25
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3180073572
- Cited by
- 34
- References
- 53
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 10 · 2023: 6 · 2022: 9 · 2021: 2
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- machine learning, sensor data analysis, interactive systems, ubiquitous computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.