ESPRESSO: Entropy and ShaPe awaRe timE-Series SegmentatiOn for Processing Heterogeneous Sensor Data
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Extracting informative and meaningful temporal segments from high-dimensional wearable sensor data, smart devices, or IoT data is a vital preprocessing step in applications such as Human Activity Recognition (HAR), trajectory prediction, gesture recognition, and lifelogging. In this paper, we propose ESPRESSO (Entropy and ShaPe awaRe timE-Series SegmentatiOn), a hybrid segmentation model for multi-dimensional time-series that is formulated to exploit the entropy and temporal shape properties of time-series. ESPRESSO differs from existing methods that focus upon particular statistical or temporal properties of time-series exclusively. As part of model development, a novel temporal representation of time-series WCAC was introduced along with a greedy search approach that estimate segments based upon the entropy metric. ESPRESSO was shown to offer superior performance to four state-of-the-art methods across seven public datasets of wearable and wear-free sensing. In addition, we undertake a deeper investigation of these datasets to understand how ESPRESSO and its constituent methods perform with respect to different dataset characteristics. Finally, we provide two interesting case-studies to show how applying ESPRESSO can assist in inferring daily activity routines and the emotional state of humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Current CPD methods have failed to generalise effectively [13] as the semantic boundaries of different applications will usually be associated with different time series properties.”
From Time Series Change Point Detection with Self-Supervised Contrastive Predictive Coding (2021) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Detection of Abrupt Changes: Theory and Application
Riedel, K. S. (1994) · Technometrics · doi:10.1080/00401706.1994.10485821 · Cited by 3,518
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 2×
“2 [33, 34]: is dataset includes fourteen low-level (such as walking and siing) and high-level (such as ironing which consists of two or more low-level) human activities undertaken by eight dierent subjects.”
BackgroundIntroducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection
Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., & Van Laerhoven, K. (2018) · Proceedings of the 20th ACM International Conference on Multimodal Interaction · doi:10.1145/3242969.3242985 · Cited by 1,277
A survey of methods for time series change point detection
Aminikhanghahi, S., & Cook, D. J. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-016-0987-z · Cited by 1,237
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742 · cited 2×
“Segmentation has beenmentioned as an open challenge in analyzing life-logging data from wearable sensors in order to have more accurate models [7].”
BackgroundMethodYeh, C.-C. M., Zhu, Y., Ulanova, L., Begum, N., Ding, Y., Dau, H. A., Silva, D. F., Mueen, A., & Keogh, E. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0179 · Cited by 653
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Change-point detection in time-series data by relative density-ratio estimation
Liu, S., Yamada, M., Collier, N., & Sugiyama, M. (2013) · Neural Networks · doi:10.1016/j.neunet.2013.01.012 · Cited by 447
Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2016) · Sensors · doi:10.3390/s16040426 · Cited by 423 · cited 2×
“For wearable sensors, segmentation methods use a fixed-length sliding window.. Authors in [44] have compared the effect of window size in detecting different types of activities in HAR applications.”
Multi-task Self-Supervised Learning for Human Activity Detection
Saeed, A., Ozcelebi, T., & Lukkien, J. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3328932 · Cited by 346 · cited 1×
“Consequently, unsupervised and 100:2 • Shohreh Deldari, Daniel V. Smith, Amin Sadri, Flora D. Salim self-supervised techniques have gained a lot of attention [39].”
A unifying framework for detecting outliers and change points from non-stationary time series data
Yamanishi, K., & Takeuchi, J.-I. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775148 · Cited by 281
Symbolic time series analysis via wavelet-based partitioning
Rajagopalan, V., & Ray, A. (2006) · Signal Processing · doi:10.1016/j.sigpro.2006.01.014 · Cited by 267
Proc. of the 19th. International Joint Conference on Artificial Intelligence (IJCAI'05)
Toussaint, M., & Vijayakumar, S. (2005) · Cited by 209
Sequential change‐point detection based on direct density‐ratio estimation
Kawahara, Y., & Sugiyama, M. (2012) · Statistical Analysis and Data Mining: The ASA Data Science Journal · doi:10.1002/sam.10124 · Cited by 190
Noor, M. H. M., Salcic, Z. A., & Wang, K. I. (2016) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.09.009 · Cited by 163
37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
(2014) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2014.2370534 · Cited by 157
Peng (2018) · doi:10.1145/3214277 · Cited by 134
Movement Primitive Segmentation for Human Motion Modeling: A Framework for Analysis
Lin, J. F.-S., Karg, M. E., & Kulić, D. (2016) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2015.2493536 · Cited by 122
Online Segmentation of Human Motion for Automated Rehabilitation Exercise Analysis
Lin, J. F.-S., & Kulić, D. (2013) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2013.2259640 · Cited by 111
Greedy Gaussian segmentation of multivariate time series
Hallac, D., Nystrup, P., & Boyd, S. (2018) · Advances in Data Analysis and Classification · doi:10.1007/s11634-018-0335-0 · Cited by 111
Matrix Profile VIII: Domain Agnostic Online Semantic Segmentation at Superhuman Performance Levels
Gharghabi, S., Ding, Y., Yeh, C. M., et al. (2017) · Proceedings · doi:10.1109/icdm.2017.21 · Cited by 103
Complex activity recognition using time series pattern dictionary learned from ubiquitous sensors
Liu, L., Peng, Y., Wang, S., Liu, M., & Huang, Z. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.020 · Cited by 98
Chamroukhi, F., Mohammed, S., Trabelsi, D., Oukhellou, L., & Amirat, Y. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.04.003 · Cited by 88
Enhancing activity recognition using CPD-based activity segmentation
Aminikhanghahi, S., & Cook, D. J. (2019) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2019.01.004 · Cited by 86
Change-point detection with feature selection in high-dimensional time-series data
Yamada, M., Kimura, A., Naya, F., & Sawada, H. (2013) · International Joint Conference on Artificial Intelligence · Cited by 81
Individualized Time-Series Segmentation for Mining Mobile Phone User Behavior
Sarker, I. H., Colman, A., Kabir, M. A., & Han, J. (2018) · The Computer Journal · doi:10.1093/comjnl/bxx082 · Cited by 80
Modeling RFID Signal Reflection for Contact-free Activity Recognition
Wang, Y., & Zheng, Y. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3287071 · Cited by 72
Time Series Segmentation through Automatic Feature LearningPreprint
Lee, W., Ortiz, J., Ko, B., & Lee, R. B.-L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05394 · Cited by 65
Domain agnostic online semantic segmentation for multi-dimensional time series
Gharghabi, S., Yeh, C. M., Ding, Y., Ding, W., Hibbing, P. R., LaMunion, S. R., Kaplan, A. S., Crouter, S. E., & Keogh, E. (2018) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-018-0589-3 · Cited by 64
Information gain-based metric for recognizing transitions in human activities
Sadri, A., Ren, Y., & Salim, F. D. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2017.01.003 · Cited by 60
Self-citationNi, Q., Patterson, T. J., Cleland, I., & Nugent, C. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.07.005 · Cited by 59
Huang, A., Wang, D., Zhao, R., & Zhang, Q. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3328919 · Cited by 59
Using change point detection to automate daily activity segmentation
Aminikhanghahi, S., & Cook, D. J. (2017) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2017.7917569 · Cited by 57
Segmenting human activities based on HMMs using smartphone inertial sensors
San-Segundo, R., Lorenzo-Trueba, J., Martínez-González, B., & Pardo, J. M. (2016) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.01.004 · Cited by 53
A Test Collection for Interactive Lifelog Retrieval
Gurrin, C. G., Schoeffmann, K., Joho, H., Münzer, B., Albatal, R., Hopfgartner, F., Zhou, L., & Dang‐Nguyen, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05710-7_26 · Cited by 50
Mining User Behavioral Rules from Smartphone Data Through Association Analysis
Sarker, I. H., & Salim, F. D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93034-3_36 · Cited by 45
Self-citationZhu, Y., Imamura, M., Nikovski, D. N., & Keogh, E. (2017) · Proceedings · doi:10.1109/icdm.2017.79 · Cited by 43
Exploring and extending the boundaries of physical activity recognition
Reiss, A., Weber, M., & Stricker, D. (2011) · 2011 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2011.6083640 · Cited by 42
What Will You Do for the Rest of the Day?: An Approach to Continuous Trajectory Prediction
Sadri, A., Salim, F. D., Ren, Y., Shao, W., Krumm, J. C., & Mascolo, C. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3287064 · Cited by 42
Self-citationLam, A. W. K., Varona-Marin, D., Li, Y., et al. (2015) · Human-Computer Interaction · doi:10.1080/07370024.2015.1093419 · Cited by 39
Li, Z., Wei, Z., Jia, W., & Sun, M. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610136 · Cited by 28
Detecting Changes in Rare Patterns from Data Streams
Huang, D. T. J., Koh, Y. S., Dobbie, G., et al. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-06605-9_36 · Cited by 20
Haladjian, J. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3369813 · Cited by 19
Optimal time window for temporal segmentation of sensor streams in multi-activity recognition
Liono, J., Qin, A. K., & Salim, F. D. (2016) · Proceedings of the 13th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services · doi:10.1145/2994374.2994388 · Cited by 18
Self-citationMultivariate electricity consumption prediction with Extreme Learning Machine
Song, H., Qin, A. K., & Salim, F. D. (2016) · doi:10.1109/ijcnn.2016.7727486 · Cited by 16
Self-citationYao, L., Sheng, Q. Z., Ruan, W., Li, X., Wang, S., & Yang, Z. Q. (2015) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads.2015.23 · Cited by 15
Angry or Climbing Stairs? Towards Physiological Emotion Recognition in the Wild
Heinisch, J. S., Anderson, C., & David, K. (2019) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2019.8730725 · Cited by 14
Higher Education Check-Ins: Exploring the User Experience of Hybrid Location Sensing
Huang, Y., Sang, Y., Wu, Q., & Yao, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359168 · Cited by 12
Evolutionary Multi-objective Ensemble Learning for Multivariate Electricity Consumption Prediction
Song, H., Qin, A. K., & Salim, F. D. (2018) · doi:10.1109/ijcnn.2018.8489261 · Cited by 10
Self-citationThe Impact of Physical Activities on the Physiological Response to Emotions
Heinisch, J. S., Hübener, I., & David, K. (2018) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2018.8480086 · Cited by 9
Discovering All-Chain Set in Streaming Time Series
Wang, S., Yuan, Y., & Li, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-16148-4_24 · Cited by 4
Research works printed but not linked: 9
- Aminikhanghahi Samaneh, 2017, Cook
- Deldari Shohreh, 2019, Proceedings of ACM International Conference on Web Search and Data Mining (WSDM) workshop on Task Intelligence (TI@WSDM)
- Heinisch Judith S, 2019, Towards Physiological Emotion Recognition in the Wild. In IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE, 486--491
- Kawahara Y., Change-Point Detection in Time-Series Data Based on Subspace Identification. In Seventh IEEE International Conference on Data Mining (ICDM). IEEE, 559--564
- Rösler Oliver, 2013, Proc. of the AIHLS, International Conference on Applied Informatics for Health and Life Sciences
- Yamada Makoto, 2013, Proc. of 23th International Joint Conference on Artificial Intelligence (IJCAI).
- Yao Lina, 2015, IEEE 21st International Conference on Parallel and Distributed Systems (ICPAADS). 116--123
- Michael Yeh Chin-Chia, 2016, IEEE 16th international conference on data mining (ICDM). IEEE, 1317--1322
- Zameni Masoomeh, 2019, Unsupervised Online Change Point Detection in High-Dimensional Time Series. Knowledge and Information Systems (KAIS)
Cited by
Time Series Change Point Detection with Self-Supervised Contrastive Predictive Coding
Deldari, S., Smith, D. V., Xue, H., & Salim, F. D. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449903 · Cited by 136
“5 USC-HAD 97K 6 3 30 4.2 Baseline Methods The performance of the proposed��−��2 method was compared against five state-of-the-art unsupervised change point detection techniques that included ESPRESSO [13], FLOSS [18], aHSIC [52], RuLSIF [30], and KL-CPD [6]. To avoid inconsistencies and implementation errors, and to p…”
BackgroundMethodInfluentialSelf-citationGenerative Adversarial Networks for Spatio-temporal Data: A Survey
Gao, N., Xue, H., Shao, W., Zhao, S., Qin, K. K., Prabowo, A., Rahaman, M. S., & Salim, F. D. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3474838 · Cited by 127
Self-citationCOCOA: Cross Modality Contrastive Learning for Sensor Data
Deldari, S., Xue, H., Saeed, A., Smith, D. V., & Salim, F. D. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550316 · Cited by 92
Self-citation
Metadata
- Authors
- Deldari, S., Smith, D. V., Sadri, A., & Salim, F.
- Affiliations
- Commonwealth Scientific and Industrial Research Organisation (AU)
- Australia and New Zealand Banking Group (AU)
- RMIT University (AU)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2020-09-04
- Volume
- 4
- Issue
- 3
- Pages
- 1-24
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3047637857
- Cited by
- 48
- References
- 52
- Citations by year
- 2026: 8 · 2025: 8 · 2024: 10 · 2023: 4 · 2022: 13 · 2021: 4 · 2020: 1
- FWCI
- 2.98
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RMIT Research Repository (RMIT University Library) (submittedVersion)
- Figshare (submittedVersion)
- arXiv (Cornell University)
- Funders
- Australian Research Council (DP190101485)
- Data61 CSIRO (500588)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
- Keywords
- time series segmentation, wearable sensor data, entropy-based segmentation, multidimensional time series, greedy search, human activity recognition, lifelogging, emotional state inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.