The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances
Open accessAbstract
In the last 5 years there have been a large number of new time series classification algorithms proposed in the literature. These algorithms have been evaluated on subsets of the 47 data sets in the University of California, Riverside time series classification archive. The archive has recently been expanded to 85 data sets, over half of which have been donated by researchers at the University of East Anglia. Aspects of previous evaluations have made comparisons between algorithms difficult. For example, several different programming languages have been used, experiments involved a single train/test split and some used normalised data whilst others did not. The relaunch of the archive provides a timely opportunity to thoroughly evaluate algorithms on a larger number of datasets. We have implemented 18 recently proposed algorithms in a common Java framework and compared them against two standard benchmark classifiers (and each other) by performing 100 resampling experiments on each of the 85 datasets. We use these results to test several hypotheses relating to whether the algorithms are significantly more accurate than the benchmarks and each other. Our results indicate that only nine of these algorithms are significantly more accurate than both benchmarks and that one classifier, the collective of transformation ensembles, is significantly more accurate than all of the others. All of our experiments and results are reproducible: we release all of our code, results and experimental details and we hope these experiments form the basis for more robust testing of new algorithms in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“HIVE-COTE is currently considered the state-of-the-art algorithm for time series classification (Bagnall et al., 2017) when evaluated over the 85 datasets from the UCR/UEA archive.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“To achieve its high accuracy, HIVE-COTE becomes hugely computationally intensive and impractical to run on a real big data mining problem (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Among these methods, only a few have considered Deep Neural Networks (DNNs) to perform this task.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Similarly to Bagnall et al. (2017), in order to have a fair comparison between the tested approaches, we developed a common framework in Python, Keras (Chollet, 2015) and Tensorflow (Abadi et al., 2015) to train the deep learning models on a cluster of more than 60 GPUs.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Note that the time series in this archive are already z-normalized (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“This archive also exhibits datasets with different characteristics such as the length of the time series which, unlike the UCR/UEA archive, varies among the same dataset. This is due to the fact that the datasets in the UCR/UEA archive are already re-scaled to have an equal length among one dataset (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“In order to have a thorough and fair experimental evaluation of all approaches, we tested each algorithm on the whole UCR/UEA archive (Chen et al., 2015b; Bagnall et al., 2017) which contains 85 univariate time series datasets.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“The informal consensus in the literature is that generative models are usually less accurate than direct discriminative models (Bagnall et al., 2017; Nguyen et al., 2017);”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“To measure the performance of the model on the test data (generalization), we adopted the accuracy measure (similarly to Bagnall et al. (2017)).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“However, given the small sample size (only 7 datasets), we cannot conclude that FCN will almost always outperform the ResNet model for ECG datasets (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“This straightforward approach supposes that the ED is able to strongly separate the raw time series, which is usually not the case evident by the low accuracy of the nearest neighbor when coupled with ED (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Statistical Comparisons of Classifiers over Multiple Data Sets
Demšar, J. (2006) · doi:10.5555/1248547.1248548 · Cited by 12,051
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Experiencing SAX: A novel symbolic representation of time series
Lin, J., Keogh, E., Wei, L., & Lonardi, S. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-007-0064-z · Cited by 1,618
Self-citationQuerying and mining of time series data
Ding, H., Trajcevski, G., Scheuermann, P., Wang, X., & Keogh, E. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1454159.1454226 · Cited by 1,353
Self-citationGarcía, S., & Herrera, F. (2008) · Cited by 1,277
On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration
Keogh, E., & Kasetty, S. (2003) · Data Mining and Knowledge Discovery · doi:10.1023/a:1024988512476 · Cited by 860
Self-citationExperimental comparison of representation methods and distance measures for time series data
Wang, X., Mueen, A., Ding, H., Trajcevski, G., Scheuermann, P., & Keogh, E. (2012) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-012-0250-5 · Cited by 846
Self-citationOn The Marriage of Lp-norms and Edit Distance
Chen, L., & Ng, R. T. (2004) · Elsevier eBooks · doi:10.1016/b978-012088469-8.50070-x · Cited by 792
Algorithms for the Longest Common Subsequence Problem
Hirschberg, D. S. (1977) · Journal of the ACM · doi:10.1145/322033.322044 · Cited by 752
Cited by
Sorted by citations
Items 301–400 of 1,000
Unsupervised machine learning techniques to prevent faults in railroad switch machines
Soares, N., de Aguiar, E. P., Souza, A. C., & Goliatt, L. (2021) · International Journal of Critical Infrastructure Protection · doi:10.1016/j.ijcip.2021.100423 · Cited by 23
Concurrent time-series selections using deep learning and dimension reduction
Ali, M., Borgo, R., & Jones, M. W. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107507 · Cited by 23
Distributed evidential clustering toward time series with big data issue
Gong, C., Su, Z., Wang, P.-H., & You, Y. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116279 · Cited by 23
Bier, A., Jastrzębska, A., & Olszewski, P. (2022) · IEEE Access · doi:10.1109/access.2022.3203523 · Cited by 23
Brouwers, S., Simmler, M., Savary, P., & Scriba, M. F. (2023) · Smart Agricultural Technology · doi:10.1016/j.atech.2023.100199 · Cited by 23
Time Series Dataset Survey for Forecasting with Deep Learning
Hahn, Y., Langer, T., Meyes, R., & Meisen, T. (2023) · Forecasting · doi:10.3390/forecast5010017 · Cited by 28
Real-Time Personalized Physiologically Based Stress Detection for Hazardous Operations
Finseth, T., Dorneich, M. C., Vardeman, S. B., Keren, N., & Franke, W. D. (2023) · IEEE Access · doi:10.1109/access.2023.3254134 · Cited by 25
Knap, P., Lalik, K., & Bałazy, P. (2023) · Sensors · doi:10.3390/s23094295 · Cited by 23
Hosseinzadeh, P., Boubrahimi, S. F., & Hamdi, S. M. (2024) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ad1de0 · Cited by 24
Eddy, E., Campbell, E., Bateman, S., & Scheme, E. (2024) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad4915 · Cited by 23
Generalized Dynamic Time Warping: Unleashing the Warping Power Hidden in Point-Wise Distances
Neamtu, R., Ahsan, R., Rundensteiner, E. A., Sárközy, G. N., Keogh, E., Dau, H. A., Nguyen, C., & Lovering, C. (2018) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00054 · Cited by 23
Self-citationSimilarity Measure Based on Incremental Warping Window for Time Series Data Mining
Li, H., & Wang, C. (2018) · IEEE Access · doi:10.1109/access.2018.2889792 · Cited by 23
Schleicher, M., Unnikrishnan, V., Neff, P. K. A., Simoes, J. P., Probst, T., Pryss, R. C., Schlee, W., & Spiliopoulou, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-79527-0 · Cited by 23
Kennedy, A., Nash, G., Rattenbury, N. J., & Kempa-Liehr, A. W. (2021) · Astronomy and Computing · doi:10.1016/j.ascom.2021.100460 · Cited by 23
High-Dimensional Similarity Search for Scalable Data Science
Echihabi, K., Zoumpatianos, K., & Palpanas, T. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00268 · Cited by 23
Gauthier, R., Largouët, C., Rozé, L., & Dourmad, J.-Y. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106329 · Cited by 23
SMATE: Semi-Supervised Spatio-Temporal Representation Learning on Multivariate Time Series
Zuo, J., Zeitouni, K., & Taher, Y. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00206 · Cited by 23
Classification and Annotation of Open Internet of Things Datastreams
Montori, F., Liao, K., Jayaraman, P. P., Bononi, L., Sellis, T., & Georgakopoulos, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-02925-8_15 · Cited by 23
timeXplain -- A Framework for Explaining the Predictions of Time Series ClassifiersPreprint
Mujkanovic, F., Doskoč, V., Schirneck, M., Schäfer, P., & Friedrich, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07606 · Cited by 23
Multi-modal lifelog data fusion for improved human activity recognition: A hybrid approach
Oh, Y., & Kim, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102464 · Cited by 22
A DDoS Detection Method for Socially Aware Networking Based on Forecasting Fusion Feature Sequence
Cheng, J., Zhou, J., Liu, Q., Tang, X., & Guo, Y. (2018) · The Computer Journal · doi:10.1093/comjnl/bxy025 · Cited by 22
Shang, D., Shang, P., & Liu, L. (2018) · Nonlinear Dynamics · doi:10.1007/s11071-018-4728-6 · Cited by 22
Meteier, Q., de Salis, E., Capallera, M., Widmer, M., Angelini, L., Khaled, O. A., Sonderegger, A., & Mugellini, E. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.775282 · Cited by 24
Bhattacharya, S. (2022) · Geophysics · doi:10.1190/geo2021-0478.1 · Cited by 22
The characteristics of flare- and CME-productive solar active regions
Kontogiannis, I. (2022) · Advances in Space Research · doi:10.1016/j.asr.2022.10.008 · Cited by 22
TSEvo: Evolutionary Counterfactual Explanations for Time Series Classification
Höllig, J., Kulbach, C., & Thoma, S. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00013 · Cited by 22
Paparrizos, J., Wu, K., Elmore, A. J., Faloutsos, C., & Franklin, M. J. M. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3594512.3594530 · Cited by 22
Eddy, E., Campbell, E., Bateman, S., & Scheme, E. (2024) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2024.1463377 · Cited by 27
Topological time-series analysis with delay-variant embedding
Tran, Q. H., & Hasegawa, Y. (2019) · Physical review. E · doi:10.1103/physreve.99.032209 · Cited by 22
GENDIS: Genetic Discovery of Shapelets
Vandewiele, G., Ongenae, F., & Turck, F. D. (2021) · Sensors · doi:10.3390/s21041059 · Cited by 22
Fuzzy Cognitive Map-Driven Comprehensive Time-Series Classification
Jastrzębska, A., Nápoles, G., Homenda, W., & Vanhoof, K. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3133597 · Cited by 22
Time Series Classification in Reservoir- and Model-Space
Aswolinskiy, W., Reinhart, F., & Steil, J. J. (2017) · Neural Processing Letters · doi:10.1007/s11063-017-9765-5 · Cited by 22
Learning Time Series Counterfactuals via Latent Space Representations
Wang, Z., Samsten, I., Mochaourab, R., & Papapetrou, P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88942-5_29 · Cited by 21
Wen, T.-H., & Teo, T. (2022) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-v-3-2022-557-2022 · Cited by 21
AutoTransformer: Automatic Transformer Architecture Design for Time Series Classification
Ren, Y., Li, L., Yang, X., & Zhou, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05933-9_12 · Cited by 21
Broad fuzzy cognitive map systems for time series classification
Wu, K., Yuan, K., Teng, Y., Liu, J., & Jiao, L. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109458 · Cited by 21
Echihabi, K., Tsandilas, T., Gogolou, A., Bezerianos, A., & Palpanas, T. (2022) · The VLDB Journal · doi:10.1007/s00778-022-00771-z · Cited by 21
Lin, D. Y., Kenéz, Á., McArt, J. A. A., & Li, J. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107638 · Cited by 21
Finding Precursors to Anomalous Drop in Airspeed During a Flight's Takeoff
Janakiraman, V. M., Matthews, B. L., & Oza, N. C. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098097 · Cited by 21
Cryptomining Cannot Change Its Spots: Detecting Covert Cryptomining Using Magnetic Side-Channel
Gangwal, A., & Conti, M. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2945171 · Cited by 21
Fast data series indexing for in-memory data
Peng, B., Fatourou, P., & Palpanas, T. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00677-2 · Cited by 21
Rožanec, J. M., Petelin, G., da Costa, J. P. C. L., Cerar, G., Bertalanič, B., Guček, M., Papa, G., & Mladenić, D. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110339 · Cited by 25
Zhang, Y., Gan, F., & Chen, X. (2020) · IEEE Conference on Energy Internet and Energy System Integration (EI2) · doi:10.1109/ei250167.2020.9346704 · Cited by 22
Spiller, M., Liu, Y., Hossain, M. Z., Gedeon, T., Geissler, J., & Nürnberger, A. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3446638 · Cited by 20
Multivariate temporal data analysis ‐ a review
Moskovitch, R. (2021) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1430 · Cited by 21
Gated three-tower transformer for text-driven stock market prediction
Chen, J., Chen, T., Shen, M., Shi, Y., Wang, D., & Zhang, X. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-11908-1 · Cited by 21
Wang, D., Hu, Q., & Yang, C. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105654 · Cited by 20
Identification of robust deep neural network models of longitudinal clinical measurements
Javidi, H., Mariam, A., Khademi, G., Zabor, E. C., Zhao, R., Radivoyevitch, T., & Rotroff, D. M. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00651-4 · Cited by 23
Explainable online ensemble of deep neural network pruning for time series forecasting
Saadallah, A., Jakobs, M., & Morik, K. J. (2022) · Machine Learning · doi:10.1007/s10994-022-06218-4 · Cited by 20
Time-frequency based multi-task learning for semi-supervised time series classification
Wei, C., Wang, Z., Yuan, J., Li, C., & Chen, S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.11.040 · Cited by 20
Sparse Binary Transformers for Multivariate Time Series Modeling
Gorbett, M., Shirazi, H. M., & Ray, I. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599508 · Cited by 21
A user‐friendly guide to using distance measures to compare time series in ecology
Dove, S., Böhm, M., Freeman, R., Jellesmark, S., & Murrell, D. J. (2023) · Ecology and Evolution · doi:10.1002/ece3.10520 · Cited by 20
Time series clustering to improve one-class classifier performance
Machado, A. P. F., Munaro, C. J., Ciarelli, P. M., & Vargas, R. E. V. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122895 · Cited by 20
Glacier: guided locally constrained counterfactual explanations for time series classification
Wang, Z., Samsten, I., Miliou, I., Mochaourab, R., & Papapetrou, P. (2024) · Machine Learning · doi:10.1007/s10994-023-06502-x · Cited by 24
Mustaqeem, M., Alam, M., Mustajab, S., Alshanketi, F., Alam, S., & Shuaib, M. (2025) · IEEE Access · doi:10.1109/access.2024.3517419 · Cited by 20
Rothe, S., Kudszus, B., & Söffker, D. (2019) · Entropy · doi:10.3390/e21090866 · Cited by 20
On Inferring Intentions in Shared Tasks for Industrial Collaborative Robots
Olivares-Alarcos, A., Foix, S., & Alenyà, G. (2019) · Electronics · doi:10.3390/electronics8111306 · Cited by 20
Zhang, C., Fanaee‐T, H., & Thoresen, M. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00724-6 · Cited by 22
Cardoso-Pereira, I., Borges, J. B., Barros, P. H., Loureiro, A. A. F., Rosso, O. A., & Ramos, H. S. (2021) · Nonlinear Dynamics · doi:10.1007/s11071-021-07059-x · Cited by 20
Temporal Rule-Based Counterfactual Explanations for Multivariate Time Series
Bahri, O., Li, P., Boubrahimi, S. F., & Hamdi, S. M. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00200 · Cited by 20
Liu, L., Pei, Z., Chen, P., Luo, H., Gao, Z., Feng, K., & Gan, Z. (2023) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-023-00212-x · Cited by 19
Xia, S., Zhou, X., Shi, H., & Li, S. (2023) · Ships and Offshore Structures · doi:10.1080/17445302.2023.2211880 · Cited by 19
Understanding Any Time Series Classifier with a Subsequence-based Explainer
Spinnato, F., Guidotti, R., Monreale, A., Nanni, M., Pedreschi, D., & Giannotti, F. (2023) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3624480 · Cited by 19
Cavalcante, A. A. B., Freire, P. M. S., Goldschmidt, R. R., & Justel, C. M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123350 · Cited by 19
A machine learning-assisted nondestructive testing method based on time-domain wave signals
Tian, Z., Li, J., Li, X., Wang, Z., Zhou, X., Sang, Y., & Zou, C. (2024) · International Journal of Rock Mechanics and Mining Sciences · doi:10.1016/j.ijrmms.2024.105731 · Cited by 19
Chen, L., Xu, D., Yang, L., Ng, C., Fu, J., He, Y., & He, Y. (2024) · Journal of Wind Engineering and Industrial Aerodynamics · doi:10.1016/j.jweia.2024.105852 · Cited by 19
A novel multi-resolution representation for time series sensor data analysis
Hu, Y., Ji, C., Zhang, Q., Chen, L., Zhan, P., & Li, X. (2019) · Soft Computing · doi:10.1007/s00500-019-04562-7 · Cited by 19
Withington, L., de Vera, D. D. P., Guest, C., Mancini, C., & Piwek, P. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115564 · Cited by 21
Fast Time Series Classification with Random Symbolic Subsequences
Nguyen, T. L., & Ifrim, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-24378-3_4 · Cited by 19
Recurrent Auto-Encoder Model for Large-Scale Industrial Sensor Signal Analysis
Wong, T., & Luo, Z. (2018) · Communications in computer and information science · doi:10.1007/978-3-319-98204-5_17 · Cited by 20
Dynamic Barycenter Averaging Kernel in RBF Networks for Time Series Classification
Shi, K., Qin, H., Sima, C., Li, S., Shen, L., & Ma, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2910017 · Cited by 19
Automatic Driver Identification from In-Vehicle Network Logs
Remeli, M., Lestyán, S., Ács, G., & Biczók, G. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917354 · Cited by 20
PIP: Pictorial Interpretable Prototype Learning for Time Series Classification
Ghods, A., & Cook, D. J. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2021.3129957 · Cited by 18
Decision Mining with Time Series Data Based on Automatic Feature Generation
Scheibel, B., & Rinderle‐Ma, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-07472-1_1 · Cited by 18
Rel-CNN: Learning Relationship Features in Time Series for Classification
He, F., Fu, T.-Y., & Lee, W.-C. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3186963 · Cited by 18
Kuo, R. J., Chen, H., & Kuo, Y.-H. (2022) · Scientific Reports · doi:10.1038/s41598-022-15053-5 · Cited by 18
A Machine Learning Attack on Illegal Trading
James, R., Leung, H., & Prokhorov, A. B. (2020) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2022.106735 · Cited by 18
Micro-scale spatial preference and temporal cyclicity linked to foraging in harbour porpoises
Stedt, J., Wahlberg, M., Carlström, J., Nilsson, P. A., Amundin, M., Oskolkov, N., & Carlsson, P. (2023) · Marine Ecology Progress Series · doi:10.3354/meps14268 · Cited by 19
Appliance Detection Using Very Low-Frequency Smart Meter Time Series
Petralia, A., Charpentier, P., Boniol, P., & Palpanas, T. (2023) · ACM International Conference on Future Energy Systems (e-Energy) · doi:10.1145/3575813.3595198 · Cited by 18
Tian, S., Zhang, Y., Feng, Y., Elsagan, N., Ko, Y. J., Mozaffari, M. H., Xi, D. D. Z., & Lee, C.-G. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120914 · Cited by 18
Rahman, M. M., Farahani, M. A., & Wuest, T. (2023) · Journal of Manufacturing and Materials Processing · doi:10.3390/jmmp7050164 · Cited by 18
End-to-End Signal Classification in Signed Cumulative Distribution Transform Space
Rubaiyat, A. H. M., Li, S., Yin, X., Shifat‐E‐Rabbi, M., Zhuang, Y., & Rohde, G. K. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3372455 · Cited by 19
Toward Fingertip Non-Contact Material Recognition and Near-Distance Ranging for Robotic Grasping
Fang, C., Wang, D., Song, D., & Zou, J. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793922 · Cited by 18
A Case Driven Study of the Use of Time Series Classification for Flexibility in Industry 4.0
Polge, J., Robert, J., & Traon, Y. L. (2020) · Sensors · doi:10.3390/s20247273 · Cited by 18
Feature learning for efficient ASR-free keyword spotting in low-resource languages
van der Westhuizen, E., Kamper, H., Menon, R., Quinn, J. A., & Niesler, T. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101275 · Cited by 18
Visual identification of oscillatory two-phase flow with complex flow patterns
Huang, Y., Li, D., Niu, H., & Conte, D. (2021) · Measurement · doi:10.1016/j.measurement.2021.110148 · Cited by 18
Sparsification of the alignment path search space in dynamic time warping
Soheily-Khah, S., & Marteau, P.-F. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.03.009 · Cited by 18
Gupta, A., Gupta, H. P., Biswas, B., & Dutta, T. (2020) · ACM Transactions on Internet of Things · doi:10.1145/3375877 · Cited by 18
Ramirez, E., Wimmer, M., & Atzmueller, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-37446-4_11 · Cited by 17
Dopaminergic signaling to ventral striatum neurons initiates sniffing behavior
Johnson, N. L., Cotelo-Larrea, A., Stetzik, L. A., Akkaya, U. M., Zhang, Z., Gadziola, M. A., Varga, A. G., Ma, M., & Wesson, D. W. (2025) · Nature Communications · doi:10.1038/s41467-024-55644-6 · Cited by 19
West, N., Schlegl, T., & Deuse, J. (2021) · International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) · doi:10.1109/icbaie52039.2021.9389954 · Cited by 17
Predicting Hydrological Drought Alert Levels Using Supervised Machine-Learning Classifiers
Jehanzaib, M., Shah, S. A., Son, H. J., Jang, S., & Kim, T. (2022) · KSCE Journal of Civil Engineering · doi:10.1007/s12205-022-1367-8 · Cited by 17
Toward Improving the Security of IoT and CPS Devices: An AI Approach
Albasir, A. A., Naik, K., & Ricardo Manzano, S. (2022) · Digital Threats Research and Practice · doi:10.1145/3497862 · Cited by 19
Yousef, I., Tulsyan, A., Shah, S. L., & Gopaluni, R. B. (2023) · Journal of Process Control · doi:10.1016/j.jprocont.2023.103127 · Cited by 17
Most influential feature form for supervised learning in voltage sag source localization
Mohammadi, Y., Polajžer, B., Leborgne, R. C., & Khodadad, D. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108331 · Cited by 17
Uribarri, G., Barone, F., Ansuini, A., & Fransén, E. A. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-024-01062-7 · Cited by 21
Extracting Statistical Graph Features for Accurate and Efficient Time Series Classification
Li, D., Lin, J., Bissyandé, T. F., Klein, J., & Traon, Y. L. (2018) · Open Repository and Bibliography (University of Luxembourg) · doi:10.5441/002/edbt.2018.19 · Cited by 17
A Novel Segmentation and Representation Approach for Streaming Time Series
Hu, Y., Guan, P., Zhan, P., Ding, Y., & Li, X. (2018) · IEEE Access · doi:10.1109/access.2018.2828320 · Cited by 17
Liu, J., Yan, J., Wang, L., Huang, L., He, H., & Liu, H. (2021) · Remote Sensing · doi:10.3390/rs13091804 · Cited by 17
WatchPlant: Networked Bio-hybrid Systems for Pollution Monitoring of Urban Areas
Hamann, H., Bogdan, S., Díaz‐Espejo, A., García‐Carmona, L., Hernández‐Santana, V., Kernbach, S., Kernbach, A., Quijano-López, A., Salamat, B., & Wahby, M. (2021) · Conference on Artificial Life (ALIFE) · doi:10.1162/isal_a_00377 · Cited by 18
Metadata
- Authors
- Bagnall, A., Lines, J., Bostrom, A., Large, J., & Keogh, E.
- Affiliations
- University of East Anglia (GB)
- University of California, Riverside (US)
- Corresponding author
- Bagnall, Anthony
- Venue
- Data Mining and Knowledge Discovery
- Published
- 2016-11-23
- Volume
- 31
- Issue
- 3
- Pages
- 606-660
- ISSN
- 1384-5810 (ISSN-L)
- 1573-756X
- PMC
- PMC6404674
- OpenAlex
- W2555077524
- Cited by
- 1,377
- References
- 48
- Citations by year
- 2026: 90 · 2025: 133 · 2024: 166 · 2023: 185 · 2022: 187 · 2021: 195 · 2020: 199 · 2019: 130 · 2018: 69 · 2017: 21 · 2016: 1
- FWCI
- 81.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Data Mining and Knowledge Discovery (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion, cc-by)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Funders
- Engineering and Physical Sciences Research Council (EP/M015087/1)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- time series classification, benchmark dataset, algorithm comparison, classification accuracy, reproducibility, Java implementation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
