The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances
Open accessAbstract
In the last 5 years there have been a large number of new time series classification algorithms proposed in the literature. These algorithms have been evaluated on subsets of the 47 data sets in the University of California, Riverside time series classification archive. The archive has recently been expanded to 85 data sets, over half of which have been donated by researchers at the University of East Anglia. Aspects of previous evaluations have made comparisons between algorithms difficult. For example, several different programming languages have been used, experiments involved a single train/test split and some used normalised data whilst others did not. The relaunch of the archive provides a timely opportunity to thoroughly evaluate algorithms on a larger number of datasets. We have implemented 18 recently proposed algorithms in a common Java framework and compared them against two standard benchmark classifiers (and each other) by performing 100 resampling experiments on each of the 85 datasets. We use these results to test several hypotheses relating to whether the algorithms are significantly more accurate than the benchmarks and each other. Our results indicate that only nine of these algorithms are significantly more accurate than both benchmarks and that one classifier, the collective of transformation ensembles, is significantly more accurate than all of the others. All of our experiments and results are reproducible: we release all of our code, results and experimental details and we hope these experiments form the basis for more robust testing of new algorithms in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“HIVE-COTE is currently considered the state-of-the-art algorithm for time series classification (Bagnall et al., 2017) when evaluated over the 85 datasets from the UCR/UEA archive.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“To achieve its high accuracy, HIVE-COTE becomes hugely computationally intensive and impractical to run on a real big data mining problem (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Among these methods, only a few have considered Deep Neural Networks (DNNs) to perform this task.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Similarly to Bagnall et al. (2017), in order to have a fair comparison between the tested approaches, we developed a common framework in Python, Keras (Chollet, 2015) and Tensorflow (Abadi et al., 2015) to train the deep learning models on a cluster of more than 60 GPUs.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Note that the time series in this archive are already z-normalized (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“This archive also exhibits datasets with different characteristics such as the length of the time series which, unlike the UCR/UEA archive, varies among the same dataset. This is due to the fact that the datasets in the UCR/UEA archive are already re-scaled to have an equal length among one dataset (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“In order to have a thorough and fair experimental evaluation of all approaches, we tested each algorithm on the whole UCR/UEA archive (Chen et al., 2015b; Bagnall et al., 2017) which contains 85 univariate time series datasets.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“The informal consensus in the literature is that generative models are usually less accurate than direct discriminative models (Bagnall et al., 2017; Nguyen et al., 2017);”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“To measure the performance of the model on the test data (generalization), we adopted the accuracy measure (similarly to Bagnall et al. (2017)).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“However, given the small sample size (only 7 datasets), we cannot conclude that FCN will almost always outperform the ResNet model for ECG datasets (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“This straightforward approach supposes that the ED is able to strongly separate the raw time series, which is usually not the case evident by the low accuracy of the nearest neighbor when coupled with ED (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Statistical Comparisons of Classifiers over Multiple Data Sets
Demšar, J. (2006) · doi:10.5555/1248547.1248548 · Cited by 12,051
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Experiencing SAX: A novel symbolic representation of time series
Lin, J., Keogh, E., Wei, L., & Lonardi, S. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-007-0064-z · Cited by 1,618
Self-citationQuerying and mining of time series data
Ding, H., Trajcevski, G., Scheuermann, P., Wang, X., & Keogh, E. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1454159.1454226 · Cited by 1,353
Self-citationGarcía, S., & Herrera, F. (2008) · Cited by 1,277
On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration
Keogh, E., & Kasetty, S. (2003) · Data Mining and Knowledge Discovery · doi:10.1023/a:1024988512476 · Cited by 860
Self-citationExperimental comparison of representation methods and distance measures for time series data
Wang, X., Mueen, A., Ding, H., Trajcevski, G., Scheuermann, P., & Keogh, E. (2012) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-012-0250-5 · Cited by 846
Self-citationOn The Marriage of Lp-norms and Edit Distance
Chen, L., & Ng, R. T. (2004) · Elsevier eBooks · doi:10.1016/b978-012088469-8.50070-x · Cited by 792
Algorithms for the Longest Common Subsequence Problem
Hirschberg, D. S. (1977) · Journal of the ACM · doi:10.1145/322033.322044 · Cited by 752
Cited by
Sorted by citations
Items 101–200 of 1,000
Mutual information based feature subset selection in multivariate time series classification
Ircio, J., Lojo, A., Mori, U., & Lozano, J. A. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107525 · Cited by 69
Fast and Accurate Time Series Classification Through Supervised Interval Search
Cabello, N., Naghizade, E., Qi, J., & Kulik, L. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00107 · Cited by 68
TEASER: early and accurate time series classification
Schäfer, P., & Leser, U. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00690-z · Cited by 67
Similarity Preserving Representation Learning for Time Series Clustering
Lei, Q., Yi, J., Vaculín, R., Wu, L., & Dhillon, I. S. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/394 · Cited by 80
Weighted kNN and constrained elastic distances for time-series classification
Geler, Z., Kurbalija, V., Ivanović, M. D., & Radovanović, M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113829 · Cited by 66
Borgwardt, K. M., Ghisu, E., Llinares-López, F., O’Bray, L., & Rieck, B. (2020) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000076 · Cited by 81
Adversarial Examples in Deep Learning for Multivariate Time Series Regression
Mode, G. R., & Hoque, K. A. (2020) · IEEE Applied Imagery Pattern Recognition Workshop · doi:10.1109/aipr50011.2020.9425190 · Cited by 69
Cheng, W., Suganthan, P. N., & Katuwal, R. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107826 · Cited by 65
Shehadeh, A., & Alshboul, O. (2025) · Journal of Construction Engineering and Management · doi:10.1061/jcemd4.coeng-15109 · Cited by 64
Detecting voids in 3D printing using melt pool time series data
Mahato, V., Obeidi, M. A., Brabazon, D., & Cunningham, P. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-020-01694-8 · Cited by 64
Robust fuzzy clustering of multivariate time trajectories
D’Urso, P., Giovanni, L. D., & Massari, R. (2018) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2018.05.002 · Cited by 64
Applications of shapelet transform to time series classification of earthquake, wind and wave data
Arul, M., & Kareem, A. (2020) · Engineering Structures · doi:10.1016/j.engstruct.2020.111564 · Cited by 63
Bagnall, A. J., Flynn, M., Large, J., Lines, J., & Middlehurst, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65742-0_1 · Cited by 63
Self-citationExplainable Multivariate Time Series Classification
Hsieh, T.-Y., Wang, S., Sun, Y., & Honavar, V. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441815 · Cited by 65
Transfer Learning With Time Series Data: A Systematic Mapping Study
Weber, M., Auch, M., Doblander, C., Mandl, P., & Jacobsen, H. (2021) · IEEE Access · doi:10.1109/access.2021.3134628 · Cited by 67
Gharghabi, S., Imani, S., Bagnall, A. J., Darvishzadeh, A., & Keogh, E. (2018) · Proceedings · doi:10.1109/icdm.2018.00119 · Cited by 62
Self-citationScalable, variable-length similarity search in data series
Linardi, M., & Palpanas, T. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3275366.3275372 · Cited by 61
Mapping Seasonal Agricultural Land Use Types Using Deep Learning on Sentinel-2 Image Time Series
Debella-Gilo, M., & Gjertsen, A. K. (2021) · Remote Sensing · doi:10.3390/rs13020289 · Cited by 64
Network intrusion detection based on the temporal convolutional model
Lopes, I. O., Zou, D., Abdulqadder, I. H., Akbar, S., Li, Z., Ruambo, F. A., & Pereira, W. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103465 · Cited by 60
Adaptive feature fusion for time series classification
Wang, T., Liu, Z., Zhang, T., Hussain, S. F., Waqas, M. M., & Li, Y. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108459 · Cited by 59
OuYang, L., Jin, N., & Ren, W. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117704 · Cited by 60
Time series classification using local distance-based features in multi-modal fusion networks
Iwana, B. K., & Uchida, S. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107024 · Cited by 58
Debunking Four Long-Standing Misconceptions of Time-Series Distance Measures
Paparrizos, J., Liu, C., Elmore, A. J., & Franklin, M. J. M. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3389760 · Cited by 65
Taranta, E. M., Samiei, A., Maghoumi, M., Khaloo, P., Pittman, C. R., & LaViola, J. J. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026002 · Cited by 58
Paparrizos, J., & Franklin, M. J. M. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3342263.3342648 · Cited by 61
Modeling Temporal Patterns with Dilated Convolutions for Time-Series Forecasting
Li, Y., Li, K., Chen, C., Zhou, X., Zeng, Z., & Li, K. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3453724 · Cited by 59
A novel distance measure based on dynamic time warping to improve time series classification
Liu, Y., Zhang, Y.-A., Zeng, M., & Zhao, J. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119921 · Cited by 57
Efficient Learning Interpretable Shapelets for Accurate Time Series Classification
Fang, Z., Wang, P., & Wang, W. (2018) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00052 · Cited by 57
A Time Series Classification Method for Behaviour-Based Dropout Prediction
Haiyang, L., Wang, Z., Benachour, P., & Tubman, P. (2018) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2018.00052 · Cited by 57
Modified dynamic fuzzy c-means clustering algorithm – Application in dynamic customer segmentation
Munusamy, S., & Punniyamoorthy, M. (2020) · Applied Intelligence · doi:10.1007/s10489-019-01626-x · Cited by 57
Embedding and learning with signatures
Fermanian, A. (2020) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2020.107148 · Cited by 57
Mooring system design optimization using a surrogate assisted multi-objective genetic algorithm
Pillai, A. C., Thies, P. R., & Johanning, L. (2018) · Engineering Optimization · doi:10.1080/0305215x.2018.1519559 · Cited by 56
Semi-supervised Time Series Classification Model with Self-supervised Learning
Xi, L., Yun, Z., Liu, H., Wang, R., Huang, X., & Fan, H. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105331 · Cited by 56
TCGAN: Convolutional Generative Adversarial Network for time series classification and clustering
Huang, F., & Deng, Y. S. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.06.033 · Cited by 57
Continual Deep Learning for Time Series Modeling
Ao, S.-I., & Fayek, H. M. (2023) · Sensors · doi:10.3390/s23167167 · Cited by 64
Smart Appliances and RAMI 4.0: Management and Servitization of Ice Cream Machines
Antonio Corradi, A., Foschini, L., Giannelli, C., Lazzarini, R., Stefanelli, C., Tortonesi, M., & Virgilli, G. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2867643 · Cited by 56
Deep Learning For Time Series Classification Using New Hand-Crafted Convolution Filters
Ismail-Fawaz, A., Devanne, M., Weber, J., & Forestier, G. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020496 · Cited by 55
Disentangling the city traffic rhythms: A longitudinal analysis of MFD patterns over a year
Ambühl, L., Loder, A., Leclercq, L., & Menéndez, M. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103065 · Cited by 59
Interpretable Time-series Classification on Few-shot Samples
Tang, W., Liu, L., & Long, G. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206860 · Cited by 59
Time series classification based on convolutional network with a Gated Linear Units kernel
Liu, C., Zhen, J., & Shan, W. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106296 · Cited by 55
Machine Learning in Classification Time Series with Fractal Properties
Kirichenko, L., Радівілова, Т., & Bulakh, V. (2018) · Data · doi:10.3390/data4010005 · Cited by 53
Meta-Learning for Few-Shot Time Series Classification
Narwariya, J., Malhotra, P., Vig, L., Shroff, G. M., & Tv, V. (2020) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3371158.3371162 · Cited by 53
SVP-T: A Shape-Level Variable-Position Transformer for Multivariate Time Series Classification
Zuo, R., Li, G., Choi, B. K. K., Bhowmick, S. S., Mah, D. N., & Wong, G. L. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26359 · Cited by 55
Asphalt pavement classification using smartphone accelerometer and Complexity Invariant Distance
Souza, V. M. A. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.06.003 · Cited by 53
Quantitative and Qualitative Analysis of Time-Series Classification Using Deep Learning
Ebrahim, S. A., Poshtan, J., Jamali, S. M., & Ebrahim, N. A. (2020) · IEEE Access · doi:10.1109/access.2020.2993538 · Cited by 53
Dynamic Multi-Scale Convolutional Neural Network for Time Series Classification
Qian, B., Xiao, Y. L., Zheng, Z., Zhou, M., Zhuang, W., Li, S., & Ma, Q. (2020) · IEEE Access · doi:10.1109/access.2020.3002095 · Cited by 54
MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time Series
Meng, Q., Qian, H., Liu, Y., Cui, L., Xu, Y., & Shen, Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26098 · Cited by 52
Time series anomaly detection based on shapelet learning
Beggel, L., Kausler, B. X., Schiegg, M., Pfeiffer, M., & Bischl, B. (2018) · Computational Statistics · doi:10.1007/s00180-018-0824-9 · Cited by 52
Scalable auto-encoders for gravitational waves detection from time series data
Corizzo, R., Ceci, M., Zdravevski, E., & Japkowicz, N. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113378 · Cited by 53
Time series motifs discovery under DTW allows more robust discovery of conserved structure
Alaee, S., Mercer, R., Kamgar, K., & Keogh, E. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00740-0 · Cited by 51
Self-citationTime series for early churn detection: Using similarity based classification for dynamic networks
Óskarsdóttir, M., Calster, T. V., Baesens, B., Lemahieu, W., & Vanthienen, J. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.04.003 · Cited by 51
Gait Anomaly Detection of Subjects With Parkinson’s Disease Using a Deep Time Series-Based Approach
Paragliola, G., & Coronato, A. (2018) · IEEE Access · doi:10.1109/access.2018.2882245 · Cited by 51
Flynn, M., Large, J., & Bagnall, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29859-3_33 · Cited by 51
Self-citationElastic similarity and distance measures for multivariate time series
Shifaz, A., Pelletier, C., Petitjean, F., & Webb, G. I. (2023) · Knowledge and Information Systems · doi:10.1007/s10115-023-01835-4 · Cited by 50
Dmytrów, K., Landmesser, J., & Bieszk‐Stolorz, B. (2021) · Energies · doi:10.3390/en14134024 · Cited by 50
Neural Rough Differential Equations for Long Time SeriesPreprint
Morrill, J., Salvi, C., Kidger, P., Foster, J., & Lyons, T. (2020) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2009.08295 · Cited by 50
Time Series Classification by Sequence Learning in All-Subsequence Space
Nguyen, T. L., Gsponer, S., & Ifrim, G. (2017) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2017.142 · Cited by 48
Agnostic Local Explanation for Time Series Classification
Guillemé, M., Masson, V., Rozé, L., & Termier, A. (2019) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2019.00067 · Cited by 48
Breuillard, H., Dupuis, R., Retinò, A., Contel, O. L., Amaya, J., & Lapenta, G. (2020) · Frontiers in Astronomy and Space Sciences · doi:10.3389/fspas.2020.00055 · Cited by 50
Wagner, N., Mialon, M., Sloth, K. H., Lardy, R., Ledoux, D., Silberberg, M., Roches, A. D. B. D., & Veissier, I. (2020) · Methods · doi:10.1016/j.ymeth.2020.09.003 · Cited by 48
The Signature Kernel Is the Solution of a Goursat PDE
Salvi, C., Cass, T., Foster, J., Lyons, T., & Yang, W. (2021) · SIAM Journal on Mathematics of Data Science · doi:10.1137/20m1366794 · Cited by 47
Classification of Tennis Shots with a Neural Network Approach
Ganser, A., Hollaus, B., & Stabinger, S. (2021) · Sensors · doi:10.3390/s21175703 · Cited by 47
Time series classification based on temporal features
Ji, C., Du, M., Hu, Y., Liu, S., Pan, L., & Zheng, X. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109494 · Cited by 47
Explaining Any Time Series Classifier
Guidotti, R., Monreale, A., Spinnato, F., Pedreschi, D., & Giannotti, F. (2020) · 2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi50398.2020.00029 · Cited by 46
Self-Bidirectional Decoupled Distillation for Time Series Classification
Xiao, Z., Xing, H., Qu, R., Li, H., Feng, L., Zhao, B., & Yang, J. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3360180 · Cited by 48
quant: a minimalist interval method for time series classification
Dempster, A., Schmidt, D. F., & Webb, G. I. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-024-01036-9 · Cited by 45
Auto-adaptive multilayer perceptron for univariate time series classification
Campo, F. A. D., Neri, M. C. G., Villegas, O. O. V., Sánchez, V. G. C., Domínguez, H. D. J. O., & García, V. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115147 · Cited by 45
A Multimodal Deep Learning-Based Fault Detection Model for a Plastic Injection Molding Process
Kim, G., Choi, J. G., Ku, M., Cho, H., & Lim, S. (2021) · IEEE Access · doi:10.1109/access.2021.3115665 · Cited by 44
Alqudah, M., Pavlovski, M., Dokic, T., Kezunović, M., Hu, Y., & Zoran Obradovic, A. (2021) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2021.3135336 · Cited by 44
Efficient Classification of Long Time Series by 3-D Dynamic Time Warping
Sharabiani, A., Darabi, H., Rezaei, A., Harford, S., Johnson, H., & Karim, F. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2699333 · Cited by 44
Simulating and Predicting of Hydrological Time Series Based on TensorFlow Deep Learning
Qin, J., Liang, J., Chen, T., Lei, X., & Kang, A. (2018) · Polish Journal of Environmental Studies · doi:10.15244/pjoes/81557 · Cited by 44
Li, M., & Bijker, W. (2019) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2019.01.009 · Cited by 44
Miller, C. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1030056 · Cited by 44
Towards Similarity-Aware Time-Series Classification
Zha, D., Lai, K.-H., Zhou, K., & Hu, X. (2022) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611977172.23 · Cited by 44
Zhang, H., Dong, Y., Li, J., & Xu, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3132017 · Cited by 43
Li, S., & Sun, L. (2020) · Journal of Bridge Engineering · doi:10.1061/(asce)be.1943-5592.0001531 · Cited by 43
Fully convolutional networks with shapelet features for time series classification
Ji, C., Hu, Y., Liu, S., Pan, L., Li, B., & Zheng, X. (2022) · Information Sciences · doi:10.1016/j.ins.2022.09.009 · Cited by 42
LITE: Light Inception with boosTing tEchniques for Time Series Classification
Ismail-Fawaz, A., Devanne, M., Berretti, S., Weber, J., & Forestier, G. (2023) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa60987.2023.10302569 · Cited by 42
Saifullah, S., Mercier, D., Lucieri, A., Dengel, A., & Ahmed, S. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1236947 · Cited by 53
Wisture: Touch-Less Hand Gesture Classification in Unmodified Smartphones Using Wi-Fi Signals
Haseeb, M. A. A., & Parasuraman, R. N. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2876448 · Cited by 42
Li, S., Zuo, X., Li, Z., & Wang, H. (2020) · Sensors · doi:10.3390/s20030911 · Cited by 42
Deep Convolutional Clustering-Based Time Series Anomaly Detection
Chadha, G. S., Islam, I., Schwung, A., & Ding, S. X. (2021) · Sensors · doi:10.3390/s21165488 · Cited by 42
The FreshPRINCE: A Simple Transformation Based Pipeline Time Series Classifier
Middlehurst, M., & Bagnall, A. J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-09282-4_13 · Cited by 40
Self-citationDistributed FastShapelet Transform: a Big Data time series classification algorithm
Baldán, F. J., & Benítez, J. M. (2018) · Information Sciences · doi:10.1016/j.ins.2018.10.028 · Cited by 40
Time-Series Event Prediction with Evolutionary State Graph
Hu, W., Yang, Y., Cheng, Z., Yang, C., & Ren, X. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441827 · Cited by 40
Sequence graph transform (SGT): a feature embedding function for sequence data mining
Ranjan, C., Ebrahimi, S., & Paynabar, K. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00813-0 · Cited by 40
Classifying animal behavior from accelerometry data via recurrent neural networks
Wang, L., Arablouei, R., Alvarenga, F. A. P., & Bishop-Hurley, G. J. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107647 · Cited by 42
Deep reconstruction of strange attractors from time seriesPreprint
Gilpin, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05909 · Cited by 40
Benabderrahmane, S., Mellouli, N., & Lamolle, M. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.03.025 · Cited by 39
Early classification of time series using multi-objective optimization techniques
Mori, U., Mendiburu, A., García, M. M., & Lozano, J. A. (2019) · Information Sciences · doi:10.1016/j.ins.2019.04.024 · Cited by 39
A new multi-process collaborative architecture for time series classification
Xiao, Z., Xu, X., Zhang, H., & Szczerbicki, E. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106934 · Cited by 42
Is rotation forest the best classifier for problems with continuous features?Preprint
Bagnall, A. J., Flynn, M., Large, J., Line, J., Bostrom, A., & Cawley, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.06705 · Cited by 47
Self-citationAn Effective Confidence-Based Early Classification of Time Series
Lv, J., Hu, X., Li, L., & Li, P. (2019) · IEEE Access · doi:10.1109/access.2019.2929644 · Cited by 38
Tavabi, N., Pruneski, J. A., Golchin, S., Singh, M., Sanborn, R. M., Heyworth, B. E., Landschaft, A., Kimia, A. A., & Kiapour, A. M. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102847 · Cited by 40
Efficient search of the best warping window for Dynamic Time Warping
Tan, C. W., Herrmann, M., Forestier, G., Webb, G. I., & Petitjean, F. (2018) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611975321.26 · Cited by 37
Temporal representation learning for time series classification
Hu, Y., Zhan, P., Xu, Y., Zhao, J., Li, Y., & Li, X. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05179-w · Cited by 37
Efficient class-specific shapelets learning for interpretable time series classification
Liang, Z., & Wang, H. (2021) · Information Sciences · doi:10.1016/j.ins.2021.03.063 · Cited by 37
ClaSP - Time Series Segmentation
Schäfer, P., Ermshaus, A., & Leser, U. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482240 · Cited by 37
Resource-Aware Time Series Imaging Classification for Wireless Link Layer Anomalies
Bertalanič, B., Meža, M., & Fortuna, C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3149091 · Cited by 40
Driver Identification Through Heterogeneity Modeling in Car-Following Sequences
Ding, Z., Xu, D., Tu, C., Zhao, H., Moze, M., Aioun, F., & Guillemard, F. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3151410 · Cited by 37
Metadata
- Authors
- Bagnall, A., Lines, J., Bostrom, A., Large, J., & Keogh, E.
- Affiliations
- University of East Anglia (GB)
- University of California, Riverside (US)
- Corresponding author
- Bagnall, Anthony
- Venue
- Data Mining and Knowledge Discovery
- Published
- 2016-11-23
- Volume
- 31
- Issue
- 3
- Pages
- 606-660
- ISSN
- 1384-5810 (ISSN-L)
- 1573-756X
- PMC
- PMC6404674
- OpenAlex
- W2555077524
- Cited by
- 1,377
- References
- 48
- Citations by year
- 2026: 90 · 2025: 133 · 2024: 166 · 2023: 185 · 2022: 187 · 2021: 195 · 2020: 199 · 2019: 130 · 2018: 69 · 2017: 21 · 2016: 1
- FWCI
- 81.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Data Mining and Knowledge Discovery (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion, cc-by)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Funders
- Engineering and Physical Sciences Research Council (EP/M015087/1)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- time series classification, benchmark dataset, algorithm comparison, classification accuracy, reproducibility, Java implementation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
