The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances
Open accessAbstract
In the last 5 years there have been a large number of new time series classification algorithms proposed in the literature. These algorithms have been evaluated on subsets of the 47 data sets in the University of California, Riverside time series classification archive. The archive has recently been expanded to 85 data sets, over half of which have been donated by researchers at the University of East Anglia. Aspects of previous evaluations have made comparisons between algorithms difficult. For example, several different programming languages have been used, experiments involved a single train/test split and some used normalised data whilst others did not. The relaunch of the archive provides a timely opportunity to thoroughly evaluate algorithms on a larger number of datasets. We have implemented 18 recently proposed algorithms in a common Java framework and compared them against two standard benchmark classifiers (and each other) by performing 100 resampling experiments on each of the 85 datasets. We use these results to test several hypotheses relating to whether the algorithms are significantly more accurate than the benchmarks and each other. Our results indicate that only nine of these algorithms are significantly more accurate than both benchmarks and that one classifier, the collective of transformation ensembles, is significantly more accurate than all of the others. All of our experiments and results are reproducible: we release all of our code, results and experimental details and we hope these experiments form the basis for more robust testing of new algorithms in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“HIVE-COTE is currently considered the state-of-the-art algorithm for time series classification (Bagnall et al., 2017) when evaluated over the 85 datasets from the UCR/UEA archive.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“To achieve its high accuracy, HIVE-COTE becomes hugely computationally intensive and impractical to run on a real big data mining problem (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Among these methods, only a few have considered Deep Neural Networks (DNNs) to perform this task.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Similarly to Bagnall et al. (2017), in order to have a fair comparison between the tested approaches, we developed a common framework in Python, Keras (Chollet, 2015) and Tensorflow (Abadi et al., 2015) to train the deep learning models on a cluster of more than 60 GPUs.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“Note that the time series in this archive are already z-normalized (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“This archive also exhibits datasets with different characteristics such as the length of the time series which, unlike the UCR/UEA archive, varies among the same dataset. This is due to the fact that the datasets in the UCR/UEA archive are already re-scaled to have an equal length among one dataset (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“In order to have a thorough and fair experimental evaluation of all approaches, we tested each algorithm on the whole UCR/UEA archive (Chen et al., 2015b; Bagnall et al., 2017) which contains 85 univariate time series datasets.”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“The informal consensus in the literature is that generative models are usually less accurate than direct discriminative models (Bagnall et al., 2017; Nguyen et al., 2017);”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“To measure the performance of the model on the test data (generalization), we adopted the accuracy measure (similarly to Bagnall et al. (2017)).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“However, given the small sample size (only 7 datasets), we cannot conclude that FCN will almost always outperform the ResNet model for ECG datasets (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
In the citing paper
“This straightforward approach supposes that the ED is able to strongly separate the raw time series, which is usually not the case evident by the low accuracy of the nearest neighbor when coupled with ED (Bagnall et al., 2017).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bagnall et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Statistical Comparisons of Classifiers over Multiple Data Sets
Demšar, J. (2006) · doi:10.5555/1248547.1248548 · Cited by 12,051
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Experiencing SAX: A novel symbolic representation of time series
Lin, J., Keogh, E., Wei, L., & Lonardi, S. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-007-0064-z · Cited by 1,618
Self-citationQuerying and mining of time series data
Ding, H., Trajcevski, G., Scheuermann, P., Wang, X., & Keogh, E. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1454159.1454226 · Cited by 1,353
Self-citationGarcía, S., & Herrera, F. (2008) · Cited by 1,277
On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration
Keogh, E., & Kasetty, S. (2003) · Data Mining and Knowledge Discovery · doi:10.1023/a:1024988512476 · Cited by 860
Self-citationExperimental comparison of representation methods and distance measures for time series data
Wang, X., Mueen, A., Ding, H., Trajcevski, G., Scheuermann, P., & Keogh, E. (2012) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-012-0250-5 · Cited by 846
Self-citationOn The Marriage of Lp-norms and Edit Distance
Chen, L., & Ng, R. T. (2004) · Elsevier eBooks · doi:10.1016/b978-012088469-8.50070-x · Cited by 792
Algorithms for the Longest Common Subsequence Problem
Hirschberg, D. S. (1977) · Journal of the ACM · doi:10.1145/322033.322044 · Cited by 752
Cited by
Sorted by citations
Items 501–600 of 1,000
Convolutional Neural Networks for Time-dependent Classification of Variable-length Time Series
Sawada, A., Miyagawa, T., Ebihara, A. F., Yachida, S., & Hosoi, T. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892605 · Cited by 15
Yu, Y., Becker, T., Trinh, L. M., & Behrisch, M. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.03.002 · Cited by 12
Wu, S., Liang, M., Wang, X., & Chen, Q. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119942 · Cited by 12
Montori, F., Liao, K., Giosa, M. D., Jayaraman, P. P., Bononi, L., Sellis, T., & Georgakopoulos, D. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3263213 · Cited by 12
Lim, H. G., Sung, Y., Jeong, H. Y., Kim, J. K., Joo, I., & Won, J. (2023) · Minerals Engineering · doi:10.1016/j.mineng.2023.108261 · Cited by 12
Chen, B., Li, Q., Ma, R., Qian, X., Wang, X., & Li, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112057 · Cited by 12
Capinha, C. (2019) · International Journal of Biometeorology · doi:10.1007/s00484-019-01714-0 · Cited by 12
A Deep Learning Approach for Fusing Sensor Data from Screw Compressors
Alonso, S., Pérez, D., Morán, A., Fuertes, J. J., Díaz, I., & Domínguez, M. (2019) · Sensors · doi:10.3390/s19132868 · Cited by 12
Context-Aware Winter Sports Based on Multivariate Sequence Learning
Han, B.-K., Ryu, J.-K., & Kim, S.-C. (2019) · Sensors · doi:10.3390/s19153296 · Cited by 12
Using DenseNet for IoT multivariate time series classification
Azar, J., Makhoul, A., & Couturier, R. (2020) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc50000.2020.9219631 · Cited by 13
Ship Target Identification via Bayesian-Transformer Neural Network
Kong, Z., Cui, Y., Xiong, W., Yang, F., Xiong, Z., & Xu, P. (2022) · Journal of Marine Science and Engineering · doi:10.3390/jmse10050577 · Cited by 12
Masutani, B., & Morishita, S. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty663 · Cited by 12
Kummerow, A., Monsalve, C., Brosinsky, C., Nicolai, S., & Westermann, D. (2020) · Applied Sciences · doi:10.3390/app10155209 · Cited by 14
Neural CDEs for Long Time Series via the Log-ODE MethodPreprint
Morrill, J., Kidger, P., Salvi, C., Foster, J., & Lyons, T. (2021) · arXiv (Cornell University) · Cited by 12
Use Short Isometric Shapelets to Accelerate Binary Time Series ClassificationPreprint
Shu, W., Yao, Y., Lyu, S., Li, J., & Chen, H. (2019) · arXiv (Cornell University) · doi:10.1007/s10115-021-01583-3 · Cited by 12
A Spectral Enabled GAN for Time Series Data GenerationPreprint
Smith, K. E., & Smith, A. O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01904 · Cited by 13
Air quality visualization analysis based on multivariate time series data feature extraction
Luo, X., Jiang, R., Yang, B., Qin, H., & Hu, H. (2024) · Journal of Visualization · doi:10.1007/s12650-024-00981-3 · Cited by 11
A Multimodal Robust Recognition Method for Grasping Objects With Robot Flexible Grippers
Liang, Q., Xiao, W., Long, J., & Zhang, D. (2024) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2024.3419420 · Cited by 11
Bao, X., Zheng, Y., Chen, L., Wu, D., Chen, X., & Liu, Y. (2024) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2024.08.005 · Cited by 11
Qiu, H., Qia, Z., Wang, R., Liu, X., Cheng, X., & Wu, L. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125755 · Cited by 11
Combining Multi-Objective Bayesian Optimization with Reinforcement Learning for TinyML
Deutel, M., Kontes, G. D., Mutschler, C., & Teich, J. (2025) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3715012 · Cited by 11
Dan, J., Feng, W., Huang, X., & Wang, Y. (2020) · Structural Health Monitoring · doi:10.1177/1475921720948206 · Cited by 11
Enriching feature engineering for short text samples by language time series analysis
Tang, Y., Blincoe, K., & Kempa-Liehr, A. W. (2020) · EPJ Data Science · doi:10.1140/epjds/s13688-020-00244-9 · Cited by 11
Adversarial Regularization for Explainable-by-Design Time Series Classification
Wang, Y., Emonet, R., Fromont, É., Malinowski, S., & Tavenard, R. (2020) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai50040.2020.00165 · Cited by 11
Jacaruso, L. C. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100729 · Cited by 11
Fahle, S., Gläser, T., & Kuhlenkötter, B. (2021) · The minerals, metals & materials series · doi:10.1007/978-3-030-75381-8_48 · Cited by 11
TSLOD: a coupled generalized subsequence local outlier detection model for multivariate time series
Meng, F., Gao, Y., Wang, H., Liu, Y., & Wang, H. (2021) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-021-01462-x · Cited by 11
Spatio-temporal warping for myoelectric control: an offline, feasibility study
Jabbari, M., Khushaba, R. N., & Nazarpour, K. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac387f · Cited by 11
Evaluating time series similarity using concept-based models
Jastrzębska, A., Nápoles, G., Salgueiro, Y., & Vanhoof, K. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107811 · Cited by 11
Diao, T., Kushzad, F., Patel, M. D., Bindiganavale, M. P., Wasi, M., Kochenderfer, M. J., & Moss, H. E. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.771713 · Cited by 12
Bi, Y., Pan, Y., Yu, C., Wang, M., & Cui, T. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105883 · Cited by 11
Car-Following-Response-Based Vehicle Classification via Deep Learning
Li, T., & Stern, R. (2023) · ACM Journal on Autonomous Transportation Systems · doi:10.1145/3603369 · Cited by 11
Mohammadi, Y., Polajžer, B., Leborgne, R. C., & Khodadad, D. (2024) · Sustainable Energy Grids and Networks · doi:10.1016/j.segan.2024.101359 · Cited by 11
Lagged encoding for image‐based time series classification using convolutional neural networks
Jastrzębska, A. (2020) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11455 · Cited by 11
Recognizing diseases with multivariate physiological signals by a DeepCNN-LSTM network
Liao, J., Liu, D., Su, G., & Liu, L. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02309-2 · Cited by 11
Evaluation of Generative Adversarial Networks for Time Series Data
Arnout, H., Bronner, J., & Runkler, T. A. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534373 · Cited by 11
Matrix Profile-Based Interpretable Time Series Classifier
Guidotti, R., & D’Onofrio, M. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.699448 · Cited by 11
Forest based on Interval Transformation (FIT): A time series classifier with adaptive features
Li, G., Xu, S., Wang, S., & Yu, P. S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118923 · Cited by 11
FT-FVC: fast transformation-based feature vector concatenation for time series classification
He, C., Huo, X., & Gao, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-04386-3 · Cited by 11
Efficient Temporal Kernels Between Feature Sets for Time Series Classification
Tavenard, R., Malinowski, S., Chapel, L., Bailly, A., Sanchez, H., & Bustos, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71246-8_32 · Cited by 11
Elderly Fall Risk Prediction with Plantar Center of Force Using ConvLSTM Algorithm
Liang, S., Liu, Y., Li, G., & Zhao, G. (2019) · IEEE International Conference on Cyborg and Bionic Systems (CBS) · doi:10.1109/cbs46900.2019.9114487 · Cited by 11
Bloomfield, R. A., Teeter, M. G., & McIsaac, K. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3011417 · Cited by 11
A Behavioral Pattern Mining Approach to Model Player Skills in Rocket League
Mathonat, R., Boulicaut, J., & Kaytoue, M. (2020) · IEEE Conference on Games (CoG) · doi:10.1109/cog47356.2020.9231739 · Cited by 11
Comparison of Machine Learning Methods to Detect Anomalies in the Activity of Dairy Cows
Wagner, N., Antoine, V., Koko, J., Mialon, M., Lardy, R., & Veissier, I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59491-6_32 · Cited by 11
Time Series Regression in Professional Road Cycling
de Leeuw, A., Heijboer, M., Hofmijster, M. J., van der Zwaard, S., & Knobbe, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61527-7_45 · Cited by 11
Meta-Feature Fusion for Few-Shot Time Series Classification
Park, S.-H., Syazwany, N. S., & Lee, S. (2023) · IEEE Access · doi:10.1109/access.2023.3270493 · Cited by 10
Automatic Feature Engineering for Time Series Classification: Evaluation and Discussion
Renault, A., Bondu, A., Lemaire, V., & Gay, D. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191074 · Cited by 11
Kovács, K. D., Béres, B., Kanyó, N., Szabó, B., Péter, B., Bősze, S. E., Székács, I., & Horváth, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-61257-2 · Cited by 10
Ghorrati, Z., Esmaeili, A., & Matson, T. E. (2024) · IEEE Access · doi:10.1109/access.2024.3462515 · Cited by 10
TGNet: Intelligent Identification of Thunderstorm Wind Gusts Using Multimodal Fusion
Zhang, X., Zheng, Y., Zhang, H., Sheng, J., Lu, B., & Feng, S. (2024) · Advances in Atmospheric Sciences · doi:10.1007/s00376-024-3308-6 · Cited by 10
Vanpoucke, K., Heremans, S., Buls, E., & Somers, B. (2024) · Remote Sensing · doi:10.3390/rs16244620 · Cited by 11
Goldmann, S. H., Machado, M., & Osterrieder, J. R. (2025) · Data & Knowledge Engineering · doi:10.1016/j.datak.2025.102490 · Cited by 10
Knowledge Aware State-Space Capsule Network for Multivariate Time Series Classification
Xiao, Z., Wan, Q., Ding, W., Song, F., & Tong, H. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3692700 · Cited by 10
An Artificial Intelligence Approach for Time Series Next Generation Applications
Dridi, A., Khedher, H. I., Moungla, H., & Afifi, H. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148931 · Cited by 10
Fang, C., Wang, D., Song, D., & Zou, J. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340973 · Cited by 10
MultiETSC: automated machine learning for early time series classification
Ottervanger, G. B., Baratchi, M., & Hoos, H. H. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00781-5 · Cited by 10
Fang, C., Wang, D., Song, D., & Zou, J. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9562081 · Cited by 10
Fang, C., Wang, D., Song, D., & Zou, J. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811902 · Cited by 10
Elastic distances for time-series classification: Itakura versus Sakoe-Chiba constraints
Geler, Z., Kurbalija, V., Ivanović, M. D., & Radovanović, M. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01725-1 · Cited by 10
IoT for measuring road network quality index
Raslan, E., Alrahmawy, M. F., Mohammed, Y. A., & Tolba, A. S. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07736-x · Cited by 11
Application of Wavelet Transform for Machine Learning Classification of Time Series
Kirichenko, L., Пичугина, О. С., Радівілова, Т., & Pavlenko, K. (2022) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-16203-9_31 · Cited by 10
Deep Semi-supervised Learning for Time-Series Classification
Goschenhofer, J. (2022) · Advances in intelligent systems and computing · doi:10.1007/978-981-19-6153-3_15 · Cited by 10
Shapelet-based Temporal Association Rule Mining for Multivariate Time Series Classification
Bahri, O., Li, P., Boubrahimi, S. F., & Hamdi, S. M. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020478 · Cited by 10
New Directions in the Applications of Rough Path Theory
Fermanian, A., Lyons, T., Morrill, J., & Salvi, C. (2023) · IEEE BITS the Information Theory Magazine · doi:10.1109/mbits.2023.3243885 · Cited by 11
An Examination of Wearable Sensors and Video Data Capture for Human Exercise Classification
Singh, A., Bevilacqua, A., Aderinola, T. B., Nguyen, T. L., Whelan, D. F., O’Reilly, M., Caulfield, B., & Ifrim, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43427-3_19 · Cited by 10
Pedestrian Dead Reckoning Based on Complex Motion Mode Recognition Using Hierarchical Classification
Niu, Z., Li, C., Qin, H., & Cao, S. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3347228 · Cited by 10
Hashida, S., & Tamura, K. (2019) · IEEE International Workshop on Computational Intelligence and Applications (IWCIA) · doi:10.1109/iwcia47330.2019.8955030 · Cited by 10
A Wasserstein Subsequence Kernel for Time Series
Bock, C., Togninalli, M., Ghisu, E., Gumbsch, T., Rieck, B., & Borgwardt, K. M. (2019) · Proceedings · doi:10.1109/icdm.2019.00108 · Cited by 10
Efficient Shapelet Discovery for Time Series Classification (Extended Abstract)
Li, G., Choi, B. K. K., Xu, J., Bhowmick, S. S., Chun, K.-P., & Wong, G. L. H. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00254 · Cited by 10
Prototypical Inception Network with Cross Branch Attention for Time Series Classification
Sun, J., Takeuchi, S., & Yamasaki, I. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533440 · Cited by 10
Dharmadhikari, S., Bhattacharya, C., Ray, A., & Basak, A. (2021) · Machines · doi:10.3390/machines9100211 · Cited by 10
Multiclass Sparse Centroids With Application to Fast Time Series Classification
Bradde, T., Fracastoro, G., & Calafiore, G. C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3124300 · Cited by 10
Less is more: Selecting the right benchmarking set of data for time series classification
Eftimov, T., Petelin, G., Cenikj, G., Kostovska, A., Ispirova, G., Korošec, P., & Bogatinovski, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116871 · Cited by 10
Ultra fast warping window optimization for Dynamic Time Warping
Tan, C. W., Herrmann, M., & Webb, G. I. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00070 · Cited by 10
MTMI-DCNN: A PSR-Based Method for Time Series Sensor Data Classification
Liu, R., Wang, F., Tian, F., Qian, J., Chen, X., Cui, S., & Lin, Y. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3149948 · Cited by 10
Spikebench: An open benchmark for spike train time-series classification
Lazarevich, I. A., Prokin, I., Gutkin, B. S., & Kazantsev, V. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010792 · Cited by 10
Distributed Technical Object Model Synthesis Based on Monitoring Data
Tianxing, M., Osipov, V. Y., Vodyaho, A. I., Lebedev, S. V., & Zhukova, N. A. (2019) · International Journal of Knowledge and Systems Science · doi:10.4018/ijkss.2019070103 · Cited by 10
Guillemé, M., Malinowski, S., Tavenard, R., & Renard, X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-39098-3_7 · Cited by 10
Matrix Profile XVI: Efficient and Effective Labeling of Massive Time Series Archives
Madrid, F., Singh, S., Chesnais, Q., Mauck, K. E., & Keogh, E. (2019) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2019.00061 · Cited by 10
Self-citationSemi-supervised time series classification method for quantum computing
Yarkoni, S., Kleshchonok, A., Dzerin, Y., Neukart, F., & Hilbert, M. (2021) · Quantum Machine Intelligence · doi:10.1007/s42484-021-00042-0 · Cited by 10
ELIS++: a shapelet learning approach for accurate and efficient time series classification
Zhang, H., Wang, P., Fang, Z., Wang, Z., & Wang, W. (2021) · World Wide Web · doi:10.1007/s11280-020-00856-1 · Cited by 10
Wu, H., Zhao, Y.-P., & Tan, H. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104258 · Cited by 10
Singh, A., Le, B. T., Nguyen, T. L., Whelan, D. F., O’Reilly, M., Caulfield, B., & Ifrim, G. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-93080-6_14 · Cited by 10
A Fuzzy-Probabilistic Representation Learning Method for Time Series Classification
Erazo-Costa, F. J., Silva, P. C. D. L. E., & Guimarães, F. G. (2024) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2024.3364585 · Cited by 10
Fast estimation of lithium-ion battery state of health using time series classification
Petrella, A., Marzolla, M., & Mercuri, F. (2025) · Journal of Energy Storage · doi:10.1016/j.est.2025.118747 · Cited by 9
Fault Identification in Hydraulic Rock Drills from Indirect Measurement During Operation
Jakobsson, E., Frisk, E., Krysander, M., & Pettersson, R. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.10.053 · Cited by 9
Towards an Awareness of Time Series Anomaly Detection Models' Adversarial Vulnerability
Tariq, S., Le, B. M., & Woo, S. S. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557073 · Cited by 9
Meißner, P., Hoppe, T., & Vietor, T. (2022) · Applied Sciences · doi:10.3390/app122412793 · Cited by 9
Long-Short-Term Memory Based on Adaptive Convolutional Network for Time Series Classification
Li, Y., & Wu, Y. (2023) · Neural Processing Letters · doi:10.1007/s11063-023-11148-w · Cited by 9
Dissimilarity-Preserving Representation Learning for One-Class Time Series Classification
Mauceri, S., Sweeney, J. S., Nicolau, M., & McDermott, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3273503 · Cited by 9
Data-oriented ensemble predictor based on time series classifiers for fraud detection
Bastos, L., Pfeiff, G., de Oliveira, R., Oliveira, H. M. N. D. S., Tostes, M. E. D. L., Zeadally, S., Cerqueira, E., & Rosário, D. (2023) · Electric Power Systems Research · doi:10.1016/j.epsr.2023.109547 · Cited by 9
Data-driven modeling of noise time series with convolutional generative adversarial networks ∗
Wunderlich, A., & Sklar, J. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/acee44 · Cited by 9
Scalable and accurate subsequence transform for time series classification
Mbouopda, M. F., & Nguifo, E. M. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110121 · Cited by 9
FedST: secure federated shapelet transformation for time series classification
Liang, Z., & Wang, H. (2024) · The VLDB Journal · doi:10.1007/s00778-024-00865-w · Cited by 10
Neural-symbolic temporal decision trees for multivariate time series classification
Pagliarini, G., Scaboro, S., Serra, G., Sciavicco, G., & Stan, I. E. (2024) · Information and Computation · doi:10.1016/j.ic.2024.105209 · Cited by 9
Sim, S., & Kim, C. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj15090400 · Cited by 9
Uncertainty-Aware Self-Attention Model for Time Series Prediction with Missing Values
Li, J., Wang, C., Su, W., Ye, D., & Wang, Z. (2025) · Fractal and Fractional · doi:10.3390/fractalfract9030181 · Cited by 9
Finding discriminative and interpretable patterns in sequences of surgical activities
Forestier, G., Petitjean, F., Senin, P., Riffaud, L., Hénaux, P.-L., & Jannin, P. (2017) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2017.09.002 · Cited by 9
The influence of the Sakoe–Chiba band size on time series classification
Górecki, T., & Łuczak, M. (2019) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-18839 · Cited by 9
Fast Exact Dynamic Time Warping on Run-Length Encoded Time Series
Froese, V., Jain, B. J., Rymar, M., & Weller, M. (2022) · Algorithmica · doi:10.1007/s00453-022-01038-3 · Cited by 9
Metadata
- Authors
- Bagnall, A., Lines, J., Bostrom, A., Large, J., & Keogh, E.
- Affiliations
- University of East Anglia (GB)
- University of California, Riverside (US)
- Corresponding author
- Bagnall, Anthony
- Venue
- Data Mining and Knowledge Discovery
- Published
- 2016-11-23
- Volume
- 31
- Issue
- 3
- Pages
- 606-660
- ISSN
- 1384-5810 (ISSN-L)
- 1573-756X
- PMC
- PMC6404674
- OpenAlex
- W2555077524
- Cited by
- 1,377
- References
- 48
- Citations by year
- 2026: 90 · 2025: 133 · 2024: 166 · 2023: 185 · 2022: 187 · 2021: 195 · 2020: 199 · 2019: 130 · 2018: 69 · 2017: 21 · 2016: 1
- FWCI
- 81.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Data Mining and Knowledge Discovery (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion, cc-by)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Funders
- Engineering and Physical Sciences Research Council (EP/M015087/1)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- time series classification, benchmark dataset, algorithm comparison, classification accuracy, reproducibility, Java implementation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
