The DOI matches its Crossref record; 273 of the 273 references it cites were found in a registry or an index.
Deep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Open accessAbstract
Time Series Classification and Extrinsic Regression are important and challenging machine learning tasks. Deep learning has revolutionized natural language processing and computer vision and holds great promise in other fields such as time series analysis where the relevant features must often be abstracted from the raw data but are not known a priori. This article surveys the current state of the art in the fast-moving field of deep learning for time series classification and extrinsic regression. We review different network architectures and training methods used for these tasks and discuss the challenges and opportunities when applying deep learning to time series data. We also summarize two critical applications of time series classification and extrinsic regression, human activity recognition and satellite earth observation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Google Earth Engine: Planetary-scale geospatial analysis for everyone
Gorelick, N., Hancher, M., Dixon, M., Ilyushchenko, S., Thau, D., & Moore, R. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.06.031 · Cited by 14,719
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17325 · Cited by 7,752
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Gaussian Processes in Machine Learning
Rasmussen, C. E. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28650-9_4 · Cited by 5,397
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Deep learning for time series classification: a review
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00619-1 · Cited by 3,342
Self-citationRecurrence Plots of Dynamical Systems
Eckmann, J.-P., Kamphorst, S. O., & Ruelle, D. (1987) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/4/9/004 · Cited by 3,284
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 3×
“In addition to the subsequence-based methods, other models employ instance-based sampling [21, 143, 147–150], treating each sample individually to generate positive and negative”
BackgroundMethodA Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662
Scalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648 · cited 1×
“There are many applications that require time series analysis such as human activity recognition [3–5], diagnosis based on electronic health records [6, 7], and systems monitoring problems [8].”
BackgroundDeep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Time series classification from scratch with deep neural networks: A strong baseline
Wang, Z., Yan, W., & Oates, T. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966039 · Cited by 2,299
Scalable and accurate deep learning with electronic health records.
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · eScholarship (California Digital Library) · Cited by 2,242
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 3×
“Devices used to collect HAR data can be categorized as visual or sensor based [4, 5].”
BackgroundMethodExact indexing of dynamic time warping
Keogh, E., & Ratanamahatana, C. A. (2005) · Knowledge and Information Systems · doi:10.1007/s10115-004-0154-9 · Cited by 1,962
Inceptiontime: finding alexnet for time series classification
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D. F., Weber, J., Webb, G. I., Idoumghar, L., Muller, P.-A., & Petitjean, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00710-y · Cited by 1,788
Self-citationDeep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data
Kussul, N., Lavreniuk, M., Skakun, S., & Shelestov, A. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2681128 · Cited by 1,786
CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes
Li, Y., Zhang, X., & Chen, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00120 · Cited by 1,698
Deep learning in environmental remote sensing: Achievements and challenges
Yuan, Q., Shen, H., Li, T., Li, Z., Li, S., Jiang, Y., Xu, H., Tan, W., Yang, Q., Wang, J., et al. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111716 · Cited by 1,697
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
LSTM Fully Convolutional Networks for Time Series Classification
Karim, F., Majumdar, S., Darabi, H., & Chen, S. (2018) · IEEE Access · doi:10.1109/access.2017.2779939 · Cited by 1,465
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 1×
“Inertial measurement units (IMUs) are wearable devices that combine all three sensors in one unit [149, 150].”
BackgroundBagnall, A., Lines, J., Bostrom, A., Large, J., & Keogh, E. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-016-0483-9 · Cited by 1,377
Activity Recognition in the Home Using Simple and Ubiquitous Sensors
Tapia, E. M., Intille, S. S., & Larson, K. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_10 · Cited by 1,323
A Transformer-based Framework for Multivariate Time Series Representation Learning
Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., & Eickhoff, C. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467401 · Cited by 1,278
Transformers in Time Series: A Survey
Wen, Q., Zhou, T., Zhang, C., Chen, W., Ma, Z., Yan, J., & Sun, L. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/759 · Cited by 1,260
A review of unsupervised feature learning and deep learning for time-series modeling
Längkvist, M., Karlsson, L., & Loutfi, A. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.01.008 · Cited by 1,243
Optical remotely sensed time series data for land cover classification: A review
Gómez, C., White, J. C., & Wulder, M. A. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.03.008 · Cited by 1,217
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Multivariate LSTM-FCNs for time series classification
Karim, F., Majumdar, S., Darabi, H., & Harford, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.014 · Cited by 1,138
Dau, H. A., Bagnall, A., Kamgar, K., Yeh, C.-C. M., Zhu, Y., Gharghabi, S., Ratanamahatana, C. A., & Keogh, E. (2019) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2019.1911747 · Cited by 1,128
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y.-X., & Yan, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00235 · Cited by 1,053
Esling, P., & Agon, C. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379788 · Cited by 997
Dempster, A., Petitjean, F., & Webb, G. I. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00701-z · Cited by 982
Self-citationNweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
10 CHALLENGING PROBLEMS IN DATA MINING RESEARCH
YANG, Q., & WU, X. (2006) · International Journal of Information Technology & Decision Making · doi:10.1142/s0219622006002258 · Cited by 930
Convolutional neural networks for time series classification
College of Electronic Science and Engineering, N. U. O. D. T., Zhao, B., Lu, H., College of Electronic Science and Engineering, N. U. O. D. T., Chen, S., College of Electronic Science and Engineering, N. U. O. D. T., Liu, J., College of Electronic Science and Engineering, N. U. O. D. T., Wu, D., & College of Electronic Science and Engineering, N. U. O. D. T. (2017) · Journal of Systems Engineering and Electronics · doi:10.21629/jsee.2017.01.18 · Cited by 881
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876
TS2Vec: Towards Universal Representation of Time Series
Yue, Z., Wang, Y., Duan, J., Yang, T., Huang, C., Tong, Y., & Xu, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20881 · Cited by 850
Real-time human activity recognition from accelerometer data using Convolutional Neural Networks
Ignatov, A. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2017.09.027 · Cited by 814
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Human Action Recognition and Prediction: A Survey
Kong, Y., & Fu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01594-9 · Cited by 780
Um, T. T., Pfister, F. M. J., Pichler, D., Endo, S., Lang, M., Hirche, S., Fietzek, U., & Kulić, D. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136817 · Cited by 729
An empirical survey of data augmentation for time series classification with neural networks
Iwana, B. K., & Uchida, S. (2021) · PLOS ONE · doi:10.1371/journal.pone.0254841 · Cited by 725
Time-Series Representation Learning via Temporal and Contextual Contrasting
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C. K., Li, X., & Guan, C. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/324 · Cited by 696 · cited 2×
“The model’s accuracy was also improved by pre-training the parameters on massive unlabeled data.”
BackgroundDeep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690 · cited 5×
“Chen et al. [5] discuss challenges in HAR and the appropriate deep learning methods for addressing each challenge.”
BackgroundMethodInfluentialHuman Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
Jiang, W., & Yin, Z. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806333 · Cited by 676
Domain adaptation for the classification of remote sensing data: An overview of recent advances
Tuia, D., Persello, C., & Bruzzone, L. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2548504 · Cited by 675
Himeur, Y., Ghanem, K., Alsalemi, A., Bensaali, F., & Amira, A. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116601 · Cited by 660
Effective Approaches to Attention-based Neural Machine Translation
Luong, M.-T., Pham, H., & Manning, C. D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.04025 · Cited by 655
Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks
Zheng, Y., Liu, Q., Chen, E., Ge, Y., & Zhao, J. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-08010-9_33 · Cited by 652
A time series forest for classification and feature extraction
Deng, H., Runger, G., Tuv, E., & Vladimir, M. (2013) · Information Sciences · doi:10.1016/j.ins.2013.02.030 · Cited by 635
(2014) · International Conference on Learning Representations · Cited by 634
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Um, T. T. (n.d.) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 602
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596 · cited 1×
“However, activities for more specialised events such as gait freezing in Parkinson’s Disease patients [308], falls [309], and manufacturing activities [310] are also collected.”
BackgroundUnderstanding the exploding gradient problemPreprint
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv (Cornell University) · Cited by 575
Jin, M., Koh, H. Y., Wen, Q., Zambon, D., Alippi, C., Webb, G. I., King, I., & Pan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3443141 · Cited by 567
Self-citationThe BOSS is concerned with time series classification in the presence of noise
Schäfer, P. (2015) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-014-0377-7 · Cited by 560
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
Classification of time series by shapelet transformation
Hills, J., Lines, J., Baranauskas, E., Mapp, J., & Bagnall, A. (2014) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-013-0322-1 · Cited by 538
Deep Recurrent Neural Networks for Human Activity Recognition
Murad, A., & Pyun, J.-Y. (2017) · Sensors · doi:10.3390/s17112556 · Cited by 524
Time series classification with ensembles of elastic distance measures
Lines, J., & Bagnall, A. (2015) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-014-0361-2 · Cited by 522
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511
GeoMAN: Multi-level Attention Networks for Geo-sensory Time Series Prediction
Liang, Y., Ke, S., Zhang, J., Yi, X., & Zheng, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/476 · Cited by 510
A Comprehensive Survey of Vision-Based Human Action Recognition Methods
Zhang, H.-B., Zhang, Y.-X., Zhong, B., Lei, Q., Yang, L., Du, J.-X., & Chen, D.-S. (2019) · Sensors · doi:10.3390/s19051005 · Cited by 503 · cited 1×
“For reviews of vision-based HAR, refer to Kong and Fu [190] or Zhang et al. [191].”
MethodMiniRocket: A Very Fast (Almost) Deterministic Transform for Time Series Classification
Dempster, A., Schmidt, D. F., & Webb, G. I. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467231 · Cited by 490
Self-citationTraining and Analysing Deep Recurrent Neural Networks
Hermans, M., & Schrauwen, B. (2013) · neural information processing systems · Cited by 488
Ruiz, A. P., Flynn, M., Large, J., Middlehurst, M., & Bagnall, A. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00727-3 · Cited by 476
Computational bioacoustics with deep learning: a review and roadmap
Stowell, D. (2022) · PeerJ · doi:10.7717/peerj.13152 · Cited by 471
Attend and Diagnose: Clinical Time Series Analysis Using Attention Models
Song, H., Rajan, D., Thiagarajan, J., & Spanias, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11635 · Cited by 468
Transfer learning for short-term wind speed prediction with deep neural networks
Hu, Q., Zhang, R., & Zhou, Y. (2016) · Renewable Energy · doi:10.1016/j.renene.2015.06.034 · Cited by 464
Multi-Scale Convolutional Neural Networks for Time Series Classification
Cui, Z., Chen, W., & Chen, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06995 · Cited by 455
Ramanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455
A CNN-LSTM Approach to Human Activity Recognition
Mutegeki, R., & Han, D. S. (2020) · 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic48513.2020.9065078 · Cited by 452
Deep learning in ECG diagnosis: A review
Liu, X., Wang, H., Li, Z., & Qin, L. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107187 · Cited by 436
Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles
Bagnall, A., Lines, J., Hills, J., & Bostrom, A. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2416723 · Cited by 416
3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images
Ji, S., Zhang, C., Xu, A., Shi, Y., & Duan, Y. (2018) · Remote Sensing · doi:10.3390/rs10010075 · Cited by 395
Multireceptive Field Graph Convolutional Networks for Machine Fault Diagnosis
Li, T., Zhao, Z., Sun, C., Yan, R., & Chen, X. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.3040669 · Cited by 386
E. D. Chaves, M., C. A. Picoli, M., & D. Sanches, I. (2020) · Remote Sensing · doi:10.3390/rs12183062 · Cited by 376
A Bag-of-Features Framework to Classify Time Series
Baydogan, M. G., Runger, G., & Tuv, E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.72 · Cited by 361
Self-attention for raw optical Satellite Time Series Classification
Rußwurm, M., & Körner, M. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.006 · Cited by 355
TapNet: Multivariate Time Series Classification with Attentional Prototypical Network
Zhang, X., Gao, Y., Lin, J., & Lu, C.-T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6165 · Cited by 352
Recurrent neural networks for time series classification
Hüsken, M., & Stagge, P. (2003) · Neurocomputing · doi:10.1016/s0925-2312(01)00706-8 · Cited by 352
The Australian Geoscience Data Cube — Foundations and lessons learned
Lewis, A., Oliver, S., Lymburner, L., Evans, B., Wyborn, L., Mueller, N., Raevksi, G., Hooke, J., Woodcock, R., Sixsmith, J., et al. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.03.015 · Cited by 351
Using dynamic time warping distances as features for improved time series classification
Kate, R. J. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-015-0418-x · Cited by 348
A multibranch CNN-BiLSTM model for human activity recognition using wearable sensor data
Challa, S. K., Kumar, A., & Semwal, V. B. (2022) · The Visual Computer · doi:10.1007/s00371-021-02283-3 · Cited by 338
Human activity recognition in artificial intelligence framework: a narrative review
Gupta, N., Gupta, S. K., Pathak, R. K., Jain, V., Rashidi, P., & Suri, J. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10116-x · Cited by 337
Generative Adversarial Networks in Time Series: A Systematic Literature Review
Brophy, E., Wang, Z., She, Q., & Ward, T. (2023) · ACM Computing Surveys · doi:10.1145/3559540 · Cited by 337
LSTM Networks Using Smartphone Data for Sensor-Based Human Activity Recognition in Smart Homes
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Sensors · doi:10.3390/s21051636 · Cited by 335
Lines, J., Taylor, S., & Bagnall, A. (2018) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3182382 · Cited by 333
InnoHAR: A Deep Neural Network for Complex Human Activity Recognition
Xu, C., Chai, D., He, J., Zhang, X., & Duan, S. (2019) · IEEE Access · doi:10.1109/access.2018.2890675 · Cited by 333
Ienco, D., Interdonato, R., Gaetano, R., & Ho Tong Minh, D. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.09.016 · Cited by 333
Human activity recognition from accelerometer data using Convolutional Neural Network
Lee, S.-M., Yoon, S. M., & Cho, H. (2017) · 2017 IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp.2017.7881728 · Cited by 331
Hierarchical Recurrent Neural Networks for Long-Term Dependencies
Hihi, S. E., & Bengio, Y. (1995) · Cited by 325
Generalized Denoising Auto-Encoders as Generative Models
Bengio, Y., Yao, L., Alain, G., & Vincent, P. (2013) · arXiv · doi:10.48550/arxiv.1305.6663 · Cited by 324
HIVE-COTE 2.0: a new meta ensemble for time series classification
Middlehurst, M., Large, J., Flynn, M., Lines, J., Bostrom, A., & Bagnall, A. (2021) · Machine Learning · doi:10.1007/s10994-021-06057-9 · Cited by 321
Transfer learning for time series classification
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2018) · 2018 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2018.8621990 · Cited by 319
Self-citationDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314 · cited 5×
“Chen et al. [5] discuss challenges in HAR and the appropriate deep learning methods for addressing each challenge.”
BackgroundMethodInfluentialTime Series Classification With Multivariate Convolutional Neural Network
Liu, C.-L., Hsaio, W.-H., & Tu, Y.-C. (2019) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2018.2864702 · Cited by 310
Unsupervised Scalable Representation Learning for Multivariate Time Series
Franceschi, J.-Y., Dieuleveut, A., & Jaggi, M. (2019) · arXiv · doi:10.48550/arxiv.1901.10738 · Cited by 305
Multi-Temporal Land Cover Classification with Sequential Recurrent Encoders
Rußwurm, M., & Körner, M. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7040129 · Cited by 286
Land Cover Classification via Multitemporal Spatial Data by Deep Recurrent Neural Networks
Ienco, D., Gaetano, R., Dupaquier, C., & Maurel, P. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2728698 · Cited by 284
Kostas, D., Aroca-Ouellette, S., & Rudzicz, F. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.653659 · Cited by 272
A Survey on Deep Learning for Human Activity Recognition
Gu, F., Chung, M.-H., Chignell, M., Valaee, S., Zhou, B., & Liu, X. (2022) · ACM Computing Surveys · doi:10.1145/3472290 · Cited by 272
AttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition
Ma, H., Li, W., Zhang, X., Gao, S., & Lu, S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/431 · Cited by 266
Near Real-Time Wildfire Progression Monitoring with Sentinel-1 SAR Time Series and Deep Learning
Ban, Y., Zhang, P., Nascetti, A., Bevington, A. R., & Wulder, M. A. (2020) · Scientific Reports · doi:10.1038/s41598-019-56967-x · Cited by 264
Xu, J., Zhu, Y., Zhong, R., Lin, Z., Xu, J., Jiang, H., Huang, J., Li, H., & Lin, T. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111946 · Cited by 264
Multi-Temporal Land Cover Classification with Sequential Recurrent Encoders
Rußwurm, M. (2018) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 261
Tan, C. W., Dempster, A., Bergmeir, C., & Webb, G. I. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00844-1 · Cited by 243
Self-citationMulti-scale Attention Convolutional Neural Network for time series classification
Chen, W., & Shi, K. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.01.001 · Cited by 242
Gated Transformer Networks for Multivariate Time Series ClassificationPreprint
Liu, M., Ren, S., Ma, S., Jiao, J., Chen, Y., Wang, Z., & Song, W. G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14438 · Cited by 237
Improving position encoding of transformers for multivariate time series classification
Foumani, N. M., Tan, C. W., Webb, G. I., & Salehi, M. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00948-2 · Cited by 236
Self-citationGraphSleepNet: Adaptive Spatial-Temporal Graph Convolutional Networks for Sleep Stage Classification
Jia, Z., Lin, Y., Wang, J., Zhou, R., Ning, X., He, Y., & Zhao, Y. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/184 · Cited by 231
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Electronics · doi:10.3390/electronics10030308 · Cited by 219
iSPLInception: An Inception-ResNet Deep Learning Architecture for Human Activity Recognition
Ronald, M., Poulose, A., & Han, D. S. (2021) · IEEE Access · doi:10.1109/access.2021.3078184 · Cited by 217
Review of Vibration-Based Structural Health Monitoring Using Deep Learning
Toh, G., & Park, J. (2020) · Applied Sciences · doi:10.3390/app10051680 · Cited by 207
Giuliani, G., Chatenoux, B., De Bono, A., Rodila, D., Richard, J.-P., Allenbach, K., Dao, H., & Peduzzi, P. (2017) · Big Earth Data · doi:10.1080/20964471.2017.1398903 · Cited by 204
Self-Supervised Pretraining of Transformers for Satellite Image Time Series Classification
Yuan, Y., & Lin, L. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3036602 · Cited by 204
Deep learning for air pollutant concentration prediction: A review
Zhang, B., Rong, Y., Yong, R., Qin, D., Li, M., Zou, G., & Pan, J. (2022) · Atmospheric Environment · doi:10.1016/j.atmosenv.2022.119347 · Cited by 203
Deep ConvLSTM With Self-Attention for Human Activity Decoding Using Wearable Sensors
Singh, S. P., Sharma, M. K., Lay-Ekuakille, A., Gangwar, D., & Gupta, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3045135 · Cited by 199
Zhang, H., Xiao, Z., Wang, J., Li, F., & Szczerbicki, E. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2949715 · Cited by 197
Bake off redux: a review and experimental evaluation of recent time series classification algorithms
Middlehurst, M., Schäfer, P., & Bagnall, A. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-024-01022-1 · Cited by 197
Convolutional Neural Networks for Human Activity Recognition Using Body-Worn Sensors
Moya Rueda, F., Grzeszick, R., Fink, G. A., Feldhorst, S., & Ten Hompel, M. (2018) · Informatics · doi:10.3390/informatics5020026 · Cited by 196
TimeNet: Pre-trained deep recurrent neural network for time series classificationPreprint
Malhotra, P., Tv, V., Vig, L., Agarwal, P., & Shroff, G. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.08838 · Cited by 189
Zeng, M., Gao, H., Yu, T., Mengshoel, O. J., Langseth, H., Lane, I., & Liu, X. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267286 · Cited by 185 · cited 1×
“Table 4 shows a list of the self-supervised models reviewed in this article.”
BackgroundRTFN: A robust temporal feature network for time series classification
Xiao, Z., Xu, X., Xing, H., Luo, S., Dai, P., & Zhan, D. (2021) · Information Sciences · doi:10.1016/j.ins.2021.04.053 · Cited by 184
Deep Learning for Time-Series Prediction in IIoT: Progress, Challenges, and Prospects
Ren, L., Jia, Z., Laili, Y., & Huang, D. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3291371 · Cited by 184
Generating Synthetic Time Series to Augment Sparse Datasets
Forestier, G., Petitjean, F., Dau, H. A., Webb, G. I., & Keogh, E. (2017) · 2017 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2017.106 · Cited by 183
Self-citationDuPLO: A DUal view Point deep Learning architecture for time series classificatiOn
Interdonato, R., Ienco, D., Gaetano, R., & Ose, K. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.01.011 · Cited by 180
Stoian, A., Poulain, V., Inglada, J., Poughon, V., & Derksen, D. (2019) · Remote Sensing · doi:10.3390/rs11171986 · Cited by 176
Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA
Hyvärinen, A., & Morioka, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06336 · Cited by 168
Lines, J., Taylor, S., & Bagnall, A. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0133 · Cited by 168
Proximity Forest: an effective and scalable distance-based classifier for time series
Lucas, B., Shifaz, A., Pelletier, C., O’Neill, L., Zaidi, N., Goethals, B., Petitjean, F., & Webb, G. I. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00617-3 · Cited by 164
Self-citationSensor-Based Human Activity Recognition with Spatio-Temporal Deep Learning
Nafea, O., Abdul, W., Muhammad, G., & Alsulaiman, M. (2021) · Sensors · doi:10.3390/s21062141 · Cited by 160
Yang, C.-L., Chen, Z.-X., & Yang, C.-Y. (2019) · Sensors · doi:10.3390/s20010168 · Cited by 159
Multilevel Deep Learning Network for County-Level Corn Yield Estimation in the U.S. Corn Belt
Sun, J., Lai, Z., Di, L., Sun, Z., Tao, J., & Shen, Y. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3019046 · Cited by 159
Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention
Garnot, V. S. F., Landrieu, L., Giordano, S., & Chehata, N. (2020) · HAL · Cited by 158
Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure AnalysisPreprint
Tang, S., Dunnmon, J., Saab, K. K., Zhang, X., Huang, Q., Dubost, F., Rubin, D. L., & Lee‐Messer, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08336 · Cited by 158
Zaini, N., Ean, L. W., Ahmed, A. N., & Malek, M. B. A. (2021) · Environmental Science and Pollution Research · doi:10.1007/s11356-021-17442-1 · Cited by 153
Minh, D. H. T., Ienco, D., Gaetano, R., Lalande, N., Ndikumana, E., Osman, F., & Maurel, P. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2794581 · Cited by 151
SAR-enhanced mapping of live fuel moisture content
Rao, K., Williams, P., Flefil, J. F., & Konings, A. G. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111797 · Cited by 151
Chen, W., & Shi, K. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.032 · Cited by 149
Position-aware activity recognition with wearable devices
Sztyler, T., Stuckenschmidt, H., & Petrich, W. H. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2017.01.008 · Cited by 148
Proximity Forest: an effective and scalable distance-based classifier for time series
Lucas, B., Shifaz, A., Pelletier, C., O’Neill, L., Zaidi, N. A., (15827960), B. G., Petitjean, F., & (14480133), G. W. (2024) · Figshare · Cited by 147
Qiao, M., He, X., Cheng, X., Li, P., Luo, H., Zhang, L., & Tian, Z. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102436 · Cited by 142
Time series extrinsic regression: Predicting numeric values from time series data
Tan, C. W., Bergmeir, C., Petitjean, F., & Webb, G. I. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00745-9 · Cited by 141
Self-citationMekruksavanich, S., & Jitpattanakul, A. (2021) · Electronics · doi:10.3390/electronics10141685 · Cited by 138
Time Series Data Augmentation for Neural Networks by Time Warping with a Discriminative Teacher
Iwana, B. K., & Uchida, S. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412812 · Cited by 137
Lightweight Temporal Self-attention for Classifying Satellite Images Time Series
Garnot, V. S. F., & Landrieu, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65742-0_12 · Cited by 136
Multistage attention network for multivariate time series prediction
Hu, J., & Zheng, W. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.11.060 · Cited by 132
Applications of mobile activity recognition
Lockhart, J. W., Pulickal, T. T., & Weiss, G. M. (2012) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2370216.2370441 · Cited by 128
TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders
Cheng, M., Tao, X., Liu, Z., Liu, Q., Zhang, H., Zhang, R., & Chen, E. (2026) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3773966.3778007 · Cited by 127
Yao, R., Lin, G., Shi, Q., & Ranasinghe, D. C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.024 · Cited by 126
Application of Deep Learning Architectures for Satellite Image Time Series Prediction: A Review
Moskolaï, W. R., Abdou, W., Dipandà, A., & Kolyang (2021) · Remote Sensing · doi:10.3390/rs13234822 · Cited by 124
TimeCLR: A self-supervised contrastive learning framework for univariate time series representation
Yang, X., Zhang, Z., & Cui, R. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108606 · Cited by 114
Mixing up contrastive learning: Self-supervised representation learning for time series
Wickstrøm, K., Kampffmeyer, M., Mikalsen, K. Ø., & Jenssen, R. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.02.007 · Cited by 113
Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer
Zhang, W., Yang, L. Q., Geng, S., & Hong, S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3292066 · Cited by 113
Zou, X., Wang, Z., Li, Q., & Sheng, W. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.08.023 · Cited by 111
Deep Neural Network Ensembles for Time Series Classification
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852316 · Cited by 103
Self-citationImproving Sequence-To-Sequence Speech Recognition Training with On-The-Fly Data Augmentation
Nguyen, T., Stueker, S., Niehues, J., & Waibel, A. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054130 · Cited by 99
FLOOD DETECTION IN TIME SERIES OF OPTICAL AND SAR IMAGES
Rambour, C., Audebert, N., Colin‐Koeniguer, E., Saux, B. L., Crucianu, M., & Datcu, M. (2020) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xliii-b2-2020-1343-2020 · Cited by 97
Crop Type Mapping from Optical and Radar Time Series Using Attention-Based Deep Learning
Ofori-Ampofo, S., Pelletier, C., & Lang, S. (2021) · Remote Sensing · doi:10.3390/rs13224668 · Cited by 97
Hsieh, T.-Y., Wang, S., Sun, Y., & Honavar, V. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441815 · Cited by 96
ConvTimeNet: A Pre-trained Deep Convolutional Neural Network for Time Series Classification
Kashiparekh, K., Narwariya, J., Malhotra, P., Vig, L., & Shroff, G. M. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852105 · Cited by 94
Multivariate time-series classification with hierarchical variational graph pooling
Duan, Z., Xu, H., Wang, Y., Huang, Y., Ren, A., Xu, Z., Sun, Y., & Wang, W. W. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.07.032 · Cited by 94
Graph-Guided Network for Irregularly Sampled Multivariate Time SeriesPreprint
Zhang, X., Zeman, M., Tsiligkaridis, T., & Žitnik, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.05357 · Cited by 94
Azevedo, T., Campbell, A., Romero-García, R., Passamonti, L., Bethlehem, R. A. I., Lió, P., & Toschi, N. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102471 · Cited by 94
Deep Learning Techniques for EEG Signal Applications – A Review
Praveena, D., Sarah, D., & George, S. T. (2020) · IETE Journal of Research · doi:10.1080/03772063.2020.1749143 · Cited by 92
Yuan, Y., Lin, L., Liu, Q., Hang, R., & Zhou, Z.-G. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102651 · Cited by 92
Research works printed but not linked: 38
- Xiao Liu, Fanjin Zhang, Zhenyu Hou, Li Mian, Zhaoyu Wang, Jing Zhang, and Jie Tang. 2021. Self-supervised learning: Generative or contrastive. IEEE Transactions on Knowledge and Data Engineering 35, 1 (2021), 857–876.
- Chao-Han Huck Yang, Yun-Yun Tsai, and Pin-Yu Chen. 2021. Voice2series: Reprogramming acoustic models for time series classification. In International Conference on Machine Learning. PMLR, 11808–11819.
- Joan Serrà, Santiago Pascual, and Alexandros Karatzoglou. 2018. Towards a universal neural network encoder for time series. In CCIA. 120–129.
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
- Zhiguang Wang and Tim Oates. 2015. Encoding time series as images for visual inspection and classification using tiled convolutional neural networks. In Workshops at the 29th AAAI Conference on Artificial Intelligence.
- Nima Hatami, Yann Gavet, and Johan Debayle. 2018. Classification of time-series images using deep convolutional neural networks. In 10th International Conference on Machine Vision (ICMV’17), Vol. 10696. SPIE, 242–249.
- Arthur Le Guennec, Simon Malinowski, and Romain Tavenard. 2016. Data augmentation for time series classification using convolutional neural networks. In ECML/PKDD Workshop on Advanced Analytics and Learning on Temporal Data.
- Don Dennis, Durmus Alp Emre Acar, Vikram Mandikal, Vinu Sankar Sadasivan, Venkatesh Saligrama, Harsha Vardhan Simhadri, and Prateek Jain. 2019. Shallow RNN: Accurate time-series classification on resource constrained devices. Advances in Neural Information Processing Systems 32 (2019), 11 pages.
- Santiago Fernández, Alex Graves, and Jürgen Schmidhuber. 2007. Sequence labelling in structured domains with hierarchical recurrent neural networks. In 20th International Joint Conference on Artificial Intelligence (IJCAI’07).
- Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the difficulty of training recurrent neural networks. In International Conference on Machine Learning. PMLR, 1310–1318.
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017).
- Max Jaderberg, Karen Simonyan, Andrew Zisserman, et al. 2015. Spatial transformer networks. Advances in Neural Information Processing Systems 28 (2015), 2017–2025.
- Tarek Allam Jr. and Jason D. McEwen. 2021. Paying attention to astronomical transients: Photometric classification with the time-series transformer. arXiv preprint:2105.06178 (2021). · arXiv
- Huaiyuan Liu Xianzhang Liu Donghua Yang Zhiyu Liang Hongzhi Wang Yong Cui and Jun Gu. 2023. TodyNet: Temporal dynamic graph neural network for multivariate time series classification. ArXiv abs/2304.05078 (2023). https://api.semanticscholar.org/CorpusID:258059979 · arXiv
- Ian C. Covert, Balu Krishnan, Imad Najm, Jiening Zhan, Matthew Shore, John Hixson, and Ming Jack Po. 2019. Temporal graph convolutional networks for automatic seizure detection. In Machine Learning for Healthcare Conference. PMLR, 160–180.
- Ling Yang and Shenda Hong. 2022. Unsupervised time-series representation learning with iterative bilinear temporal-spectral fusion. In ICML. 25038–25054.
- Sana Tonekaboni Danny Eytan and Anna Goldenberg. 2021. Unsupervised representation learning for time series with temporal neighborhood coding. International Conference on Learning Representations. https://openreview.net/forum?id=8qDwejCuCN
- Xiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, and Marinka Zitnik. 2022. Self-supervised contrastive pre-training for time series via time-frequency consistency. In Proceedings of Neural Information Processing Systems (NeurIPS’22).
- Bhavik Vachhani, Chitralekha Bhat, and Sunil Kumar Kopparapu. 2018. Data augmentation using healthy speech for dysarthric speech recognition. In Interspeech. 471–475.
- Jingkun Gao Xiaomin Song Qingsong Wen Pichao Wang Liang Sun and Huan Xu. 2020. RobustTAD: Robust Time Series Anomaly Detection via Decomposition and Convolutional Neural Networks. arxiv:cs.LG/2002.09545 (2020).
- Zhicheng Cui Wenlin Chen and Yixin Chen. 2016. Multi-Scale Convolutional Neural Networks for Time Series Classification. arxiv:cs.CV/1603.06995 (2016).
- Arthur Le Guennec, Simon Malinowski, and Romain Tavenard. 2016. Data augmentation for time series classification using convolutional neural networks. In ECML/PKDD on Advanced Analytics and Learning on Temporal Data.
- Gautier Pialla, Maxime Devanne, Jonathan Weber, Lhassane Idoumghar, and Germain Forestier. 2022. Data augmentation for time series classification with deep learning models. In International Workshop on Advanced Analytics and Learning on Temporal Data. Springer, 117–132.
- 10.1109/BigData.2018.8621990 · DOI · Paper page
- Stephan Spiegel. 2016. Transfer learning for time series classification in dissimilarity spaces. Proceedings of AALTD 78 (2016).
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
- 10.1016/j.rse.2007.07.004 · doi:10.1016/j.rse.2007.07.004
- 10.1016/B978-0-12-809254-5.00002-6 · doi:10.1016/b978-0-12-809254-5.00002-6
- 10.1109/CVPR42600.2020.01234 · DOI
- 10.3390/rs14174378 · doi:10.3390/rs14174378
- 10.1016/j.infrared.2019.103152 · DOI
- Nicola Di Mauro, Antonio Vergari, Teresa Maria Altomare Basile, Fabrizio G. Ventola, and Floriana Esposito. 2017. End-to-end learning of deep spatio-temporal representations for satellite image time series classification. In DC@PKDD/ECML.
- 10.3390/rs11050523 · DOI
- 10.3390/rs12172814 · DOI
- Yoav Freund and Robert E. Schapire. 1996. Experiments with a new boosting algorithm. In 13th International Conference on Machine Learning.148–156.
- Matthieu Herrmann and Geoffrey I. Webb. 2021. Amercing: An intuitive, elegant and effective constraint for dynamic time warping. arXiv preprint:2111.13314 (2021). · arXiv
- Angus Dempster, Daniel F. Schmidt, and Geoffrey I. Webb. 2023. Hydra: Competing convolutional kernels for fast and accurate time series classification. Data Mining and Knowledge Discovery 37 (2023), 1–27.
- Vinod Nair and Geoffrey E. Hinton. 2010. Rectified linear units improve restricted Boltzmann machines. In ICML.
Cited by
Jin, M., Koh, H. Y., Wen, Q., Zambon, D., Alippi, C., Webb, G. I., King, I., & Pan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3443141 · Cited by 567
Self-citation
Metadata
- Authors
- Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M.
- Venue
- ACM Computing Surveys
- Published
- 2024-04-25
- Volume
- 56
- Issue
- 9
- Pages
- 1-45
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4392199044
- Cited by
- 268
- References
- 273
- FWCI
- 48.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Australian Government Research Training Program
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.