Unsupervised Scalable Representation Learning for Multivariate Time Series
Open accessAbstract
Time series constitute a challenging data type for machine learning algorithms, due to their highly variable lengths and sparse labeling in practice. In this paper, we tackle this challenge by proposing an unsupervised method to learn universal embeddings of time series. Unlike previous works, it is scalable with respect to their length and we demonstrate the quality, transferability and practicability of the learned representations with thorough experiments and comparisons. To this end, we combine an encoder based on causal dilated convolutions with a novel triplet loss employing time-based negative sampling, obtaining general-purpose representations for variable length and multivariate time series.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Image-based contrastive learning methods may not be able to address the temporal dependencies of time-series data.
“First, they may not be able to address the temporal dependencies of data, which are key characteristics of time-series [Franceschi et al. , 2019].”
From Time-Series Representation Learning via Temporal and Contextual Contrasting (2021) · cites this paper as Franceschi et al., 2019
Section 3, p. 3, uses time-based sampling and an unsupervised time-based criterion for learning time-series representations, supporting the importance of temporal information. But neither that section nor the discussion of other domains in Related Work (p. 2) says that image-based contrastive methods may fail to address temporal dependencies. (LLM, conf=0.76)
Experimental — accuracy not yet measuredImage-based contrastive learning methods are not able to work well on time-series data.
“However, these image-based contrastive learning methods are not able to work well on time-series data for the following reasons.”
From Time-Series Representation Learning via Temporal and Contextual Contrasting (2021) · cites this paper as Franceschi et al., 2019
Related Work (p. 2) says triplet losses have seen little use for time series and identifies limitations of certain existing time-series methods. Unsupervised Training (p. 3) explains why the authors adapt a triplet loss to time series, but neither passage assesses whether image-based contrastive learning methods work well on time-series data. Searches for image-based contrastive methods and their suitability for time series found no passage addressing that claim. (LLM, conf=0.70)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267 · see citing works
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · see citing works
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911 · see citing works
Deep learning for time series classification: a review
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00619-1 · Cited by 3,342 · cited 2× · see citing works
“Those results are incomplete as Ismail Fawaz et al. (2019) performed their experiments on the old version of the archive, whereas ours are performed on its most recent release where some datasets were changed.”
BackgroundUnsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861 · see citing works
Bagnall, A., Lines, J., Bostrom, A., Large, J., & Keogh, E. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-016-0483-9 · Cited by 1,377 · see citing works
Decomposing Motion and Content for Natural Video Sequence Prediction
Villegas, R., Yang, J., Hong, S., Lin, X., & Lee, H. (2017) · arXiv · doi:10.48550/arxiv.1706.08033 · Cited by 488 · see citing works
Lines, J., Taylor, S., & Bagnall, A. (2018) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3182382 · Cited by 333 · see citing works
The UEA multivariate time series classification archive, 2018
Bagnall, A., Dau, H. A., Lines, J., Flynn, M., Large, J., Bostrom, A., Southam, P., & Keogh, E. (2018) · arXiv · doi:10.48550/arxiv.1811.00075 · Cited by 87 · cited 5× · see citing works
“However, we provide a comparison with DTWD as baseline using results provided by Bagnall et al. (2018).”
BackgroundMethodInfluential
Flagged first, then by citations
Research works printed but not linked: 33
- Arora, S., Khandeparkar, H., Khodak, M., Plevrakis, O., and Saunshi, N. A theoretical analysis of contrastive unsupervised representation learning. arXiv preprint arXiv:1902.09229 , 2019. · arXiv
- Bai, S., Kolter, J. Z., and Koltun, V . An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271 , 2018. · arXiv
- Bostrom, A. and Bagnall, A. Binary shapelet transform for multiclass time series classification. In Big Data Analytics and Knowledge Discovery , pp. 257-269, Cham, 2015. Springer International Publishing.
- Bredin, H. Tristounet: Triplet loss for speaker turn embedding. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pp. 5430-5434, March 2017.
- Cui, Z., Chen, W., and Chen, Y. Multi-scale convolutional neural networks for time series classification. arXiv preprint arXiv:1603.06995 , 2016. · arXiv
- Demšar, J., Curk, T., Erjavec, A., ˇ Crt Gorup, Hoˇ cevar, T., Milutinoviˇ c, M., Možina, M., Polajnar, M., Toplak, M., Stariˇ c, A., Štajdohar, M., Umek, L., Žagar, L., Žbontar, J., Žitnik, M., and Zupan, B. Orange: Data mining toolbox in Python. Journal of Machine Learning Research , 14:2349-2353, 2013.
- Denton, E. L. and Birodkar, V. Unsupervised learning of disentangled representations from video. In Advances in Neural Information Processing Systems 30 , pp. 4414-4423. Curran Associates, Inc., 2017.
- Dosovitskiy, A., Springenberg, J. T., Riedmiller, M., and Brox, T. Discriminative unsupervised feature learning with convolutional neural networks. In Advances in Neural Information Processing Systems 27 , pp. 766-774. Curran Associates, Inc., 2014.
- Fortuin, V., Hüser, M., Locatello, F., Strathmann, H., and Rätsch, G. SOM-V AE: Interpretable discrete representation learning on time series. In International Conference on Learning Representations , 2019.
- Goldberg, Y. and Levy, O. word2vec explained: deriving Mikolov et al.'s negative-sampling wordembedding method. arXiv preprint arXiv:1402.3722 , 2014. · arXiv
- Goodfellow, I., Bengio, Y., and Courville, A. Deep Learning . MIT Press, 2016. http://www. deeplearningbook.org.
- Hochreiter, S. and Schmidhuber, J. Long short-term memory. Neural computation , 9(8):1735-1780, 1997.
- Hyvarinen, A. and Morioka, H. Unsupervised feature extraction by time-contrastive learning and nonlinear ICA. In Advances in Neural Information Processing Systems 29 , pp. 3765-3773. Curran Associates, Inc., 2016.
- Jansen, A., Plakal, M., Pandya, R., Ellis, D. P. W., Hershey, S., Liu, J., Moore, R. C., and Saurous, R. A. Unsupervised learning of semantic audio representations. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pp. 126-130, April 2018.
- Kingma, D. P. and Ba, J. Adam: A method for stochastic optimization. In International Conference on Learning Representations , 2015.
- Lei, Q., Yi, J., Vaculin, R., Wu, L., and Dhillon, I. S. Similarity preserving representation learning for time series analysis. arXiv preprint arXiv:1702.03584 , 2017. · arXiv
- Liljefors, F., Sorkhei, M. M., and Broome, S. [Re] Unsupervised scalable representation learning for multivariate time series. 2019. URL https://openreview.net/forum?id=HyxQr65z6S.
- Lines, J. and Bagnall, A. Time series classification with ensembles of elastic distance measures. Data Mining and Knowledge Discovery , 29(3):565-592, May 2015.
- Logeswaran, L. and Lee, H. An efficient framework for learning sentence representations. In International Conference on Learning Representations , 2018.
- Lu, R., Wu, K., Duan, Z., and Zhang, C. Deep ranking: Triplet MatchNet for music metric learning. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pp. 121-125, March 2017.
- Maaten, L. v. d. and Hinton, G. Visualizing data using t-SNE. Journal of Machine Learning Research , 9:2579-2605, November 2008.
- Malhotra, P., TV, V., Vig, L., Agarwal, P., and Shroff, G. TimeNet: Pre-trained deep recurrent neural network for time series classification. arXiv preprint arXiv:1706.08838 , 2017. · arXiv
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., and Dean, J. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems 26 , pp. 3111-3119. Curran Associates, Inc., 2013.
- Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research , 12:2825-2830, October 2011.
- Salimans, T. and Kingma, D. P. Weight normalization: A simple reparameterization to accelerate training of deep neural networks. In Advances in Neural Information Processing Systems 29 , pp. 901-909. Curran Associates, Inc., 2016.
- Schäfer, P. The BOSS is concerned with time series classification in the presence of noise. Data Mining and Knowledge Discovery , 29(6):1505-1530, November 2015.
- Turpault, N., Serizel, R., and Vincent, E. Semi-supervised triplet loss based learning of ambient audio embeddings. In 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pp. 760-764, May 2019.
- Wang, Z., Yan, W., and Oates, T. Time series classification from scratch with deep neural networks: A strong baseline. In 2017 International Joint Conference on Neural Networks (IJCNN) , pp. 1578-1585, May 2017.
- Wu, L., Yen, I. E.-H., Yi, J., Xu, F., Lei, Q., and Witbrock, M. Random Warping Series: A random features method for time-series embedding. In Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics , volume 84 of Proceedings of Machine Learning Research , pp. 793-802. PMLR, April 2018a.
- Wu, L. Y., Fisch, A., Chopra, S., Adams, K., Bordes, A., and Weston, J. Starspace: Embed all the things! In Thirty-Second AAAI Conference on Artificial Intelligence , 2018b.
- Xu, W., Liu, X., and Gong, Y. Document clustering based on non-negative matrix factorization. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval , SIGIR '03, pp. 267-273, New York, NY, USA, 2003. ACM.
- Young, T., Hazarika, D., Poria, S., and Cambria, E. Recent trends in deep learning based natural language processing. IEEE Computational Intelligence Magazine , 13(3):55-75, August 2018.
- Yu, F. and Koltun, V. Multi-scale context aggregation by dilated convolutions. In International Conference on Learning Representations , 2016.
Cited by
Sorted by citations
Time-Series Representation Learning via Temporal and Contextual Contrasting
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C. K., Li, X., & Guan, C. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/324 · Cited by 696 · see citing works
Deep Learning for Time Series Forecasting: Tutorial and Literature Survey
Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, Y., Maddix, D., Turkmen, C., Gasthaus, J., Bohlke-Schneider, M., Salinas, D., Stella, L., et al. (2023) · ACM Computing Surveys · doi:10.1145/3533382 · Cited by 382 · see citing works
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295 · see citing works
Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C.-K., Li, X., & Guan, C. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3308189 · Cited by 224 · see citing works
Fully-Connected Spatial-Temporal Graph for Multivariate Time-Series Data
Wang, Y., Xu, Y., Yang, J., Wu, M., Li, X., Xie, L., & Chen, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29500 · Cited by 134 · see citing works
COCOA: Cross Modality Contrastive Learning for Sensor Data
Deldari, S., Xue, H., Saeed, A., Smith, D. V., & Salim, F. D. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550316 · Cited by 92 · see citing works
TARNet: Task-Aware Reconstruction for Time-Series Transformer
Chowdhury, R. R., Zhang, X., Shang, J., Gupta, R. K., & Hong, D. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539329 · Cited by 68 · see citing works
Chen, T., Ren, X., Lai, J., Tan, H., Liu, F., & Chan, W. K. V. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114389 · Cited by 3 · see citing works
- Authors
- Franceschi, J.-Y., Dieuleveut, A., & Jaggi, M.
- Affiliations
- MLIA
- École Polytechnique (FR)
- École Polytechnique Fédérale de Lausanne (CH)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Volume
- 32
- Pages
- 4650-4661
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1901.10738
- OpenAlex
- W2971121529
- Cited by
- 305
- References
- 9
- Citations by year
- 2026: 1 · 2025: 43 · 2024: 81 · 2023: 74 · 2022: 43 · 2021: 39 · 2020: 21 · 2019: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, cc-by)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Topological and Geometric Data Analysis
- Keywords
- multivariate time series, unsupervised feature learning, time series embedding, triplet loss, variable-length time series, transfer learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
