Multi-Granularity Residual Learning with Confidence Estimation for Time Series Prediction
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Time-series prediction is of high practical value in a wide range of applications such as econometrics and meteorology, where the data are commonly formed by temporal patterns. Most prior works ignore the diversity of dynamic pattern frequency, i.e., different granularities, suffering from insufficient information exploitation. Thus, multi-granularity learning is still under-explored for time-series prediction. In this paper, we propose a Multi-granularity Residual Learning Framework (MRLF) for more effective time series prediction. For a given time series, intuitively, there are more or less semantic overlaps and validity differences among its representations of different granularities. Due to the information redundancy, straightforward methods that leverage multi-granularity data, such as concatenation or ensemble, can easily lead to the model being dominated by the redundant coarse-grained trend information. Therefore, we design a novel residual learning net to model the prior knowledge of the fine-grained data’s distribution through the coarse-grained one. Then, by calculating the residual between multi-granularity data, the redundant information be removed. Furthermore, to alleviate the side effect of validity differences, we introduce a self-supervised objective for confidence estimation, which delivers more effective optimization without the requirement of additional annotation efforts. Extensive experiments on the real-world datasets indicate that multi-granular infor…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Methods for constructing multiple contrastive views based on multi-granularity or multi-scale augmentations also include MRLF [131], CMLF [115], and SSLAPP [132].”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [131]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17325 · Cited by 7,752
Multimodality image registration by maximization of mutual information
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. (1997) · IEEE Transactions on Medical Imaging · doi:10.1109/42.563664 · Cited by 4,547 · cited 1×
“In this work, we take advantage of mutual information [6, 29, 33, 38, 46] to measure the consistence of each granular data.”
MethodForecasting, Structural Time Series Models and the Kalman Filter
Harvey, A. C. (1990) · doi:10.1017/cbo9781107049994 · Cited by 4,195
Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing
Vapnik, V. N., Golowich, S. E., & Smola, A. J. (1997) · Cited by 2,757
DeepAR: Probabilistic forecasting with autoregressive recurrent networks
Salinas, D., Flunkert, V., Gasthaus, J., & Januschowski, T. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.07.001 · Cited by 2,661
Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks
Lai, G., Chang, W.-C., Yang, Y., & Liu, H. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3210006 · Cited by 2,152
Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks
Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., & Zhang, C. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403118 · Cited by 2,001
International Conference on Learning Representations (ICLR)
Abbas, M. Z. A., Kivinen, J., & Raiko, T. (2016) · Cited by 1,694
The Exponentially Weighted Moving Average
Hunter, J. S. (1986) · Journal of Quality Technology · doi:10.1080/00224065.1986.11979014 · Cited by 1,136
Temporal pattern attention for multivariate time series forecasting
Shih, S.-Y., Sun, F.-K., & Lee, H.-Y. (2019) · Machine Learning · doi:10.1007/s10994-019-05815-0 · Cited by 960
Equitability, mutual information, and the maximal information coefficient
Kinney, J. B., & Atwal, G. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1309933111 · Cited by 667 · cited 1×
“In contrast to correlation, mutual information captures non-linear statistical dependencies between variables. and thus can act as a measure of true dependence [3, 26].”
BackgroundInput feature selection by mutual information based on Parzen window
Kwak, N., & Choi, C.-H. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1114861 · Cited by 641
Gaussian processes for time-series modelling
Roberts, S., Osborne, M., Ebden, M., Reece, S., Gibson, N., & Aigrain, S. (2013) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2011.0550 · Cited by 605
Attend and Diagnose: Clinical Time Series Analysis Using Attention Models
Song, H., Rajan, D., Thiagarajan, J., & Spanias, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11635 · Cited by 468
An ARIMA-Model-Based Approach to Seasonal Adjustment
Hillmer, S. C., & Tiao, G. C. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477767 · Cited by 450
Stock Price Prediction via Discovering Multi-Frequency Trading Patterns
Zhang, L., Aggarwal, C., & Qi, G.-J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098117 · Cited by 447
DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting
Huang, S., Wang, D., Wu, X., & Tang, A. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3358132 · Cited by 250
Li, Z., Zhao, H., Liu, Q., Huang, Z., Mei, T., & Chen, E. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220014 · Cited by 209
Self-citationKnowledge-Driven Stock Trend Prediction and Explanation via Temporal Convolutional Network
Deng, S., Zhang, N., Zhang, W., Chen, J., Pan, J. Z., & Chen, H. (2019) · Companion Proceedings of The 2019 World Wide Web Conference · doi:10.1145/3308560.3317701 · Cited by 185
An Overview of Electricity Demand Forecasting Techniques
Singh, A. K., Ibraheem, S. K., & Muazzam, M. (2013) · Network and complex systems · Cited by 147
Tang, X., Yao, H., Sun, Y., Aggarwal, C., Mitra, P., & Wang, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6056 · Cited by 125
Probabilistic Forecasting of Sensory Data With Generative Adversarial Networks – ForGAN
Koochali, A., Schichtel, P., Dengel, A. R., & Ahmed, S. (2019) · IEEE Access · doi:10.1109/access.2019.2915544 · Cited by 113
Chen, C., Zhao, L., Bian, J., Xing, C., & Liu, T.-Y. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330663 · Cited by 73 · cited 1×
“Following [7, 13, 52], we aim to predict the daily return ratio of a stock which is”
Self-citationMultiscale and Multi-Granularity Process Analytics: A Review
Reis, M. S. (2019) · Processes · doi:10.3390/pr7020061 · Cited by 51
Multi-scale Two-way Deep Neural Network for Stock Trend Prediction
Liu, G., Mao, Y., Sun, Q., Huang, H., Gao, W., Li, X., Shen, J., Li, R., & Wang, X. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/628 · Cited by 50
REST: Relational Event-driven Stock Trend Forecasting
Xu, W., Liu, W., Xu, C., Bian, J., Yin, J., & Liu, T.-Y. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450032 · Cited by 49
Self-citationLearning Transferable User Representations with Sequential Behaviors via Contrastive Pre-training
Cheng, M., Yuan, F., Liu, Q., Xin, X., & Chen, E. (2021) · 2021 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm51629.2021.00015 · Cited by 40
Self-citationInvestor-Imitator: A Framework for Trading Knowledge Extraction
Ding, Y. C., Liu, W., Bian, J., Zhang, D., & Liu, T. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220113 · Cited by 23
Self-citationEstimating Early Fundraising Performance of Innovations via Graph-Based Market Environment Model
Wu, L., Li, Z., Zhao, H., Pan, Z., Liu, Q., & Chen, E. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6110 · Cited by 20
Self-citation
Research works printed but not linked: 21
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. International Conference on Learning Representations (2015).
- Mohamed Ishmael Belghazi, Aristide Baratin, Sai Rajeshwar, Sherjil Ozair, Yoshua Bengio, Aaron Courville, and Devon Hjelm. 2018. Mutual information neural estimation. In International Conference on Machine Learning. 531–540.
- Mikolaj Binkowski, Gautier Marti, and Philippe Donnat. 2018. Autoregressive convolutional neural networks for asynchronous time series. In International Conference on Machine Learning. PMLR, 580–589.
- George Box. 2013. Box and Jenkins: time series analysis, forecasting and control. In A Very British Affair. Springer, 161–215.
- Atul J Butte and Isaac S Kohane. 1999. Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. In Biocomputing 2000. World Scientific, 418–429.
- Kyunghyun Cho Bart Van Merriënboer Caglar Gulcehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078(2014). · arXiv
- Junyoung Chung Caglar Gulcehre KyungHyun Cho and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555(2014). · arXiv
- Zhicheng Cui Wenlin Chen and Yixin Chen. 2016. Multi-scale convolutional neural networks for time series classification. arXiv preprint arXiv:1603.06995(2016). · arXiv
- Fuli Feng, Huimin Chen, Xiangnan He, Ji Ding, Maosong Sun, and Tat-Seng Chua. 2019. Enhancing Stock Movement Prediction with Adversarial Training. IJCAI (2019).
- Pierre Geurts 2018. dynGENIE3: dynamical GENIE3 for the inference of gene networks from time series expression data. Scientific reports 8, 1 (2018), 1–12.
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
- Min Hou, Chang Xu, Yang Liu, Weiqing Liu, Jiang Bian, Le Wu, Zhi Li, Enhong Chen, and Tie-Yan Liu. 2021. Stock Trend Prediction with Multi-Granularity Data: A Contrastive Learning Approach with Adaptive Fusion. Association for Computing Machinery, New York, NY, USA, 700–709.
- Nikita Kitaev, Lukasz Kaiser, and Anselm Levskaya. 2020. Reformer: The Efficient Transformer. In International Conference on Learning Representations.
- Manfred Mudelsee. 2013. Climate time series analysis. Vol. 30. Springer.
- Aaron van den Oord Yazhe Li and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748(2018). · arXiv
- Boris N Oreshkin Dmitri Carpov Nicolas Chapados and Yoshua Bengio. 2019. N-BEATS: Neural basis expansion analysis for interpretable time series forecasting. arXiv preprint arXiv:1905.10437(2019). · arXiv
- Clare Ostle, Richard C Thompson, Derek Broughton, Lance Gregory, Marianne Wootton, and David G Johns. 2019. The rise in ocean plastics evidenced from a 60-year time series. Nature communications 10, 1 (2019), 1–6.
- Yao Qin, Dongjin Song, Haifeng Chen, Wei Cheng, Guofei Jiang, and Garrison Cottrell. 2017. A dual-stage attention-based recurrent neural network for time series prediction. IJCAI (2017), 2627–2633.
- Naftali Tishby Fernando C Pereira and William Bialek. 2000. The information bottleneck method. arXiv preprint physics/0004057(2000). · arXiv
- Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Łukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998–6008.
- Likang Wu, Zhi Li, Hongke Zhao, Qi Liu, and Enhong Chen. 2022. Estimating Fund-Raising Performance for Start-up Projects from a Market Graph Perspective. Pattern Recogn. 121, C (jan 2022), 13 pages.
Cited by
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295
“Thus one future direction is to consider more effective ways to induce inductive biases into time series SSL based on the understanding of time series data and characteristics of specific tasks.”
BackgroundSelf-citationMGSFformer: A Multi-Granularity Spatiotemporal Fusion Transformer for air quality prediction
Yu, C., Wang, F., Wang, Y., Shao, Z., Sun, T., Yao, D., & Xu, Y. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102607 · Cited by 162
UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting
Liu, X., Hu, J., Li, Y., Diao, S., Liang, Y., Hooi, B., & Zimmermann, R. (2024) · Proceedings of the ACM Web Conference 2024 · doi:10.1145/3589334.3645434 · Cited by 115
“Multivariate time series forecasting, with its capacity to analyze historical data and predict future trends, emerges as a crucial tool in modern web technologies [8, 10, 11, 13, 35].”
BackgroundFormerTime: Hierarchical Multi-Scale Representations for Multivariate Time Series Classification
Cheng, M., Liu, Q., Liu, Z., Li, Z., Luo, Y., & Chen, E. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583205 · Cited by 93
Self-citationGraph Time-series Modeling in Deep Learning: A Survey
Chen, H., & Eldardiry, H. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3638534 · Cited by 55
Metadata
- Authors
- Hou, M., Xu, C., Li, Z., Liu, Y., Liu, W., Chen, E., & Bian, J.
- Affiliations
- University of Science and Technology of China (CN)
- Microsoft Research Asia (China) (CN)
- Venue
- Proceedings of the ACM Web Conference 2022
- Publisher
- ACM
- Published
- 2022-04-25
- Pages
- 112-121
- OpenAlex
- W4224309822
- Cited by
- 59
- References
- 33
- Citations by year
- 2026: 6 · 2025: 36 · 2024: 11 · 2023: 6
- FWCI
- 9.42
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Keywords
- time series forecasting, residual learning, confidence estimation, self-supervised learning, temporal patterns, information redundancy, temporal granularity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.