TVGeAN: Tensor Visibility Graph-Enhanced Attention Network for Versatile Multivariant Time Series Learning Tasks
Open accessAbstract
This paper introduces Tensor Visibility Graph-enhanced Attention Networks (TVGeAN), a novel graph autoencoder model specifically designed for MTS learning tasks. The underlying approach of TVGeAN is to combine the power of complex networks in representing time series as graphs with the strengths of Graph Neural Networks (GNNs) in learning from graph data. TVGeAN consists of two new main components: TVG which extend the capabilities of visibility graph algorithms in representing MTSs by converting them into weighted temporal graphs where both the nodes and the edges are tensors. Each node in the TVG represents the MTS observations at a particular time, while the weights of the edges are defined based on the visibility angle algorithm. The second main component of the proposed model is GeAN, a novel graph attention mechanism developed to seamlessly integrate the temporal interactions represented in the nodes and edges of the graphs into the core learning process. GeAN achieves this by using the outer product to quantify the pairwise interactions of nodes and edges at a fine-grained level and a bilinear model to effectively distil the knowledge interwoven in these representations. From an architectural point of view, TVGeAN builds on the autoencoder approach complemented by sparse and variational learning units. The sparse learning unit is used to promote inductive learning in TVGeAN, and the variational learning unit is used to endow TVGeAN with generative capabilities. The performance of the TVGeAN model is extensively evaluated against four widely cited MTS benchmarks for both supervised and unsupervised learning tasks. The results of these evaluations show the high performance of TVGeAN for various MTS learning tasks. In particular, TVGeAN can achieve an average root mean square error of 6.8 for the C-MPASS dataset (i.e., regression learning tasks) and a precision close to one for the SMD, MSL, and SMAP datasets (i.e., anomaly detection learning tasks), which are better results than most published works.
AI snapshot
Written from the paper’s full text.
TL;DR
TVGeAN is a graph autoencoder for multivariate time series that combines a Tensor Visibility Graph (TVG) representation with a Graph-enhanced Attention Network (GeAN). It reports strong performance on regression and anomaly-detection benchmarks, including an average RMSE of 6.8 on C-MPASS and precision close to one on SMD, MSL, and SMAP.
Key findings
- TVGeAN achieves an average RMSE of 6.8 for the C-MPASS regression dataset and precision close to one for the SMD, MSL, and SMAP anomaly-detection datasets, described as better than most published works.
- In computational comparisons on FD004 and SMAP, TVGeAN had the lowest FLOPs, fastest inference time, and fewest parameters: FD004 FLOPs 321,000, parameter count 25,125, inference time 2.21 ms; SMAP FLOPs 214,214, parameter count 19,214, inference time 1.05 ms.
- TVG-based graphs produced sharper error decay and quasi-negligible plateaus compared with monoplex (MnGEAN) and multiplex (MxGEAN) graph representations; MnGEAN fluctuated, while MxGEAN decayed more slowly and plateaued at non-negligible errors.
- GeAN showed lower variability and predictions closer to zero than variants using concatenation or unitary attention (OUGAN, CBGAN, CUGAN), with the paper attributing this to the outer product and bilinear model.
Methods
- The model is a graph autoencoder with encoder, stochastic/reparameterization layer, and decoder, using sparse and variational learning units; the loss combines sparse loss, reconstruction loss, and Kullback–Leibler divergence.
- Evaluation used four benchmarks: C-MPASS subsets FD001–FD004 for regression, and SMD, MSL, and SMAP for anomaly detection; metrics included MAE, RMSE, precision, recall, and F1.
- Implementation used Python 3.12.5 and PyTorch 2.4.0, with five GNN layers in both encoder and decoder, LeakyReLU negative slope 0.2, Adam optimizer with initial learning rate 0.001, learning-rate reduction by 0.1 every 10 epochs without improvement, and batch size one-tenth the training dataset; 10-fold cross-validation was used for the attention-mechanism comparison.
Limitations
- The paper states that the proportional growth of the diameter and relationships of TVG graphs can be a possible limitation for very long and complex MTS datasets; future work includes graph clustering, dimensionality reduction, or state-space representations for more compact graphs.
- The paper states that modelling MTS with missing and incomplete data points needs further investigation, and that improving graph attention mechanisms to jointly process multiple MTS data points may increase computational complexity while enabling real-time applications.
- Evident from the text: evaluation is limited to four benchmark datasets (C-MPASS, SMD, MSL, SMAP), and the provided text does not report statistical significance tests or confidence intervals for the main benchmark comparisons.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
35 of 64 cited sources checked · 17 supported · 2 flagged · accuracy not yet measured
- Premisereasoning
Most DNN models for MTS use multiple instances because they were designed to process univariate sequences.
“Despite the different principles and design goals of these architectures, the fact that they were designed to process univariate sequences entails the use of multiple instances to facilitate the processing of MTS.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [15] Ashish, V. (2017). Attention is all you need. arXiv.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [16] Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv. source
Section 4 (p. 5) describes a two-dimensional input sequence used to evaluate TCNs and RNNs, contrary to the assertion that these architectures require multiple instances to process more than one variable. The paper does not assess whether most DNN models for multivariate time series use multiple instances. (LLM, conf=0.78)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured - cites [17] Elman, 1990, Finding structure in time, Cogn. Sci. source
- Interpretationcitation
GeAN uses a bilinear model to distil knowledge interwoven in node and edge representations.
“GeAN also uses the bilinear model [29,30] to distil the knowledge interwoven in these representations by allowing each node and edge to collaboratively modulate each other's contributions through a shared learning space.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [29] Tenenbaum, 2000, Separating Style and Content with Bilinear Models, Neural Comput. source
- cites [30] Kim, J.H., Jun, J., and Zhang, B.T. (2018, January 3–8). Bilinear attention networks. Proceedings of the Advances in Neural Information Processing Systems 31 (NeurIPS 2018), Montreal, QC, Canda. source
- Interpretationreasoning
Sparse learning allows TVGeAN to learn from different graph structures without random sampling as in GraphSAGE or node masking.
“This in turn allows TVGeAN to learn from different graph structures without the need to implement additional techniques such as random sampling as in GraphSAGE [33] or node masking as in [34].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [33] Hamilton, W., Ying, Z., and Leskovec, J. (2017, January 4–9). Inductive representation learning on large graphs. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA. source
- cites [34] Mishra, P., Piktus, A., Goossen, G., and Silvestri, F. (2020). Node masking: Making graph neural networks generalize and scale better. arXiv. source
- Premisecitation
Multiple-instance configurations limit simultaneously capturing evolving patterns and dependencies of MTS.
“the limitations in simultaneously capturing the evolving patterns and dependencies of MTS due to the restriction of each instance's hypothesis space to its individual inputs [22,23]”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [22] Karim, 2019, Multivariate LSTM-FCNs for time series classification, Neural Netw. source
The Introduction (p. 2) describes multivariate time-series methods, including one that finds dependencies between segments, but does not state that multiple-instance configurations limit the simultaneous capture of evolving patterns and dependencies. Searches for the claimed hypothesis-space restriction and for multiple-instance limitations found no passage addressing that point. (LLM, conf=0.72)
Experimental — accuracy not yet measured - cites [23] Graves, A., Fernández, S., and Schmidhuber, J. (2007, January 9–13). Multi-dimensional recurrent neural networks. Proceedings of the International Conference on Artificial Neural Networks, Porto, Portugal. source
- Premisecitation
Most studies using complex networks as preprocessing convert raw time series into graphs, extract topological statistics, and feed them into DNN models.
“In particular, most of the studies in this area use complex networks to convert raw time series data into graphs and then extract the topological statistics (such as cluster coefficients, path lengths, and node edge distributions) from the graphs and feed them into the DNN models.”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [28] Supriya, 2016, Weighted visibility graph with complex network features in the detection of epilepsy, IEEE Access source
The paper’s opening summary describes converting EEG time series into a complex network and extracting network statistics, including modularity and average weighted degree. But it feeds those features into SVM and KNN classifiers, not DNN models. The paper also does not establish that most studies use the claimed pipeline. (LLM, conf=0.90)
Experimental — accuracy not yet measured - cites [79] Eroglu, D., Marwan, N., Stebich, M., and Kurths, J. (2018). Multiplex visibility graphs to investigate recurrent neural network dynamics. Sci. Rep., 7. source
The Abstract (page unavailable) describes converting time series of neuron activations into graphs, and the Discussion (page unavailable) analyzes topological properties such as clustering coefficients. The paper does not establish that most studies use this approach or that the extracted statistics are fed into DNN models; its proposed graph-based methods tune ESN hyperparameters. (LLM, conf=0.86)
Experimental — accuracy not yet measured
- Premisecitation
Multiple-instance configurations incur high computational cost from running multiple instances.
“These include the high computational cost incurred by running multiple instances [18,19]”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [18] Lipton, Z.C. (2015). Learning to diagnose with LSTM recurrent neural networks. arXiv. source
The classification-performance discussion (p. 9) says auxiliary-output models trained more slowly and required more epochs. It does not describe running multiple instances or attribute computational cost to doing so. Searches for multiple-instance configurations and training multiple models found no passage addressing that claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured - cites [19] Forestier, 2019, Deep learning for time series classification: A review, Data Min. Knowl. Discov. source
- Premisecitation
Most existing works use the spatial or spectral GNN approach to map MTS into a graph.
“To overcome this challenge, most of the existing works use the spatial or spectral GNN approach [65].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [65] Jin, M., Koh, H.Y., Wen, Q., Zambon, D., Alippi, C., Webb, G.I., King, I., and Pan, S. (2023). A survey on graph neural networks for time series: Forecasting, classification, imputation, and anomaly detection. arXiv. source
- Premisecitation
Spatial GNN models assume that the underlying structure of the data sources from which the MTS dataset is generated is known.
“Spatial GNN models (e.g., refs.[66][67][68]) are based on the assumption that the underlying structure of the data sources from which the MTS dataset is generated is known.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [66] Bloemheuvel, 2023, Graph neural networks for multivariate time series regression with application to seismic data, Int. J. Data Sci. Anal. source
- cites [67] Ding, J., Zhang, L., and Cheng, J. (2021, January 26–28). Multi-robot Path Planning Based on Spatio-Temporal Information in Large-scale Unknown Environment. Proceedings of the 2021 27th International Conference on Mechatronics and Machine Vision in Practice (M2VIP), Shanghai, China. source
- cites [68] Wang, X., Ma, Y., Wang, Y., Jin, W., Wang, X., Tang, J., Jia, C., and Yu, J. (2020, January 20–24). Traffic flow prediction via spatial temporal graph neural network. Proceedings of the Web Conference 2020, Taipei, Taiwan. source
- Findingown data
Table 3 shows that the model presented in [97] occupies the penultimate position in terms of performance.
“Table 3 also shows that the model presented in [97] occupies the penultimate position in terms of performance.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [97] Ma, M., Wang, Z., and Zhong, Z. (2024). Transformer Encoder Enhanced by an Adaptive Graph Convolutional Neural Network for Prediction of Aero-Engines’ Remaining Useful Life. Aerospace, 11. source
- Interpretationreasoning
By using sparse and variational autoencoder architectures, TVGeAN can capture intrinsic knowledge from a small training space and generalize it effectively without using complex approaches.
“Furthermore, by using sparse and variational autoencoder architectures, TVGeAN can capture the intrinsic knowledge from a small training space and generalize it effectively without using complex approaches, as is the case with the models that use the dynamic graph approach, e.g., refs.[103-106].”
Quote in the paperSubstantial claim2 of 4 sources checked- cites [103] Song, 2023, Identifying performance anomalies in fluctuating cloud environments: A robust correlative-GNN-based explainable approach, Future Gener. Comput. Syst. source
- cites [104] Bajpai, S., Murthy, P.K., and Kumar, N. (2024, January 27–29). AnomGraphAdv: Enhancing Anomaly and Network Intrusion Detection in Wireless Networks Using Adversarial Training and Temporal Graph Networks. Proceedings of the 17th ACM Conference on Security and Privacy in Wireless and Mobile Networks, Seoul, Republic of Korea. source
- cites [105] Xiong, 2024, SiET: Spatial information enhanced transformer for multivariate time series anomaly detection, Knowl.-Based Syst. source
- cites [106] Wu, Y., Gu, M., Wang, L., Lin, Y., Wang, F., and Yang, H. (2021). Event2graph: Event-driven bipartite graph for multivariate time-series anomaly detection. arXiv. source
- Interpretationreasoning
The ability of GeAN to learn the temporal interactions embedded in the node and edge features of graphs in their native formats solves the shortcomings associated with using separate feature extraction processes to capture temporal and spatial features.
“Furthermore, the ability of GeAN to learn the temporal interactions embedded in the node and edge features of graphs in their native formats solves the shortcomings associated with using separate feature extraction processes to capture the temporal and spatial features, as is the case in [81,82].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [81] Sun, 2019, Univariate time series classification using information geometry, Pattern Recognit. source
- cites [82] Donner, 2011, Recurrence based time series analysis by means of complex network methods, Int. J. Bifurc. Chaos source
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
- Findingown data
TVGeAN achieves an average RMSE of 6.8 for the C-MPASS dataset.
“In particular, TVGeAN can achieve an average root mean square error of 6.8 for the C-MPASS dataset (i.e., regression learning tasks)”
Quote in the paperSubstantial claim- Rests on an assumption: The standard statistical metrics used (RMSE, precision, recall, F1) adequately capture performance on the MTS learning tasks.
- Findingown data
TVGeAN achieves precision close to one for the SMD, MSL, and SMAP datasets.
“and a precision close to one for the SMD, MSL, and SMAP datasets (i.e., anomaly detection learning tasks)”
Quote in the paperSubstantial claim- Rests on an assumption: The standard statistical metrics used (RMSE, precision, recall, F1) adequately capture performance on the MTS learning tasks.
- Findingreasoning
The convergence rate of MxGeAN trained on the FD004 dataset is much lower than the convergence rate for the same model trained on the FD001 dataset.
“For example, it can be seen that the convergence rate of MxGeAN trained on the FD004 dataset is much lower than the convergence rate for the same model trained on the FD001 dataset.”
Quote in the paperNot a substantial claim - Findingreasoning
The error curves of the MnGeAN models exhibit a high degree of fluctuation compared to the other models.
“Figure 3 also shows that the error curves of the MnGeAN models exhibit a high degree of fluctuation compared to the other models.”
Quote in the paperSubstantial claim - Findingreasoning
Figure 3 shows that the error curves of the MnGeAN models exhibit a high degree of fluctuation compared to the other models.
“Figure 3 also shows that the error curves of the MnGeAN models exhibit a high degree of fluctuation compared to the other models.”
Quote in the paperSubstantial claim - Findingown data
The whisker range of the box plots of the GeAN model is only a fraction of the range of the box plots of the other models, indicating low variability in prediction errors across folds.
“In particular, it can be seen that the whisker range of the box plots of the GeAN model is only a fraction of the range of the box plots of the other models, indicating the low variability in the prediction errors generated by the GeAN mechanism across different folds.”
Quote in the paperSubstantial claim - Findingown data
Figure 3 shows that the error curves of MnGeAN, MxGeAN, and TVGeAN follow different characteristics.
“Figure 3 shows that the error curves of MnGeAN, MxGeAN, and TVGeAN follow different characteristics.”
Quote in the paperSubstantial claim - Findingown data
The error curves of MnGeAN, MxGeAN, and TVGeAN follow different characteristics.
“Figure 3 shows that the error curves of MnGeAN, MxGeAN, and TVGeAN follow different characteristics.”
Quote in the paperSubstantial claim - Findingreasoning
The interquartile ranges of CBGAN and CUGAN are much higher than those of the other models, especially in the anomaly detection learning tasks (SMD, MSL, and SMAP datasets).
“Figure 5 shows that the interquartile ranges of these two models are much higher than those of the other models, especially in the anomaly detection learning tasks (i.e., SMD, MSL, and SMAP datasets).”
Quote in the paperSubstantial claim - Findingreasoning
The error curves of TVGeAN decrease sharply in the early epochs and then plateau at a quasi-negligible value.
“For example, it can be seen that the error curves of TVGeAN decrease sharply in the early epochs and then plateau at a quasi-negligible value.”
- Also stated in: § 4.2. Effects of TVG on the Learning Performance of the Model · plain
“For example, it can be seen that the error curves of TVGeAN decrease sharply in the early epochs and then plateau at a quasi-negligible value.”
Quote in the paperSubstantial claim - Also stated in: § 4.2. Effects of TVG on the Learning Performance of the Model · plain
- Findingreasoning
The error curve of the MnGeAN model trained on the FD004 dataset shows stronger fluctuations than its counterpart trained on FD001.
“It can also be seen that the error curve of the MnGeAN model trained on the FD004 dataset shows stronger fluctuations than its counterpart trained on FD001.”
Quote in the paperNot a substantial claim - Findingreasoning
The box plots of the mechanisms using the unitary attention approach, namely OUGAN and CUGAN, are significantly far from the desired zero-error values.
“Figure 5 also shows that the box plots of the mechanisms using the unitary attention approach, namely OUGAN and CUGAN, are significantly far from the desired zero-error values.”
Quote in the paperSubstantial claim - Findingnone given
The model proposed in [101] shows the lowest performance on the supervised learning tasks compared to the other models.
“For example, the model proposed in [101] shows the lowest performance on the supervised learning tasks compared to the others.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [101] Liang, 2023, Remaining useful life prediction via a deep adaptive transformer framework enhanced by graph attention network, Int. J. Fatigue source
- Findingreasoning
Table 3 shows that applying preprocessing techniques to the MTS before generating graphs on which GNNs work can bring marginal improvements to prediction performance.
“It can also be seen from Table 3 that applying preprocessing techniques to the MTS before generating graphs on which GNNs work can bring marginal improvements to the prediction performance.”
Quote in the paperNot a substantial claim - Findingown data
TVGeAN outperforms some state-of-the-art models in terms of predictive accuracy.
“The previous subsection has shown that the proposed model can outperform some of the state-of-the-art models in terms of predictive accuracy.”
Quote in the paperSubstantial claim - Interpretationreasoning
GeAN integrates temporal interactions represented in nodes and edges into the core learning process.
“GeAN, a novel graph attention mechanism developed to seamlessly integrate the temporal interactions represented in the nodes and edges of the graphs into the core learning process.”
Quote in the paperSubstantial claim - Interpretationreasoning
TVGeAN combines complex networks for representing time series as graphs with GNNs for learning from graph data.
“The underlying approach of TVGeAN is to combine the power of complex networks in representing time series as graphs with the strengths of Graph Neural Networks (GNNs) in learning from graph data.”
Quote in the paperSubstantial claim - Interpretationnone given
GeAN uses the outer product to quantify pairwise interactions of nodes and edges at a fine-grained level.
“GeAN achieves this by using the outer product to quantify the pairwise interactions of nodes and edges at a fine-grained level”
Quote in the paperSubstantial claim - Interpretationreasoning
GeAN's outer product and bilinear model lead to consolidation of salient MTS behaviors into a compact map that ensures accurate attention scores.
“This in turn leads to a consolidation of the salient behaviors of the MTS dataset into a compact map that ensures the derivation of accurate attention scores.”
Quote in the paperSubstantial claim - Interpretationreasoning
The variational learning unit allows TVGeAN to condense inputs in a low-dimensional space and reconstruct them in the output layers.
“The variational learning unit, on the other hand, is used to provide TVGeAN with generative capabilities that allow it to condense the given inputs in a low-dimensional space and then reconstruct them in the output layers.”
Quote in the paperSubstantial claim - Interpretationreasoning
The sparse learning unit promotes inductive learning in TVGeAN by prioritizing nodes and edges according to their importance for the learning objectives.
“The main reason for using the sparse learning units is to promote inductive learning in TVGeAN by prioritizing nodes and edges according to their importance for the learning objectives.”
Quote in the paperSubstantial claim - Premisecitation
Multiple-instance configurations risk losing critical information when information from instances is fused.
“the risk of losing critical information when the information obtained from these instances is fused [20,21]”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [20] Yang, J., Wang, K., Peng, X., and Qiao, Y. (2018, January 16–20). Deep recurrent multi-instance learning with spatio-temporal features for engagement intensity prediction. Proceedings of the 20th ACM International Conference on Multimodal Interaction, Boulder, CO, USA. source
- cites [21] Wang, 2022, Multivariable time series forecasting using model fusion, Inf. Sci. source
- Study design and conductown data
TVGeAN was evaluated against four widely cited MTS benchmarks: C-MPASS, SMD, MSL, and SMAP for supervised and unsupervised learning tasks.
“Present a comprehensive evaluation of the TVGeAN model using four widely cited MTS benchmarks for supervised and unsupervised learning tasks: C-MPASS [35], SMD [36], MSL, and SMAP [37].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [35] Saxena, A., Goebel, K., Simon, D., and Eklund, N. (2008, January 6–9). Damage Propagation Modeling for Aircraft Engine Run-to-Failure Simulation. Proceedings of the 1st International Conference on Prognostics and Health Management (PHM08), Denver, CO, USA. source
- cites [36] Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., and Pei, D. (2019, January 4–8). Robust anomaly detection for multivariate time series through stochastic recurrent neural network. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA. source
- cites [37] Hundman, K., Constantinou, V., Laporte, C., Colwell, I., and Soderstrom, T. (2018, January 19–23). Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK. Multivariate time series analysis and applications. source
- Rests on an assumption: The four MTS benchmarks used (C-MPASS, SMD, MSL, SMAP) are representative of MTS learning tasks.
- Interpretationcitation
The invariance of TVG graphs under affine transformations, inherited from the visibility angle approach, increases the robustness of these graphs in mitigating the effects of variability or confounding factors introduced by the environment from which MTSs are collected.
“Furthermore, the invariance of TVG graphs under affine transformations inherited from the use of the visibility angle approach increases the robustness of these graphs in mitigating the effects of variability or confounding factors introduced by the environment from which MTSs are collected.”
Quote in the paperSubstantial claim- Rests on an assumption: The environment from which MTSs are collected introduces variability or confounding factors.
- Premisereasoning
GNN flexibility allows dealing more effectively with MTS datasets with heterogeneous and incomplete input space.
“This flexibility allows GNNs to deal more effectively with MTS datasets with heterogeneous and incomplete input space, as nodes with missing or corrupted information can adapt their computational unit based on the available data, resulting in more robust and reliable performance.”
Quote in the paperSubstantial claim - Premisecitation
The visibility angle algorithm leads to a connected graph that is invariant under affine transformations.
“Using the visibility angle algorithm leads to a connected graph that is invariant under affine transformations [28,[87][88][89].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [28,[87][88][89]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisenone given
Most works using GNNs for MTS learning tasks do not define a cohesive approach to deal simultaneously with structural and temporal features distributed over edges and nodes.
“Moreover, this review shows that most works using GNNs for MTS learning tasks do not define a cohesion approach to deal simultaneously with the structural and temporal features distributed over the edges and nodes of the graphs.”
Quote in the paperSubstantial claim - Interpretationown data
TVGeAN is very competent in various MTS learning tasks.
“The results of these evaluations show that TVGeAN is very competent in various MTS learning tasks.”
Quote in the paperSubstantial claim- Rests on an assumption: The four MTS benchmarks used (C-MPASS, SMD, MSL, SMAP) are representative of MTS learning tasks.
- Interpretationreasoning
The sparse unit facilitates inductive learning by allowing TVGeAN to capture knowledge contained in graphs without being constrained by their specific structures or additional techniques such as random sampling or node masking.
“The main advantage of the sparse unit is to facilitate inductive learning by allowing TVGeAN to capture the knowledge contained in graphs without being constrained by their specific structures or having to implement additional techniques such as random sampling or node masking, which are typically used in other models for this purpose.”
Quote in the paperSubstantial claim - Interpretationown data
TVGeAN's results are better than most published works.
“which are better results than most published works.”
Quote in the paperSubstantial claim- Rests on an assumption: The standard statistical metrics used (RMSE, precision, recall, F1) adequately capture performance on the MTS learning tasks.
- Interpretationreasoning
The variational learning unit improves the predictability of TVGeAN by allowing it to regenerate given graphs under noise inputs.
“The variational learning unit, on the other hand, serves to improve the predictability of the TVGeAN model by allowing it to regenerate the given graphs under noise inputs.”
Quote in the paperSubstantial claim - Interpretationcitation
TVGeAN architecture is based on the autoencoder approach with sparse and variational learning units.
“Designing the architecture of TVGeAN based on the autoencoder approach with sparse and variational learning units [31,32].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [31] Ranzato, M.A., Poultney, C., Chopra, S., and Cun, Y. (2006, January 4–7). Efficient learning of sparse representations with an energy-based model. Proceedings of the Advances in Neural Information Processing Systems 19 (NIPS 2006), Vancouver, BC, Canada. source
- cites [32] Kingma Diederik, P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
Not checked in the free run.
- Interpretationreasoning
The property of affine invariance is important for TVG because it allows MTS dependencies to be represented in graphs without isolating nodes.
“This property is important for TVG, as it allows for the representation of MTS dependencies in graphs without isolating nodes.”
Quote in the paperSubstantial claim - Premisereasoning
GNNs can capture different levels of dependencies of MTS represented as graphs without multiple instance configurations.
“This capability allows the GNN to capture different levels of dependencies of MTS datasets represented as graphs without the need to use multiple instance configurations as required by other DNN models.”
Quote in the paperSubstantial claim - Premisereasoning
Segregating spatial and temporal feature extraction can lose interactions between spatial and temporal features.
“Although this segregation can provide a more scalable approach for processing MTS with GNN, it has several drawbacks, such as the high susceptibility to the loss of interactions between spatial and temporal features, since each of these feature extraction processes is performed separately.”
Quote in the paperSubstantial claim - Interpretationreasoning
GeAN achieves integration of node and edge features by using the outer product operation instead of vector concatenation.
“GeAN achieves this integration by using the outer product operation instead of the vector concatenation used in other graph attention mechanisms.”
Quote in the paperSubstantial claim - Interpretationreasoning
As a result, the attention score generated may not reflect the actual importance or relevance of each feature in the graphs.
“As a result, the attention score generated may not reflect the actual importance or relevance of each feature in the graphs.”
Quote in the paperSubstantial claim - Interpretationreasoning
When TVG graphs are processed by GeAN, dependencies distributed in different elements of the graph can be consolidated by following the continuous flow of information through the graph.
“Thus, when the TVG graphs are processed by the GeAN model, the dependencies distributed in the different elements of the graph can be consolidated by following the continuous flow of information through the graph.”
Quote in the paperSubstantial claim - Interpretationreasoning
This representation allows GeAN to effectively distil knowledge and consolidate it, driving convergence of the TVGeAN models towards zero-error regions.
“This simple yet comprehensive representation allows the learning process (i.e., GeAN) to effectively distil the knowledge contained in the different datasets and firmly consolidate it during the learning steps, which in turn drives the convergence of the TVGeAN models towards the zero-error regions.”
Quote in the paperSubstantial claim - Interpretationreasoning
The sparse learning unit provides an adaptive method for dimensionality reduction by amputating edges and/or nodes whose contributions to learning tasks are negligible.
“Another main advantage of employing the sparse learning unit is that can provide the model with an adaptive method for dimensionality reduction by amputating the edges and/or nodes whose contributions to the learning tasks are neglectable.”
Quote in the paperSubstantial claim - Interpretationown data
The poor prediction performance of the unitary attention mechanism can be mainly attributed to its inherent limitations, especially the mismatch between the projected values of the node features and the features of its neighbors and edges.
“This poor prediction performance can be mainly attributed to the inherent limitations of the unitary attention mechanism, especially the mismatch between the projected values of the node features and the features of its neighbors and edges.”
Quote in the paperSubstantial claim - Interpretationreasoning
Using bilinear models in GeAN avoids potential loss of information that can occur when data are projected into a higher-dimensional space and then projected back during inference.
“The use of bilinear models in GeAN can also avoid the potential loss of information that can occur when the data are projected into a higher-dimensional space and then projected back into the original space during inference.”
Quote in the paperSubstantial claim - Interpretationreasoning
The visibility angle enables TVG to effectively represent the intrinsic behavior of the underlying processes that generate the MTS datasets.
“This enables TVG to effectively represent the intrinsic behavior of the underlying processes that generate the MTS datasets.”
Quote in the paperNot a substantial claim - Interpretationown data
The high fluctuation of MnGeAN error curves implies that graphs generated by the monoplex algorithm are not able to represent important information of MTS datasets in a way useful for GeAN.
“This behavior implies that the graphs generated by the monoplex algorithm are not able to represent the important information of the MTS datasets in a way that is useful for the GeAN model.”
Quote in the paperSubstantial claim - Interpretationown data
The outstanding performance of the GeAN mechanism corroborates the ability of the design philosophy underlying GeAN to capture knowledge embedded in different datasets and generalize it effectively to unseen samples.
“This outstanding performance of the GeAN mechanism corroborates the ability of the design philosophy underlying the GeAN mechanism to endow it with tremendous capabilities to capture the knowledge embedded in different datasets and generalize it effectively to unseen samples.”
Quote in the paperSubstantial claim - Interpretationreasoning
Another reason for the better performance of TVGeAN is the adoption of the visibility angle to define the weighting of edges between different nodes.
“Another important reason for the better performance of TVGeAN is the adoption of the visibility angle to define the weighting of edges between different nodes.”
Quote in the paperSubstantial claim - Interpretationreasoning
The sharp decrease and plateau of TVGeAN error curves can be attributed to the TVG algorithm's ability to accurately capture temporal dependencies inherent in MTS datasets and represent them concisely as tensor edges and nodes.
“These characteristics can be attributed to the ability of the TVG algorithm to accurately capture the temporal dependencies inherent in the MTS dataset and represent them concisely as tensor edges and nodes.”
Quote in the paperSubstantial claim - Interpretationnone given
Using bilinear models in GeAN reduces susceptibility to overfitting by eliminating the possibility of using an overly dimensional space to project raw data.
“Another important benefit of using bilinear models in GeAN is that the susceptibility to overfitting can be reduced by eliminating the possibility of using an overly dimensional space to project the raw data.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The representation of the sophisticated interactions of FD004 with the monoplex algorithm leads to a graph whose weighted edges are almost equal (close to unity).
“On the other hand, since the monoplex algorithm expresses all interactions as contemporaneous correlations between the univariate time series, the representation of the sophisticated interactions of FD004 with this algorithm leads to the creation of a graph whose weighted edges are almost equal (i.e., close to unity).”
Quote in the paperSubstantial claim - Interpretationreasoning
Using the concatenation operation to aggregate the features of edges and nodes results in long and complex vectors, as it appends these features side-by-side without providing information about their interactions.
“This can be attributed to the fact that using the concatenation operation to aggregate the features of edges and nodes results in long and complex vectors, as this operator simply appends these features side-by-side without providing information about their interactions.”
Quote in the paperSubstantial claim - Premisenone given
The monoplex algorithm expresses all interactions as contemporaneous correlations between the univariate time series.
“On the other hand, since the monoplex algorithm expresses all interactions as contemporaneous correlations between the univariate time series, the representation of the sophisticated interactions of FD004 with this algorithm leads to the creation of a graph whose weighted edges are almost equal (i.e., close to unity).”
Quote in the paperSubstantial claim - Interpretationreasoning
The FD004 dataset contains more dynamic relationships and temporal dependencies than the FD001 dataset.
“Therefore, the FD004 dataset contains more dynamic relationships and temporal dependencies than the FD001 dataset.”
Quote in the paperSubstantial claim- Rests on an assumption: FD004 was simulated under six operating conditions and two fault modes, while FD001 was simulated under a single operating condition and a single fault mode.
- Premisereasoning
The unitary attention approach relies on computing attention scores by projecting each feature individually onto the learning matrix, treating each feature in isolation and not accounting for possible dependencies and interactions between features.
“In particular, the unitary attention approach relies on computing the attention scores by projecting each feature individually onto the learning matrix, which results in treating each feature in isolation from the others and does not take into account the possible dependencies and interactions between the features themselves.”
Quote in the paperSubstantial claim - Interpretationreasoning
GeAN overcomes the inherent temporal agnosticism of attention mechanisms for time-series learning by integrating temporal information directly into the core learning process of the attention mechanism.
“In addition to its main strengths, GeAN also overcomes one of the fundamental shortcomings of using attention mechanisms for time-series learning tasks: the inherent temporal agnosticism of these mechanisms.”
- Also stated in: § 3.2. Graph-Enhanced Attention Mehchanism · plain
“GeAN provides a more elegant solution by integrating the temporal information of the MTS directly into the core learning process of the attention mechanism itself.”
Quote in the paperSubstantial claim - Also stated in: § 3.2. Graph-Enhanced Attention Mehchanism · plain
- Interpretationreasoning
The moderate performance of these two models suggests that the segregation of the spatial and temporal extraction processes with different networks has a negative impact on the learning ability of the models.
“However, the moderate performance of these two models suggests that the segregation of the spatial and temporal extraction processes with different networks has a negative impact on the learning ability of the models.”
Quote in the paperSubstantial claim - Interpretationreasoning
GeAN is designed to incorporate the full temporal interactions embedded in edges and nodes into the learning process and express them concisely as accurate attention scores.
“GeAN is primarily designed to seamlessly incorporate the full temporal interactions embedded in edges and nodes into the learning process and express them concisely as accurate attention scores.”
Quote in the paperSubstantial claim - Interpretationreasoning
This can lead to the learning algorithm being confronted with a large amount of information that does not reflect the salient patterns of the graph structures or the underlying dataset they represent.
“This in turn can lead to the learning algorithm being confronted with a large amount of information that does not reflect the salient patterns of the graph structures or the underlying dataset they represent.”
Quote in the paperSubstantial claim - Interpretationreasoning
The outer product allows GeAN to capture complex interactions of edge and node features without being affected by their inherent heterogeneous semantics and information content.
“Firstly, the ability of the outer product to represent all pairwise interactions from different data types allows GeAN to capture complex interactions of edge and node features without being affected by their inherent heterogeneous semantics and information content.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The use of the bilinear model to combine the mutual associations of the features generated by the outer product provides an interactive learning approach that allows nodes and edges within a layer to modulate their features and consolidate them into concise spaces.
“Another strong aspect that leads to the exceptional performance of the GeAN mechanism is the use of the bilinear model to combine the mutual associations of the features generated by the outer product.Indeed, this model provides an interactive learning approach that allows the nodes and edges within a layer not only to modulate their features simultaneously from the perspective of the others but”
Quote in the paperSubstantial claim - Interpretationreasoning
The ability of visibility algorithms to reveal intrinsic behavior of underlying processes allows TVG to accelerate the learning process by emphasizing particular patterns of those processes.
“This in turn allows TVG to accelerate the learning process by emphasizing the particular patterns of the underlying processes.”
Quote in the paperSubstantial claim- Rests on an assumption: Visibility algorithms can reveal the intrinsic behavior of the underlying processes generating MTS observations, such as stochasticity, randomness, fractality, and periodicity.
- Interpretationreasoning
The graphs generated by the monoplex algorithm are not able to represent the important information of the MTS datasets in a way that is useful for the GeAN model.
“This behavior implies that the graphs generated by the monoplex algorithm are not able to represent the important information of the MTS datasets in a way that is useful for the GeAN model.”
Quote in the paperSubstantial claim - Interpretationreasoning
The sparse learning unit allows the model to amputate the edges and nodes whose contributions to the learning tasks are negligible.
“This incorporation allows the model to amputate the edges and nodes whose contributions to the learning tasks are negligible.”
Quote in the paperSubstantial claim - Interpretationown data
The exceptional results of TVGeAN compared to other work confirm the effectiveness and thoroughness of the underlying assumptions used to develop its components.
“The exceptional results of the proposed model (i.e., TVGeAN) compared to other work confirms the effectiveness and thoroughness of the underlying assumptions used to develop its components.”
Quote in the paperSubstantial claim - Interpretationnone given
The computational complexity of the proposed TVG model is O(KT^2), where K is the number of univariate time series forming the MTS and T is the number of its time points.
“It is interesting to note that the computational complexity of the proposed TVG model can be written as O KT 2 , where K is the number univariant time series forming MTS, and T is the number of its time points.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Reducing the noise in the original MTS dataset can lead to more informative graph structures from which the models can more easily identify the salient features.
“Reducing the noise in the original MTS dataset can lead to more informative graph structures from which the models can more easily identify the salient features.”
Quote in the paperNot a substantial claim - Interpretationnone given
TVGeAN is a novel graph auto-encoder model developed specifically for MTS learning tasks.
“This paper proposed TVGeAN, a novel graph auto-encoder model developed specifically for MTS learning tasks.”
Quote in the paperSubstantial claim - Study design and conductnone given
The performance of TVGeAN has been extensively evaluated from different perspectives in both supervised and unsupervised learning domains.
“The performance of the proposed model has been extensively evaluated from different perspectives in both supervised and unsupervised learning domains.”
Quote in the paperSubstantial claim - Interpretationreasoning
One of the main reasons for the high efficiency of TVGeAN is the incorporation of the sparse learning unit in its autoencoder architectures.
“One of the main reasons for the high efficiency of TVGeAN is the incorporation of the sparse learning unit in its autoencoder architectures.”
Quote in the paperSubstantial claim - Interpretationreasoning
Another important reason for the performance of TVGeAN is its adoption of the weight-sharing approach to derive attention scores across the different layers.
“Another important reason for the performance of TVGeAN is its adoption for the weight-sharing approach to derive attention scores across the different layers.”
Quote in the paperSubstantial claim - Interpretationreasoning
The dynamic graph approach usually has drawbacks such as the need to use additional modules to maintain the historical patterns extracted from the graphs as they evolve.
“However, this approach usually has some drawbacks, such as the need to use additional modules to maintain the historical patterns extracted from the graphs as they evolve.”
Quote in the paperSubstantial claim - Interpretationreasoning
The weight-sharing approach reduces the total number of parameters by reusing the same set of weighting matrices.
“This approach facilitates the reduction in the total number of parameters by reusing the same set of weighting matrices.”
Quote in the paperSubstantial claim
- May combine two claims. 39
- Classified as probably not a substantial claim. 54
May combine two claims.
InterpretationreasoningThe use of the TVG algorithm to map the MTS dataset into graphs eliminates the need to censor or truncate some parts of the MTS relationships, to rely on simplified metrics such as cosine similarity, or to patch the MTS.
“In particular, the use of the TVG algorithm to map the MTS dataset into graphs eliminates the need to censor or truncate some parts of the MTS relationships, as is the case with the constrained correlation approach used in [102]; to rely on simplified metrics such as cosine similarity, as is the case in [101]; or to patch the MTS, as is the case in [96].”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [102] Gao, 2024, Nonlinear slow-varying dynamics-assisted temporal graph transformer network for remaining useful life prediction, Reliab. Eng. Syst. Saf. source
- cites [101] Liang, 2023, Remaining useful life prediction via a deep adaptive transformer framework enhanced by graph attention network, Int. J. Fatigue source
- cites [96] Wang, Y., Xu, Y., Yang, J., Wu, M., Li, X., Xie, L., and Chen, Z. (2024, January 20–27). Fully-Connected Spatial-Temporal Graph for Multivariate Time-Series Data. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada. source
The FC Graph Construction section says the method segments each MTS sample into patches and uses a truncation operation to calculate their number. It also calls the dot product a simple metric for sensor similarity. These statements contradict the claim that the method avoids patching and simplified similarity metrics; the cited paper describes its method as FC-STGNN, not TVG. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
InterpretationcitationEdge weights in TVG are defined based on the visibility angle algorithm.
“the weights of the edges are defined based on the visibility angle algorithm [28].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [28] Supriya, 2016, Weighted visibility graph with complex network features in the detection of epilepsy, IEEE Access source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationGNN learning can be fine-tuned to extract features of individual time steps or variables, capture dynamic evolution of two MTS instances connected by edges, or interpret patterns of a subgraph.
“Indeed, the learning process of GNNs can be fine-tuned to extract the features of individual time steps or variables represented by vertices, to capture the dynamic evolution of two MTS instances connected by the edges, or to interpret the patterns of a part of the MTS represented by a subgraph [27].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [27] Wu, 2020, A comprehensive survey on graph neural networks, IEEE Trans. Neural Netw. Learn. Syst. source
The Frameworks section (p. 4) describes GNNs learning node representations and producing edge- and graph-level outputs; the Spatial-Temporal Graph Neural Networks section (p. 15) describes modeling dynamic inputs and dependencies between connected nodes. But the survey does not establish the claim’s specific mapping to MTS time steps, variables, and pairs of MTS instances, or say that GNNs interpret patterns in an MTS subgraph. (LLM, conf=0.85)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationMultiple-instance configurations lead to poor scalability, high intractability, and low interpretability and explainability.
“poor scalability, high intractability, and low interpretability and explainability [24,25].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [24] Samek, W., Wiegand, T., and Müller, K.-R. (2017). Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv. source
The Abstract (p. 1) describes deep learning models as black boxes that provide little information about how they reach predictions, supporting the concern about interpretability and explainability. The cited paper does not connect that concern to multiple-instance configurations or say that such configurations have poor scalability or high intractability; searches for those terms found no relevant passage. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [25] Ye, 2011, Time series shapelets: A novel technique that allows accurate, interpretable and fast classification, Data Min. Knowl. Discov. source
Section 2.1.1 says instance-based methods are generally less interpretable than rule-based methods and that a global-view time-series method loses efficiency on large-scale datasets. It also describes a particular pattern-search problem as intractable. These passages support aspects of the claimed drawbacks, but they do not establish that multiple-instance configurations generally have all three. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSpectral GNN models relax the assumption of known structure by using spectral graph theory.
“Spectral GNN models (e.g., refs.[69][70][71]), on the other hand, relax this assumption by utilizing the principles of spectral graph theory.”
Quote in the paperNot a substantial claim1 of 3 sources checked- cites [69] Cao, D., Wang, Y., Duan, J., Zhang, C., Zhu, X., Huang, C., Tong, Y., Xu, B., Bai, J., and Tong, J. (2020, January 6–12). Spectral temporal graph neural network for multivariate time-series forecasting. Proceedings of the Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Virtual. source
- cites [70] Bulut, 2023, Spectral temporal graph neural network for multivariate agricultural price forecasting, Ciência Rural.
Not checked in the free run.
- cites [71] Jin, M., Shi, G., Li, Y.F., Wen, Q., Xiong, B., Zhou, T., and Pan, S. (2023). How Expressive are Spectral-Temporal Graph Neural Networks for Time Series Forecasting?. arXiv.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationGAT's superior performance in processing large amounts of data in real-time has led to it becoming one of the most popular methods for designing aggregation functions in most modern GNNs.
“Although GNNs impose no constraints on the form of the aggregation function, the superior performance of the Graph Attention Network (GAT) [90] in processing large amounts of data in real-time has led to it becoming one of the most popular methods for designing aggregation functions in most modern GNNs.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [90] Veličković, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., and Bengio, Y. (2017). Graph attention networks. arXiv. source
The Results (p. 8) report strong benchmark performance, while Comparisons to Related Work (pp. 4–5) describes an efficient, parallelizable attention layer and a version that can run on larger graph datasets. The paper does not establish superior real-time processing of large amounts of data or show that GAT became a popular aggregation method in modern GNNs because of such performance. (LLM, conf=0.88)
Experimental — accuracy not yet measured
May combine two claims.
InterpretationreasoningComparing the results of [102] with those of [97,101], the model of [102] shows some improvement, which could be due to the parallel approach in that work.
“Comparing the results of [102] with those of [97,101], it can be seen that the model of [102] shows some improvement compared with these models, which could be due to the parallel approach in this work.”
Quote in the paperNot a substantial claim1 of 3 sources checked- cites [102] Gao, 2024, Nonlinear slow-varying dynamics-assisted temporal graph transformer network for remaining useful life prediction, Reliab. Eng. Syst. Saf. source
- cites [97] Ma, M., Wang, Z., and Zhong, Z. (2024). Transformer Encoder Enhanced by an Adaptive Graph Convolutional Neural Network for Prediction of Aero-Engines’ Remaining Useful Life. Aerospace, 11. source
The Results and Analysis section reports that AGCTE performs better than the compared methods on FD002 and FD004 and ranks first on average, though not on every subdataset. The Conclusions describe separate modules extracting spatial and temporal features relatively independently, but the paper does not attribute its improvement to a parallel approach; its Results and Analysis offer other possible explanations. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites [101] Liang, 2023, Remaining useful life prediction via a deep adaptive transformer framework enhanced by graph attention network, Int. J. Fatigue source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThis argument has been pointed out in several papers, where it is proposed to improve conventional graph attention mechanisms by projecting the concatenated features once onto the learning matrix.
“This argument has already been pointed out in several papers, e.g., in [91][92][93], where it is proposed to improve the performance of conventional graph attention mechanisms by projecting the concatenated features once onto the learning matrix.”
Quote in the paperNot a substantial claim3 of 3 sources checked- cites [91] Qiu, J., Tang, J., Ma, H., Dong, Y., Wang, K., and Tang, J. (2018, January 19–23). Deepinf: Social influence prediction with deep learning. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK. source
Section 3.2 (p. 4) describes attention computed from concatenated, transformed node features, so the source supports the claim’s reference to a concatenation-based graph-attention mechanism. It presents this as following Veličković et al., however, and does not propose projecting concatenated features once as an improvement over conventional GAT. Section 5.2 (p. 7) instead reports that the concatenation-based mechanism outperformed the alternative attention mechanisms the authors tried. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [92] Wang, G., Ying, R., Huang, J., and Leskovec, J. (2019). Improving graph attention networks with large margin-based constraints. arXiv. source
The Constrained Graph Attention Networks section (p. 4) proposes improving GAT through margin-based constraints and selective neighbor aggregation. The Analysis of GATs section (p. 2) describes concatenating transformed node features in the conventional attention function, but does not propose projecting concatenated features once onto a learning matrix as the improvement. (LLM, conf=0.88)
Experimental — accuracy not yet measured - cites [93] Brody, S., Alon, U., and Yahav, E. (2021). How attentive are graph attention networks?. arXiv. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSeveral GAT variants have been developed to overcome GAT limitations using strategies such as multi-headed attention, restricting aggregation to top-K neighbors, and reordering GAT operations.
“Some notable examples are the use of multi-headed attention mechanisms at each node of the GNN [91], the restriction of aggregation to the neighbors with the highest K-attention scores [92], and the reordering of GAT operations [93].”
Quote in the paperNot a substantial claim3 of 3 sources checked- cites [91] Qiu, J., Tang, J., Ma, H., Dong, Y., Wang, K., and Tang, J. (2018, January 19–23). Deepinf: Social influence prediction with deep learning. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK. source
- cites [92] Wang, G., Ying, R., Huang, J., and Leskovec, J. (2019). Improving graph attention networks with large margin-based constraints. arXiv. source
- cites [93] Brody, S., Alon, U., and Yahav, E. (2021). How attentive are graph attention networks?. arXiv. source
May combine two claims.
Premiseown dataThe architecture of [97] follows the design approach of [101] by using GAT to extract spatial features and multi-head self-attention to extract temporal features, with the exception that in [97] an adaptive embedding vector is added to each node within the GCN.
“A look at the architectures of this model shows that it follows the design approach of [101] by using GAT to extract the spatial features and multi-head self-attention to extract the temporal features, with the exception that in [97], an adaptive embedding vector is added to each node within the GCN.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [97] Ma, M., Wang, Z., and Zhong, Z. (2024). Transformer Encoder Enhanced by an Adaptive Graph Convolutional Neural Network for Prediction of Aero-Engines’ Remaining Useful Life. Aerospace, 11. source
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured - cites [101] Liang, 2023, Remaining useful life prediction via a deep adaptive transformer framework enhanced by graph attention network, Int. J. Fatigue source
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataTable 3 shows that some models such as [76,77,104,106] have adopted the principles of the dynamic graph approach to construct graphs at runtimes based on the dynamics represented in the MTSs.
“Table 3 also shows that some models such as [76,77,104,106] have adopted the principles of the dynamic graph approach to endow the DNN models with the ability to construct the graphs at runtimes based on the dynamics represented in the MTSs.”
Quote in the paperNot a substantial claim3 of 4 sources checked- cites [76] He, 2024, Efficiently localizing system anomalies for cloud infrastructures: A novel Dynamic Graph Transformer based Parallel Framework, J. Cloud Comput. source
- cites [77] Chen, K., Feng, M., and Wirjanto, T.S. (2023). Multivariate time series anomaly detection via dynamic graph forecasting. arXiv. source
Section 4.2 describes constructing dynamic correlation graphs from successive multivariate time-series segments, supporting the claim that this model represents changing relationships. But it says the similarity matrices are constructed before training, not that the DNN constructs graphs at runtime; our copy also does not establish the claim for all four cited models. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [104] Bajpai, S., Murthy, P.K., and Kumar, N. (2024, January 27–29). AnomGraphAdv: Enhancing Anomaly and Network Intrusion Detection in Wireless Networks Using Adversarial Training and Temporal Graph Networks. Proceedings of the 17th ACM Conference on Security and Privacy in Wireless and Mobile Networks, Seoul, Republic of Korea. source
- cites [106] Wu, Y., Gu, M., Wang, L., Lin, Y., Wang, F., and Yang, H. (2021). Event2graph: Event-driven bipartite graph for multivariate time-series anomaly detection. arXiv. source
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe modest improvement observed in models [99,100] is likely due to the noise reduction achieved by preprocessing.
“The modest improvement observed in these models is likely due to the noise reduction achieved by preprocessing.”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [99] Wen, Z., Fang, Y., Wei, P., Liu, F., Chen, Z., and Wu, M. (2024). Temporal and Heterogeneous Graph Neural Network for Remaining Useful Life Prediction. arXiv. source
The Comparative Analysis (page unavailable) reports improved predictive performance for THGNN, so the paper supports an improvement in the model's results. The Datasets section (page unavailable) mentions preprocessing and normalization, but neither it nor the performance analysis attributes the improvement to noise reduction; the paper also describes the improvement as significant rather than modest. (LLM, conf=0.78)
Experimental — accuracy not yet measured - cites [100] Huang, Z., He, Y., and Sick, B. (2023, January 13–15). Spatio-Temporal Attention Graph Neural Network for Remaining Useful Life Prediction. Proceedings of the 2023 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA. source
The clustering-normalization section (page unavailable) describes noise from unified normalization and more consistent sensor scales after cluster normalization. The Evaluation Metrics section reports improved RUL prediction with that preprocessing, supporting the proposed explanation. It calls the improvement significant, however, and reports gains of up to 26% in RMSE and 27% in Score, so describing it as modest does not accurately reflect the reported results. (LLM, conf=0.83)
Experimental — accuracy not yet measured
May combine two claims.
Findingown dataThe box plots of the GeAN mechanism are much closer to zero compared to the box plots of the other models, indicating higher prediction accuracy of GeAN.
“It can also be seen that the box plots of the GeAN mechanism are much closer to zero compared to the box plots of the other models, indicating the higher prediction accuracy of GeAN.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe results presented in Figure 5 show that the generalizability of the GeAN mechanism is more accurate and robust than other mechanisms.
“The results presented in Figure 5 show that the generalizability of the GeAN mechanism is more accurate and robust than other mechanisms.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningMxGeAN has a slower decay rate with lower error values than MnGeAN.
“The comparison of the error curves of MnGeAN with those of MxGeAN shows that the latter has a slower decay rate with lower error values.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataTVGeAN has an excellent learning curve, high generalizability, and superior performance compared to peer works.
“The results of this evaluation show that TVGeAN has an excellent learning curve, high generalizability, and superior performance compared to peer works.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn the FD004 and SMAP datasets, TVGeAN has the lowest FLOPs, the fastest inference time, and the least number of parameters compared to the other evaluated models.
“The results of this evaluation, as presented in Table 4, show that the proposed model, i.e., TVGeAN, has the lowest FLOPs, the fastest inference time, and the least number of parameters compared to the other models.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningTVG graphs preserve temporal dependencies within each univariate time series via tensor edges and mutual relationships between different time series at each time point via tensor nodes.
“This allows the graphs generated by the TVG algorithm to preserve the temporal dependencies within each univariate time series (via tensor edges) and the mutual relationships between different time series at each time point (via tensor nodes).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone givenEach node in TVG represents MTS observations at a particular time.
“Each node in the TVG represents the MTS observations at a particular time, while the weights of the edges are defined based on the visibility angle algorithm.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone givenTVG converts MTS into weighted temporal graphs where both nodes and edges are tensors.
“TVG which extend the capabilities of visibility graph algorithms in representing MTSs by converting them into weighted temporal graphs where both the nodes and the edges are tensors.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe KL divergence loss ensures consistency between the distributions of the encoder and decoder layers.
“while the KL divergence loss is used to ensure consistency between the distributions of the encoder and decoder layers.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenUse of TVG results in a weighted temporal graph that exactly matches the multidimensional nature of the MTS and preserves the full range of dynamics and relationships inherent in these series through a simple graph structure.
“The use of TVG results in a weighted temporal graph that exactly matches the multidimensional nature of the MTS and preserves the full range of dynamics and relationships inherent in these series through a simple graph structure.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenGNNs impose no restrictions on the type of computational units used at each node or edge.
“Another important advantage of using GNNs for MTS learning tasks is that GNNs impose no restrictions on the type of computational units used at each node or edge.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenSpectral GNNs have high computational complexity in both the time and frequency domains.
“However, this advantage is outweighed by the high computational complexity required to process MTS datasets in both the time and frequency domains.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone givenThe TVG is designed to strike a balance between the simplicity and completeness of MTS representation by defining node and edge features as tensors.
“The TVG is designed to strike a balance between the simplicity and completeness of the MTS representation by defining the features of nodes and edges as tensors.”
Quote in the paperSubstantial claimMay combine two claims.
PremisereasoningSummarizing complex relationships in MTS datasets as topological metrics may lose critical and nuanced patterns or bias models toward the selected metrics.
“Although this may offer some advantages in terms of reducing the dimensionality of the raw data, summarizing the complex relationships inherent in the MTS datasets as a set of topological metrics may result in a loss of critical and nuanced patterns, biasing the models towards the selected metrics, or even a combination of both.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenGNNs are compatible with inductive learning, enabling generalization from training to unseen data.
“Finally, the inherent compatibility of GNNs for inductive learning approaches enables the generalization of knowledge from the training phase to unseen data during the testing phase.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenThe main challenge of hierarchical GNNs is partitioning MTS datasets into hierarchical representations that preserve critical relationships and interactions.
“Although hierarchical GNNs can be effective in cases where an MTS has multiple levels of temporal and spatial granularity, the main challenge of this method is to partition the MTS datasets into hierarchical representations that can preserve their critical relationships and interactions.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationGNNs can incorporate information represented by vertices and edges into the learning process.
“One of the main advantages of using the GNN for processing MTS is its ability to incorporate the information represented by vertices and edges into the learning process.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [26] Scarselli, 2009, The Graph Neural Network Model, IEEE Trans. Neural Netw. source
Probably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone givenThe reconstruction loss allows the model to evaluate the closeness of reconstructed data to the original inputs.
“the reconstruction loss is used to allow the model to evaluate the closeness of the reconstructed data to the original inputs”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThrough regeneration, TVGeAN can capture the intrinsic behavior of MTS and learn from MTS datasets even if they are contaminated with noisy or inconsistent measurements.
“Through this regeneration process, TVGeAN can not only capture the intrinsic behavior of MTS but also learn from MTS datasets even if they are contaminated with noisy or inconsistent measurements.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe sparse loss encourages the model to learn from different graph structures.
“The sparse loss encourages the model to learn from different graph structures”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe decoder uses parameters generated by the stochastic layer to derive the prior distribution from which new graphs resembling the original input are generated.
“The decoder component then uses the parameters generated by the stochastic layer to derive the prior distribution, from which new graphs resembling the original input are generated.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone givenThe stochastic layer introduces randomness into the latent spaces so that the model can account for inherent uncertainty in the data during learning.
“The stochastic layer is used to introduce randomness into the latent spaces so that the model can account for the inherent uncertainty in the data during learning.”
Quote in the paperSubstantial claimMay combine two claims.
PremisereasoningUsing DNN architectures at GNN nodes increases computational complexity and potential scalability issues.
“However, this comes at the cost of increasing computational complexity and potential scalability issues, since both the temporal and spatial dependencies must be processed simultaneously.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningMonoplex and multiplex approaches are on opposite sides of the continuum of simplicity and completeness.
“The comparison of monoplex and multiplex approaches shows that they are on opposite sides of the continuum of simplicity and completeness.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningMultiplex methods preserve the full interactions of MTS but often lead to complicated graph structures and labyrinthine relationships.
“In contrast, creating separate layers for each time series, as in multiplex methods, can preserve the full interactions of MTS, but it often leads to complicated graph structures and labyrinthine relationships.”
Quote in the paperSubstantial claimMay combine two claims.
Premisenone givenDynamic GNNs require updating the graph structure during learning, which is computationally intensive and can increase the risk of model instability.
“However, the need to update the graph structure during the learning steps is not only very computationally intensive but can also increase the risk of model instability.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone givenThe variational learning unit endows TVGeAN with generative capabilities.
“and the variational learning unit is used to endow TVGeAN with generative capabilities.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone givenThe encoder converts given graphs into parameters of a variational posterior distribution that best fits the underlying distribution from which the data represented by the graphs were generated.
“The main purpose of the encoder is to convert the given graphs into a set of parameters of the variational posterior distribution that best fits the underlying distribution from which the data represented by the graphs were generated.”
Quote in the paperSubstantial claim- Rests on an assumption: The underlying distribution from which the data represented by the graphs were generated can be approximated by the variational posterior distribution.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenGAT was developed to overcome shortcomings that arise when features of all neighbors and edges are aggregated without considering their degree of importance.
“Essentially, GAT was developed to overcome the shortcomings that can arise when the features of all neighbors and edges are aggregated without considering their degree of importance, as is the case when using traditional aggregation functions such as averaging, mean/sum aggregation, or max/min pooling.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningSuch information overload limits stable and meaningful knowledge distillation during training and limits generalization of the knowledge gained for test patterns.
“Such information overload not only severely limits the achievement of stable and meaningful knowledge distillation during the training phases but also limits the generalization of the knowledge gained for test patterns.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe features of the graph generated by Monoplex have a high degree of multicollinearity, causing GeAN difficulty in recognizing subtle patterns and providing consistent results.
“This causes the features of the graph generated by Monoplex to have a high degree of multicollinearity, which in turn causes GeAN to experience difficulty in recognizing the subtle patterns and providing consistent results.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe evaluations in Sections 4.2 and 4.3 show the superiority of TVG and GeAN components in capturing knowledge in datasets and generalizing this knowledge to test datasets.
“These evaluations show the superiority of these two components in terms of their ability to capture the knowledge in the datasets and generalize this knowledge to test datasets.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThis comprehensive information enriches GeAN's learning process and enables it to gain insightful knowledge about the underlying relationships governing the MTS dataset, which in turn leads to a reduction in training errors over time.
“This comprehensive information enriches GeAN's learning process and enables it to gain insightful knowledge about the underlying relationships governing the MTS dataset, which in turn leads to a reduction in training errors over time.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenThe LeakyReLU activation function can effectively handle negative learnable weights by controlling the negative slope.
“Although this may lead to negative learnable weights, the LeakyReLU activation function, commonly used in attention mechanisms, can effectively handle these values by controlling the negative slope.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningUsing signed time differences allows GeAN to learn to distinguish between past and future behavior, improving understanding of the dynamic evolution of MTS datasets.
“By using signed time differences, GeAN can learn to distinguish between past and future behavior, which in turn improves the understanding of the dynamic evolution of the MTS datasets.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe outer product's ability to provide fine-grained quantification of interaction allows GeAN to derive an accurate attention score based on detailed information, which can improve predictive performance.
“Finally, the ability of the outer product to provide fine-grained quantification of the interaction allows the GeAN to derive an accurate attention score based on detailed information, which in turn can improve the predictive performance of the overall GeAN network.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Premisenone givenGeAN is based on the use of the outer product operation to manifest the pairwise features of edges and nodes and on the bilinear model to calculate the attention coefficient.
“Recall that GeAN is based on the use of the outer product operation to manifest the pairwise features of edges and nodes and on the bilinear model to calculate the attention coefficient.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningIn the case of anomalies, a higher anomaly ratio leads to poorer results, and vice versa.
“In the case of anomalies, a higher ratio leads to poorer results, and vice versa.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningAs a result, predictions fluctuate strongly even with small changes in the inputs, and they show high variability of the predicted values.
“As a result, the predictions fluctuate strongly, even with small changes in the inputs, and they show a high variability of the predicted values.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningPoor loss results cause GeAN to repeat learning cycles, leading to fluctuation of the error curves and preventing MnGeAN from approaching a stable learning curve.
“Thus, whenever GeAN attempts to acquire knowledge about the MTSs and their interactions in order to generate the latent features, the poor results of the loss function lead to a repetition of the learning cycles.This repetition leads to a fluctuation of the error curves and prevents MnGeAN from approaching a stable learning curve.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationown dataThe addition of an adaptive embedding vector to each node within the GCN can lead to some improvement in prediction performance.
“As can be seen, such addition can lead to some improvement in the prediction performance.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningThe high stability of TVGeAN on different datasets is due to the fact that the graphs generated by the TVG algorithm can represent the full spectrum of dynamic interactions in the MTS datasets via tensor structures.
“It is worth noting that the high stability of TVGeAN on different datasets is due to the fact that the graphs generated by the TVG algorithm can represent the full spectrum of dynamic interactions in the MTS datasets via the tensor structures.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningThis study proposes an adaptive approach based on determining the effective contributions of individual hidden states of nodes and edges to the performance of the whole network.
“This study proposes an adaptive approach based on determining the effective contributions of the individual hidden states of the nodes and edges to the performance of the whole network:”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenApplying the outer product operation to edge and node features leads to comprehensive maps that can represent all possible interactions of these features at a fine-grained level.
“More specifically, applying the outer product operation to the edge and node features leads to comprehensive maps that can represent all possible interactions of these features at a fine-grained level.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisereasoningThe multiplex algorithm provides comprehensive information about the MTS datasets and their interactions via multilayer graphs and the interlayer-mutual information modeling approach.
“These characteristics can be attributed to the fact that the multiplex algorithm provides comprehensive information about the MTS datasets and their interactions via multilayer graphs and the interlayer-mutual information modeling approach.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisereasoningAdapting existing attention mechanisms to MTS learning tasks remains a challenge because most were developed for time-agnostic graphs where edges typically have no temporal features and nodes represent categorical data.
“Nevertheless, adapting these attention mechanisms to MTS learning tasks remains a challenge, since most of these attention mechanisms have been developed for time-agnostic graphs, such as bibliometric or social networks, where the edges typically have no temporal features, and the nodes represent categorical data.”
Quote in the paperSubstantial claim- Rests on an assumption: Most existing attention mechanisms have been developed for time-agnostic graphs, such as bibliometric or social networks, where edges typically have no temporal features and nodes represent categorical data.
Probably not a substantial claim: may not pass S4 (based).
Premisenone givenOther GNN models employ a fixed length dimension reduction, with predefined weighting matrix dimensions that stay fixed during training and testing regardless of impact on prediction performance.
“It is of interest to mention that other GNN models employ a fixed length dimension reduction; that is, the dimensionality of the weighing matrix in each layer is predefined and stays fixed during the training and testing phase, regardless of its impact on the prediction performance.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningA 10-fold cross-validation strategy was used to ensure a comprehensive evaluation of all models.
“To ensure a comprehensive evaluation of all these models, the 10-fold cross-validation strategy was used.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThis simple yet comprehensive representation allows GeAN to effectively distil knowledge contained in different datasets and consolidate it during learning steps, driving convergence of TVGeAN models toward zero-error regions.
“This simple yet comprehensive representation allows the learning process (i.e., GeAN) to effectively distil the knowledge contained in the different datasets and firmly consolidate it during the learning steps, which in turn drives the convergence of the TVGeAN models towards the zero-error regions.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe TVG algorithm accurately captures the temporal dependencies inherent in the MTS dataset and represents them concisely as tensor edges and nodes.
“These characteristics can be attributed to the ability of the TVG algorithm to accurately capture the temporal dependencies inherent in the MTS dataset and represent them concisely as tensor edges and nodes.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningUsing such a map in the learning process allows GeAN to take into account the entire behavior of the underlying MTS dataset represented by the graphs in its predictions, leading to consistent results with low variability.
“Using such a map in the learning process allows the GeAN to take into account the entire behavior of the underlying MTS dataset represented by the graphs in its predictions.This in turn leads to consistent results with low variability represented as small box plots.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningTo ensure a fair comparison, three models were created for each dataset, each using one of the attention mechanisms, and all models were fed with the same graphs generated by the TVG algorithm and created using the same architecture.
“To ensure a fair comparison, three models were created for each dataset listed in Table 1, each of these models using one of the attention mechanisms listed above.All of these models, as well as the models using the GeAN mechanism described in Section 3.2, were fed with the same graphs generated by the TVG algorithm, and all of these models were created using the same architecture described in”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningTVG leads to more informative graphs than those generated by monoplex and less complexity compared to multiplex.
“This in turn leads to more informative graphs than those generated by monoplex and less complexity compared to multiplex.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningThe sparse learning unit alters nodes and/or edges within and across layers so that the model does not memorize the graph structure but learns specialized and discriminating features from nodes and/or edges.
“The main aim of this unit is to alter the nodes and/edges within and across the layers so that the model does not memorize the graph structure but rather encourage the model to learn the specialized and discriminating features from nodes and/or edges.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThrough the learning process, the parameter spaces of the bilinear model can be perfectly fitted to the inherent characteristics of the given MTS datasets, resulting in GeAN making predictions with zero or negligible errors and providing a box plot centered around the zero-error regions.
“Through the learning process, the parameter spaces of the bilinear model can be perfectly fitted to the inherent characteristics of the given MTS datasets, which in turn results in the GeAN making its predictions with zero or negligible errors and providing a box plot centered around the zero-error regions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
InterpretationreasoningDifferences between the error curves of the datasets (SMD, MSL, and SMAP) used to evaluate anomaly detection learning tasks can be interpreted in terms of their anomaly ratio.
“By the same argument, we can state that the differences between the error curves of the datasets (e.g., SMD, MSL, and SMAP) used to evaluate the anomaly detection learning tasks can be interpreted in terms of their anomaly ratio.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe outer product's ability to keep the representation space compact allows GeAN to process large features represented in dense graphs without compromising processing performance.
“Secondly, the outer product's ability to keep the representation space compact allows GeAN to process large features represented in dense graphs without compromising processing performance.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationown dataThe high variability in the performance readings of these GNN architectures shows the high sensitivity that design decisions have on these architectures.
“However, the high variability in the performance readings of these architectures shows the high sensitivity that the design decisions have on these architectures.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningCosine similarity's scale invariance and lack of consideration of the temporal relationship between different instances can impose limitations in representing complex nonlinear relationships and temporal dependencies of MTS at full resolution.
“While this metric can quantify the general shape and direction of time series, its scale invariance and lack of consideration of the temporal relationship between different instances can impose some limitations in representing complex nonlinear relationships and temporal dependencies of MTS at full resolution.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningOne possible reason for the modest performance of the model in [101] is the use of cosine similarity to define the connectivity of the graphs representing the MTS.
“One of the possible reasons for the modest performance of this model could be the use of cosine similarity to define the connectivity of the graphs representing the MTS.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [101] Liang, 2023, Remaining useful life prediction via a deep adaptive transformer framework enhanced by graph attention network, Int. J. Fatigue source
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
InterpretationreasoningThe main disadvantage of using external memory units in a DNN network is their negative impact on prediction delay, since all memory units of all nodes need to be synchronized at each learning step.
“The main disadvantage of using external memory units in a DNN network is their negative impact on the prediction delay, since all memory units of all nodes need to be synchronized at each learning step to ensure consistent prediction values.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningA reduction in the number of parameters leads to a reduction in the FLOPs requirement of the model and thus to a reduction in inference time.
“Such a reduction in the number of parameters leads to a reduction in the FLOPS requirement of the model and thus to a reduction in inference time.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe limitation of graph growth with data points has been overcome in this work by using autoencoder architectures with sparse learning units.
“Although this limitation has been overcome in this work by using autoencoder architectures with sparse learning units, our future research focuses on developing algorithms that can model MTS in graphs without being scaled up with their data points.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenWhile adversarial learning provides a powerful approach, it also comes with challenges and limitations such as low generalizability and stability.
“While adversarial learning provides a powerful approach, it also comes with some challenges and limitations, such as low generalizability and stability.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningIn addition to the overhead imposed by additional modules, inconsistency between predicted values generated by different modules requires the use of ensemble learning strategies.
“In addition to the overhead that may be imposed on the learning process by the additional modules, the inconsistency between the predicted values generated by different modules requires the use of ensemble learning strategies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThis can be at the expense of diluted or neglected nuanced information contained in the MTS dataset.
“However, this can be at the expense of diluted or neglected nuanced information contained in the MTS dataset.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe proportional growth of the diameter and relationships of the graphs generated by the TVG algorithm can be a limitation, especially when modeling very long and complex MTS datasets.
“The proportional growth of the diameter and relationships of the graphs generated by the TVG algorithm can be one of the possible limitations, especially when modeling very long and complex MTS datasets.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone givenTVGeAN utilizes an autoencoder architecture with sparse and variational learning units to enable both generative and inductive learning.
“Furthermore, TVGeAN utilizes the autoencoder architecture with sparse and variational learning units to enable both generative and inductive learning.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationown dataThe diversity of GNN architectures shown in Table 3 emphasizes the high adaptability that GNNs can offer in tackling different MTS learning tasks.
“The diversity of GNN architectures shown in Table 3 emphasizes the high adaptability that GNNs can offer in tackling different MTS learning tasks.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningBy amputating insignificant components, the model remains compact, which leads to a reduction in computational effort and inference time.
“By amputating insignificant components, the model remains compact, which in turn leads to a reduction in computational effort and inference time.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThis can weaken the representation power of the generated graph, which in turn impairs the ability of the model to capture the underlying characteristics of the MTS represented by the graphs.
“This can weaken the representation power of the generated graph, which in turn impairs the ability of the model to capture the underlying characteristics of the MTS represented by the graphs.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationAnother drawback of using dynamic GNN is the long training time required to achieve a stable learning environment.
“Another drawback of using dynamic GNN is the long training time required to achieve a stable learning environment [105].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [105] Xiong, 2024, SiET: Spatial information enhanced transformer for multivariate time series anomaly detection, Knowl.-Based Syst. source
Classified as probably not a substantial claim.
Interpretationnone givenGeAN is a new graph attention mechanism designed to integrate the temporal dependencies of MTS datasets into the model's learning process by automatically prioritizing the attention scores of graph nodes and edge features based on their temporal interactions.
“The second main component, GeAN, is a new graph attention mechanism that is primarily designed to seamlessly integrate the temporal dependencies of MTS datasets into the model's learning process by automatically prioritizing the attention scores of graph nodes and edge features based on their temporal interactions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe Tensor Visibility Graph (TVG) extends the capabilities of visibility graph algorithms to model MTS datasets by representing them as weighted temporal graphs where the nodes and edges are tensors.
“The first component of the proposed model, the Tensor Visibility Graph (TVG), extends the capabilities of visibility graph algorithms to model the MTS datasets by representing them as weighted temporal graphs where the nodes and edges are tensors.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The four MTS benchmarks used (C-MPASS, SMD, MSL, SMAP) are representative of MTS learning tasks.
“four widely cited MTS benchmarks for supervised and unsupervised learning tasks: C-MPASS [35], SMD [36], MSL, and SMAP [37]”
The paper relies on this without support.
The standard statistical metrics used (RMSE, precision, recall, F1) adequately capture performance on the MTS learning tasks.
“These evaluations are quantified using standard statistical metrics such as Root Mean Square Error (RMSE), precision, recall, and F1.”
The paper relies on this without support.
The underlying distribution from which the data represented by the graphs were generated can be approximated by the variational posterior distribution.
“The main purpose of the encoder is to convert the given graphs into a set of parameters of the variational posterior distribution that best fits the underlying distribution from which the data represented by the graphs were generated.”
The paper relies on this without support.
The environment from which MTSs are collected introduces variability or confounding factors.
“mitigating the effects of variability or confounding factors introduced by the environment from which MTSs are collected.”
The paper relies on this without support.
Visibility algorithms can reveal the intrinsic behavior of the underlying processes generating MTS observations, such as stochasticity, randomness, fractality, and periodicity.
“Another compelling reason for applying the visibility angle in TVG is the ability of visibility algorithms to reveal the intrinsic behavior of the underlying processes generating the MTS observations, such as stochasticity, randomness, fractality, and periodicity.”
The paper relies on this without support.
Most existing attention mechanisms have been developed for time-agnostic graphs, such as bibliometric or social networks, where edges typically have no temporal features and nodes represent categorical data.
“since most of these attention mechanisms have been developed for time-agnostic graphs, such as bibliometric or social networks, where the edges typically have no temporal features, and the nodes represent categorical data.”
The paper relies on this without support.
The features of nodes and edges in a graph provide different perspectives on the dynamics of the underlying process it represents.
“GeAN recognizes the fact that the features of nodes and edges in a graph provide different perspectives on the dynamics of the underlying process it represents.”
The paper relies on this without support.
FD004 was simulated under six operating conditions and two fault modes, while FD001 was simulated under a single operating condition and a single fault mode.
“These characteristics can be attributed to the fact that FD004 was simulated under six operating conditions and two fault modes, while the FD001 dataset was simulated under a single operating condition and a single fault mode.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Shared attention-matrix dimensions conflict with dimensional reduction
MajorThe attention matrices are fixed at dimensions based on K and shared by all layers, but the cross-layer matrix reduces feature dimensions after the first layer. The stated fixed-size matrices therefore cannot operate on the reduced features in subsequent layers as described.
“W 1 ∈ R K×1 and W 2 ∈ R K×K are the learnable weighting matrices that are shared by all layers of the proposed model”
“where W (1) ∈ R d (2) ×d (1) ; d (2) < d (l) is a cross-layer weighting matrix whose main goal is to provide a gradual dimensional reduction of the features space between subsequent layers.”
Figure 5 is described as both cross-validation boxplots and an epoch plot
MinorThe results text says Figure 5 contains boxplots of values recorded across testing folds, while its caption describes a metric plotted against the number of epochs.
“The normalized accuracy of all the models corresponding to all the datasets was recorded at the end of each testing phases and then visualized in a boxplot as shown in Figure 5.”
“Figure 5. Normalized RMAE vs. number of epochs for the seven datasets: (a) FD001, (b) FD002, (c) FD003, (d) FD004, (e) SMD, (f) MSL, (g) SMAP.”
Sampling formula does not produce the stated posterior variance
MinorEquation (8) specifies covariance σ2(G)I. With standard-normal noise, equation (9) multiplies the noise by σ2(G), producing covariance σ4(G)I instead.
“q ϕ (y|G) = N y; µ(G), σ 2 (G)I (8”
“z = µ(G) + σ 2 (G) ⊙ ϵ (9”
Near-zero values are called higher accuracy
MinorThe paper calls the Figure 5 values normalized accuracy, but then interprets values closer to zero as higher prediction accuracy. That interpretation fits an error metric, not accuracy.
“The normalized accuracy of all the models corresponding to all the datasets was recorded at the end of each testing phases”
“the box plots of the GeAN mechanism are much closer to zero compared to the box plots of the other models, indicating the higher prediction accuracy of GeAN.”
Total-loss equation equates sparse loss with itself plus other losses
MinorEquation (11) labels the total loss as L sparse, even though L sparse is already a component of that total. As written, the equation requires the weighted KL and reconstruction losses to sum to zero.
“L sparse = L sparse + βL KL + γL recon (11”
“Then, the total losses of the model can be expressed as follows:”
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N.-C., Tung, C. C., & Liu, H. H. (1998) · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rspa.1998.0193 · Cited by 23,707 · see citing works
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · see citing works
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · see citing works
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,938 · see citing works
Generalized Additive Models: An Introduction with R
Wood, S. N. (2017) · doi:10.1201/9781315370279 · Cited by 13,852 · see citing works
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212 · see citing works
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · see citing works
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · see citing works
Inductive Representation Learning on Large Graphs
Hamilton, W. L., Ying, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1706.02216 · Cited by 10,639 · see citing works
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582 · see citing works
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · see citing works
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17325 · Cited by 7,752 · see citing works
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · see citing works
New Introduction to Multiple Time Series Analysis
Lütkepohl, H. (2005) · Springer eBooks · doi:10.1007/978-3-540-27752-1 · Cited by 6,081 · see citing works
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655 · see citing works
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310 · see citing works
Wu, Y., & He, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_1 · Cited by 3,601 · see citing works
Wu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
Deep learning for time series classification: a review
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00619-1 · Cited by 3,342 · see citing works
Time Series Analysis by State Space Methods: Second Edition
Durbin, J., & Koopman, S. J. (2012) · doi:10.1093/acprof:oso/9780199641178.001.0001 · Cited by 3,301 · see citing works
Recurrent Neural Network RegularizationPreprint
Zaremba, W., Sutskever, I., & Vinyals, O. (2014) · arXiv.org · doi:10.48550/arxiv.1409.2329 · Cited by 3,086 · see citing works
Damage propagation modeling for aircraft engine run-to-failure simulation
Saxena, A., Goebel, K., Simon, D., & Eklund, N. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711414 · Cited by 1,954 · see citing works
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · see citing works
Inceptiontime: finding alexnet for time series classification
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D. F., Weber, J., Webb, G. I., Idoumghar, L., Muller, P.-A., & Petitjean, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00710-y · Cited by 1,788 · see citing works
Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771 · see citing works
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
Luo, W., Li, Y., Urtasun, R., & Zemel, R. (2017) · arXiv · doi:10.48550/arxiv.1701.04128 · Cited by 1,575 · see citing works
Villarraga Ossa, E. F. (2021) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 1,472 · see citing works
Multivariate LSTM-FCNs for time series classification
Karim, F., Majumdar, S., Darabi, H., & Harford, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.014 · Cited by 1,138 · see citing works
Efficient Learning of Sparse Representations with an Energy-Based Model
Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0147 · Cited by 1,106 · see citing works
Samek, W., Wiegand, T., & Müller, K.-R. (2017) · arXiv · doi:10.48550/arxiv.1708.08296 · Cited by 1,080 · see citing works
Neural Networks and Deep Learning
Aggarwal, C. (2018) · Cambridge International Law Journal · doi:10.1007/978-3-319-94463-0 · Cited by 932 · see citing works
Learning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879 · see citing works
Separating Style and Content with Bilinear Models
Tenenbaum, J. B., & Freeman, W. T. (2000) · Neural Computation · doi:10.1162/089976600300015349 · Cited by 840 · see citing works
How Attentive are Graph Attention Networks?
Brody, S., Alon, U., & Yahav, E. (2021) · arXiv · doi:10.48550/arxiv.2105.14491 · Cited by 789 · see citing works
Kim, J.-H., Jun, J., & Zhang, B.-T. (2018) · arXiv · doi:10.48550/arxiv.1805.07932 · Cited by 761 · see citing works
Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks
Zheng, Y., Liu, Q., Chen, E., Ge, Y., & Zhao, J. L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08010-9_33 · Cited by 689 · see citing works
Traffic Flow Prediction via Spatial Temporal Graph Neural Network
Wang, X., Ma, Y., Wang, Y., Jin, W., Wang, X., Tang, J., Jia, C., & Yu, J. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380186 · Cited by 644 · see citing works
DeepInf: Social Influence Prediction with Deep Learning
Qiu, J., Tang, J., Ma, H., Dong, Y., Wang, K., & Tang, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220077 · Cited by 587 · see citing works
Gated Feedback Recurrent Neural Networks
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.02367 · Cited by 583 · see citing works
Performance Evaluation of Deep Neural Networks Applied to Speech Recognition: RNN, LSTM and GRU
Shewalkar, A. N., Nyavanandi, D., & Ludwig, S. A. (2019) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2019-0006 · Cited by 578 · see citing works
Jin, M., Koh, H. Y., Wen, Q., Zambon, D., Alippi, C., Webb, G. I., King, I., & Pan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3443141 · Cited by 567 · see citing works
Machine learning advances for time series forecasting
Masini, R., Medeiros, M. C., & Mendes, E. F. (2021) · Journal of Economic Surveys · doi:10.1111/joes.12429 · Cited by 544 · see citing works
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2016) · arXiv · doi:10.48550/arxiv.1610.02357 · Cited by 538 · see citing works
Recurrence based time series analysis by means of complex network methods
DONNER, R. V., SMALL, M., DONGES, J. F., MARWAN, N., ZOU, Y., XIANG, R., & KURTHS, J. (2011) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127411029021 · Cited by 423 · see citing works
Time series shapelets: a novel technique that allows accurate, interpretable and fast classification
Ye, L., & Keogh, E. (2011) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0179-5 · Cited by 406 · see citing works
Predicting the present with Bayesian structural time series
Scott, S. L., & Varian, H. R. (2014) · International Journal of Mathematical Modelling and Numerical Optimisation · doi:10.1504/ijmmno.2014.059942 · Cited by 395 · see citing works
A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal
Liang, K., Meng, L., Liu, M., Liu, Y., Tu, W., Wang, S., Zhou, S., Liu, X., Sun, F., & He, K. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3417451 · Cited by 395 · see citing works
Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting
Cao, D., Wang, Y., Duan, J., Zhang, C., Zhu, X., Huang, C., Tong, Y., Xu, B., Bai, J., Tong, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.07719 · Cited by 388 · see citing works
Complex network-based time series analysis
Yang, Y., & Yang, H. (2007) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2007.10.055 · Cited by 368 · see citing works
Long sequence time-series forecasting with deep learning: A survey
Chen, Z., Ma, M., Li, T., Wang, H., & Li, C. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101819 · Cited by 359 · see citing works
Time Series Prediction Based on LSTM-Attention-LSTM Model
Wen, X., & Li, W. (2023) · IEEE Access · doi:10.1109/access.2023.3276628 · Cited by 346 · see citing works
Computing receptive fields of convolutional neural networks
Araujo, A., Norris, W., & Sim, J. (2019) · Distill · doi:10.23915/distill.00021 · Cited by 312 · see citing works
Multi-dimensional Recurrent Neural Networks
Graves, A., Fernández, S., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74690-4_56 · Cited by 303 · see citing works
Zheng, Y., Liu, Q., Chen, E., Ge, Y., & Zhao, J. L. (2015) · Frontiers of Computer Science · doi:10.1007/s11704-015-4478-2 · Cited by 273 · see citing works
Network structure of multivariate time series
Lacasa, L., Nicosia, V., & Latora, V. (2015) · Scientific Reports · doi:10.1038/srep15508 · Cited by 252 · see citing works
Weighted visibility graph with complex network features in the detection of epilepsy
Supriya, S., Siuly, S., Wang, H., Cao, J., & Zhang, Y. (2016) · IEEE Access · doi:10.1109/access.2016.2612242 · Cited by 216 · see citing works
Generalized Forecast Error Variance Decomposition for Linear and Nonlinear Multivariate Models
Lanne, M., & Nyberg, H. (2016) · Oxford Bulletin of Economics and Statistics · doi:10.1111/obes.12125 · Cited by 187 · see citing works
ConsisRec: Enhancing GNN for Social Recommendation via Consistent Neighbor Aggregation
Yang, L., Liu, Z., Dou, Y., et al. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463028 · Cited by 176 · see citing works
Fully-Connected Spatial-Temporal Graph for Multivariate Time Series Data
Wang, Y.-C., Xu, Y., Yang, J., Wu, M., Li, X.-L., Xie, L.-H., & Chen, Z. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2309.05305 · Cited by 175
Customer segmentation of multiple category data in e-commerce using a soft-clustering approach
Wu, R.-S., & Chou, P.-H. (2010) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2010.11.002 · Cited by 159 · see citing works
Multivariate Time Series Analysis and Applications
Wei, W. W. S. (2019) · Wiley series in probability and statistics · doi:10.1002/9781119502951 · Cited by 151 · see citing works
Fan, J., Bai, J., Li, Z., Ortiz‐Bobea, A., & Gomes, C. P. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21444 · Cited by 134 · see citing works
Fully-Connected Spatial-Temporal Graph for Multivariate Time-Series Data
Wang, Y., Xu, Y., Yang, J., Wu, M., Li, X., Xie, L., & Chen, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29500 · Cited by 134 · see citing works
Lazcano, A., Herrera, P. J., & Monge, M. (2023) · Mathematics · doi:10.3390/math11010224 · Cited by 114 · see citing works
Financial time series forecasting with deep learning : A systematic literature review: 2005–2019
Sezer, Ö. B., Gudelek, M. U., & Ozbayoglu, A. M. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106181 · Cited by 112 · see citing works
Constructing ordinal partition transition networks from multivariate time series
Zhang, J.-Y., Zhou, J., Tang, M., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-08245-x · Cited by 111 · see citing works
Geometric detection of coupling directions by means of inter-system recurrence networks
Feldhoff, J. H., Donner, R. V., Donges, J. F., et al. (2012) · Physics Letters A · doi:10.1016/j.physleta.2012.10.008 · Cited by 109 · see citing works
Liang, P., Li, Y., Wang, B., Yuan, X., & Zhang, L. (2023) · International Journal of Fatigue · doi:10.1016/j.ijfatigue.2023.107722 · Cited by 101 · see citing works
Song, Y., Xin, R., Chen, P., Zhang, R., Chen, J., & Zhao, Z. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.03.020 · Cited by 100 · see citing works
Advanced LSTM: A Study About Better Time Dependency Modeling in Emotion Recognition
Tao, F., & Liu, G. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461750 · Cited by 98 · see citing works
Yang, J., Wang, K., Peng, X., & Qiao, Y. (2018) · Proceedings of the 20th ACM International Conference on Multimodal Interaction · doi:10.1145/3242969.3264981 · Cited by 79 · see citing works
Zhou, L., & Wang, H. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102462 · Cited by 77 · see citing works
Graph neural networks for multivariate time series regression with application to seismic data
Bloemheuvel, S., van den Hoogen, J., Jozinović, D., Michelini, A., & Atzmueller, M. (2023) · International Journal of Data Science and Analytics · doi:10.1007/s41060-022-00349-6 · Cited by 75 · see citing works
He, H., Li, X., Chen, P., Chen, J., Liu, M., & Wu, L. (2024) · Journal of Cloud Computing · doi:10.1186/s13677-024-00677-x · Cited by 62 · see citing works
Improving Graph Attention Networks with Large Margin-based Constraints
Wang, G., Ying, R., Huang, J., & Leskovec, J. (2019) · arXiv · doi:10.48550/arxiv.1910.11945 · Cited by 61 · see citing works
A Host-Based Anomaly Detection Framework Using XGBoost and LSTM for IoT Devices
Wang, X., & Lu, X. (2020) · Wireless Communications and Mobile Computing · doi:10.1155/2020/8838571 · Cited by 56 · see citing works
Wang, Y., Wu, M., Li, X., Xie, L., & Chen, Z. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3241896 · Cited by 56 · see citing works
Can GNN be Good Adapter for LLMs?
Huang, X., Han, K., Yang, Y., Bao, D., Tao, Q., Chai, Z., & Zhu, Q. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645627 · Cited by 52 · see citing works
Multi-Dimensional Recurrent Neural NetworksPreprint
Graves, A., Fernandez, S., & Schmidhuber, J. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0705.2011 · Cited by 48 · see citing works
Gao, Z., Jiang, W., Wu, J., Dai, T., & Zhu, H. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110162 · Cited by 45 · see citing works
SEHIDS: Self Evolving Host-Based Intrusion Detection System for IoT Networks
Baz, M. (2022) · Sensors · doi:10.3390/s22176505 · Cited by 43 · see citing works
Self-citationMultiplex visibility graphs to investigate recurrent neural network dynamics
Bianchi, F. M., Livi, L., Alippi, C., & Jenssen, R. (2017) · Scientific Reports · doi:10.1038/srep44037 · Cited by 41 · see citing works
Multivariable time series forecasting using model fusion
Wang, R., Pei, X., Zhu, J., Zhang, Z., Huang, X., Zhai, J., & Zhang, F. (2022) · Information Sciences · doi:10.1016/j.ins.2021.11.025 · Cited by 39 · see citing works
When Recurrent Models Don't Need To Be RecurrentPreprint
Miller, J., & Hardt, M. (2018) · arXiv.org · doi:10.48550/arxiv.1805.10369 · Cited by 38 · see citing works
Temporal and Heterogeneous Graph Neural Network for Remaining Useful Life Prediction
Wen, Z., Fang, Y., Wei, P., Liu, F., Chen, Z., & Wu, M. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3592788 · Cited by 34 · see citing works
SiET: Spatial information enhanced transformer for multivariate time series anomaly detection
Xiong, W., Wang, P., Sun, X., & Wang, J. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111928 · Cited by 32 · see citing works
Univariate time series classification using information geometry
Sun, J., Yang, Y., Liu, Y., Chen, C., Rao, W., & Bai, Y. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.05.040 · Cited by 31 · see citing works
Constructing networks from a dynamical system perspective for multivariate nonlinear time series
Nakamura, T., Tanizawa, T., & SMALL, M. P. (2016) · Physical review. E · doi:10.1103/physreve.93.032323 · Cited by 29 · see citing works
Jin, M., Koh, H. Y., Wen, Q., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.03759 · Cited by 29 · see citing works
A novel graph attention adversarial network for predicting disease-related associations
Zhang, J., Jiang, Z., Hu, X., et al. (2020) · Methods · doi:10.1016/j.ymeth.2020.05.010 · Cited by 27 · see citing works
Improving chemical reaction yield prediction using pre-trained graph neural networks
Han, J., Kwon, Y., Choi, Y.-S., & Kang, S. (2024) · Journal of Cheminformatics · doi:10.1186/s13321-024-00818-z · Cited by 26 · see citing works
SAST-GNN: A Self-Attention Based Spatio-Temporal Graph Neural Network for Traffic Prediction
Xie, Y. F., Xiong, Y., & Zhu, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59410-7_49 · Cited by 22 · see citing works
A dynamic customer segmentation approach by combining LRFMS and multivariate time series clustering
Wang, S., Sun, L., & Yu, Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-68621-2 · Cited by 22 · see citing works
Structured Receptive Fields in CNNs
Jacobsen, J.-H., van Gemert, J. C., Lou, Z., & Smeulders, A. W. M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.286 · Cited by 22 · see citing works
Ma, M., Wang, Z., & Zhong, Z. (2024) · Aerospace · doi:10.3390/aerospace11040289 · Cited by 18 · see citing works
Pattern interdependent network of cross-correlation in multivariate time series
Ren, H., Yuan, Q., Semba, S., et al. (2020) · Physics Letters A · doi:10.1016/j.physleta.2020.126781 · Cited by 14 · see citing works
GLSTM-DTA: Application of Prediction Improvement Model Based on GNN and LSTM
Liang, Y., Jiang, S., Gao, M., et al. (2022) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2219/1/012008 · Cited by 12 · see citing works
Mining Novel Multivariate Relationships in Time Series Data Using Correlation Networks
Agrawal, S., Steinbach, M. S., Boley, D. L., et al. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2911681 · Cited by 11 · see citing works
Spatio-Temporal Attention Graph Neural Network for Remaining Useful Life Prediction
Huang, Z., He, Y., & Sick, B. (2023) · 2023 International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci62032.2023.00022 · Cited by 10 · see citing works
Multivariate Time Series Anomaly Detection via Dynamic Graph Forecasting
Chen, K., Feng, M., & Wirjanto, T. S. (2023) · arXiv · doi:10.48550/arxiv.2302.02051 · Cited by 10 · see citing works
Node Masking: Making Graph Neural Networks Generalize and Scale Better
Mishra, P., Piktus, A., Goossen, G., & Silvestri, F. (2020) · arXiv · doi:10.48550/arxiv.2001.07524 · Cited by 8 · see citing works
Event2Graph: Event-driven Bipartite Graph for Multivariate Time-series Anomaly Detection
Wu, Y., Gu, M., Wang, L., Lin, Y., Wang, F., & Yang, H. (2021) · arXiv · doi:10.48550/arxiv.2108.06783 · Cited by 6 · see citing works
Spectral temporal graph neural network for multivariate agricultural price forecasting
Özden, C., & Bulut, M. (2023) · Ciência Rural · doi:10.1590/0103-8478cr20220677 · Cited by 5 · see citing works
Multilayer quantile graph for multivariate time series analysis and dimensionality reduction
Silva, V. F., Silva, M. E., Ribeiro, P., et al. (2024) · International Journal of Data Science and Analytics · doi:10.1007/s41060-024-00561-6 · Cited by 5 · see citing works
Time Series for Data Scientists
Sanchez, J. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108942812 · Cited by 4 · see citing works
Multi-robot Path Planning Based on Spatio-Temporal Information in Large-scale Unknown Environment
Ding, J., Zhang, L., & Cheng, J. (2021) · 2021 27th International Conference on Mechatronics and Machine Vision in Practice (M2VIP) · doi:10.1109/m2vip49856.2021.9665033 · Cited by 3 · see citing works
Bajpai, S., Krishna Murthy, P., & Kumar, N. (2024) · Proceedings of the 17th ACM Conference on Security and Privacy in Wireless and Mobile Networks · doi:10.1145/3643833.3656130 · Cited by 3 · see citing works
Introduction to correlation networks: Interdisciplinary approaches beyond thresholding
Masuda, N., Boyd, Z. M., Garlaschelli, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2311.09536
Multilayer Horizontal Visibility Graphs for Multivariate Time Series Analysis
Silva, V. F., Silva, M. E., Ribeiro, P., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.02333
Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecasting
Jin, M., Shi, G., Li, Y.-F., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.06587
Temporal and Heterogeneous Graph Neural Network for Remaining Useful Life Prediction
Wen, Z., Fang, Y., Wei, P., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.04336
Predicting the Present with Bayesian Structural Time Series
Scott, S. L., & Varian, H. R. (2013) · doi:10.2139/ssrn.2304426
Flagged first, then by citations
Research works printed but not linked: 4
- Zaremba, W., Sutskever, I., and Vinyals, O. (2014). Recurrent neural network regular-ization. arXiv.
- Miller, J., and Hardt, M. (2018). Stable recurrent models. arXiv.
- Zhang, Y., and Yan, J. (2023, January 1–5). Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting. Proceedings of the Eleventh International Conference on Learning Representations, Kigali, Rwanda.
- Masuda, N., Boyd, Z.M., Garlaschelli, D., and Mucha, P.J. (2023). Correlation networks: Interdisciplinary approaches beyond thresholding. arXiv, Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8572131/.
Cited by
Sorted by citations
Al-Ahmad, B. I., Alzaqebah, A., Alkhawaldeh, R. S., Al-Zoubi, A. M., Lo, H., & Ali, A. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3087 · Cited by 3 · see citing works
“Transformer-based models are powerful, however because of their complexity and extensive number of parameters, they typically need a lot more data to train ef fi ciently ( Wu et al., 2019 , 2021 ; Baz, 2024 ).”
- Authors
- Baz, M.
- Affiliations
- Taif University (SA)
- Corresponding author
- Baz, Mohammed
- ORCID
- Baz, Mohammed
- Venue
- Mathematics
- Publisher
- MDPI AG
- Published
- 2024-10-23
- Volume
- 12
- Issue
- 21
- Pages
- 3320
- ISSN
- 2227-7390 (ISSN-L)
- OpenAlex
- W4403682526
- Semantic Scholar
- 373e9b13cdc7702925fd2a79ba70d59cde3c3aa7
- Cited by
- 1
- References
- 87
- Citations by year
- 2025: 1
- FWCI
- 0.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Mathematics (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Taif University (TU-DSPP-2024-143)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Engineering › Building and Construction › Traffic Prediction and Management Techniques
- Keywords
- multivariate time series, graph attention mechanism, graph autoencoder, dynamic graphs, sparse learning, variational learning, anomaly detection, time series regression, graph neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-21.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-21.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review