Cited by 37Machine Fault Diagnosis TechniquesReliability and Maintenance OptimizationFault Detection and Control Systems

Temporal and Heterogeneous Graph Neural Network for Remaining Useful Life Prediction

Open access
Wen, Zhihao, Fang, Yuan, Wei, Pengcheng, Liu, Fayao, Chen, Zhenghua, Wu, Min·2025·IEEE Transactions on Neural Networks and Learning Systems

Abstract

Predicting remaining useful life (RUL) plays a crucial role in the prognostics and health management of industrial systems that involve a variety of interrelated sensors. Given a constant stream of time-series sensory data from such systems, deep learning (DL) models have risen to prominence at identifying complex, nonlinear temporal dependencies in these data. In addition to the temporal dependencies of individual sensors, spatial dependencies emerge as important correlations among these sensors, which can be naturally modeled by a temporal graph that describes time-varying spatial relationships. However, the majority of existing studies have relied on capturing discrete snapshots of this temporal graph, a coarse-grained approach that leads to a loss of temporal information. Moreover, given the variety of heterogeneous sensors, it becomes vital that such inherent heterogeneity is leveraged for RUL prediction in temporal sensor graphs. To capture the nuances of the temporal and spatial relationships and heterogeneous characteristics in an interconnected graph of sensors, we introduce a novel model named temporal and heterogeneous graph neural networks (THGNNs). Specifically, THGNN aggregates historical data from neighboring nodes to accurately capture the temporal dynamics and spatial correlations within the stream of sensor data in a fine-grained manner. Moreover, the model leverages feature-wise linear modulation (FiLM) to address the diversity of sensor types, significantly improving the model's capacity to learn the heterogeneity in the data sources. Finally, we have validated the effectiveness of our approach through comprehensive experiments. Our empirical findings demonstrate significant advancements on the N-CMAPSS dataset, achieving improvements of up to 19.2% and 31.6% in terms of two different evaluation metrics over state-of-the-art methods.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tnnls.2025.3592788

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The modest improvement observed in models [99,100] is likely due to the noise reduction achieved by preprocessing.

    “The modest improvement observed in these models is likely due to the noise reduction achieved by preprocessing.”

    From TVGeAN: Tensor Visibility Graph-Enhanced Attention Network for Versatile Multivariant Time Series Learning Tasks (2024) · cites this paper as [99]

    The Comparative Analysis (page unavailable) reports improved predictive performance for THGNN, so the paper supports an improvement in the model's results. The Datasets section (page unavailable) mentions preprocessing and normalization, but neither it nor the performance analysis attributes the improvement to noise reduction; the paper also describes the improvement as significant rather than modest. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 12

  1. P. Goyal, N. Kamra, X. He, and Y. Liu, "Dyngem: Deep embedding method for dynamic graphs," arXiv preprint arXiv:1805.11273, 2018. · arXiv
  2. A. Sankar, Y. Wu, L. Gou, W. Zhang, and H. Yang, "Dysat: Deep neural representation learning on dynamic graphs via self-attention networks," in Proceedings of the 13th international conference on web search and data mining, 2020, pp. 519-527.
  3. D. Xu, C. Ruan, E. Korpeoglu, S. Kumar, and K. Achan, "Inductive repre- sentation learning on temporal graphs," arXiv preprint arXiv:2002.07962, 2020. · arXiv
  4. H. Mei and J. M. Eisner, "The neural hawkes process: A neurally self- modulating multivariate point process," NeurIPS, vol. 30, 2017.
  5. H. Wu, J. Xu, J. Wang, and M. Long, "Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting," NeurIPS, vol. 34, pp. 22 419-22 430, 2021.
  6. L. Bai, L. Yao, C. Li, X. Wang, and C. Wang, "Adaptive graph convolutional recurrent network for traffic forecasting," ArXiv, 2020.
  7. L. Zhao, Y. Song, C. Zhang, Y. Liu, P. Wang, T. Lin, M. Deng, and H. Li, "T-gcn: A temporal graph convolutional network for traffic prediction," IEEE TITS, vol. 21, pp. 3848-3858, 2018.
  8. D. Ha, A. M. Dai, and Q. V. Le, "Hypernetworks," in ICLR, 2017.
  9. K. Xu, J. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhudinov, R. Zemel, and Y. Bengio, "Show, attend and tell: Neural image caption generation with visual attention," in International conference on machine learning. PMLR, 2015, pp. 2048-2057.
  10. Y. Zhang and J. Yan, "Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting," in ICLR, 2022.
  11. T. Kim, J. Kim, Y. Tae, C. Park, J.-H. Choi, and J. Choo, "Reversible instance normalization for accurate time-series forecasting against distribution shift," in ICLR, 2022.
  12. Zhenghua Chen received the B.Eng. degree in mechatronics engineering from University of Electronic Science and Technology of China (UESTC), Chengdu, China, in 2011, and Ph.D. degree in electrical and electronic engineering from Nanyang Technological University (NTU), Singapore, in 2017. He has been working at NTU as a research fellow. Currently, he is a scientist at Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), Singapore. He has won several competitive awards, such as First Place Winner for CVPR 2021 UG2+ Challenge, A*STAR Career Development Award, First Runner-Up Award for Grand Challenge at IEEE VCIP 2020, Finalist Academic Paper Award at IEEE ICPHM 2020, etc. He serves as Associate Editor for Elsevier Neurocomputing and Guest Editor for IEEE Transactions on Emerging Topics in Computational Intelligence. He is currently the Vice Chair of IEEE Sensors Council Singapore Chapter and IEEE Senior Member. His research interests include smart sensing, data analytics, machine learning, transfer learning and related applications.

Cited by

Sorted by citations

Authors
Wen, Z., Fang, Y., Wei, P., Liu, F., Chen, Z., & Wu, M.
Affiliations
  • Singapore Management University (SG)
  • Singapore University of Technology and Design (SG)
  • Agency for Science, Technology and Research (SG)
Venue
IEEE Transactions on Neural Networks and Learning Systems
Published
2025-11
Volume
36
Issue
11
Pages
19748-19761
ISSN
  • 2162-237X (ISSN-L)
  • 2162-2388
OpenAlex
W4412837103
Cited by
34
References
61
Citations by year
2026: 21 · 2025: 11 · 2024: 2
FWCI
11.75
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
  • Agency for Science, Technology and Research (A*STAR) through its AME Programmatic Funds (A20H6b0151)
  • Ministry of Education, Singapore, through its Academic Research Fund Tier 2 (T2EP20122-0041)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
  • Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
Keywords
remaining useful life prediction, temporal graph neural networks, heterogeneous graph neural networks, prognostics and health management, sensor time series, spatial dependence, feature-wise linear modulation, N-CMAPSS

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review