Cited by 120Machine Fault Diagnosis TechniquesReliability and Maintenance OptimizationPower Transformer Diagnostics and Insulation

Convolutional transformer: An enhanced attention mechanism architecture for remaining useful life estimation of bearings

Ding, Yifei, Jia, Minping·2022·IEEE Transactions on Instrumentation and Measurement

Abstract

Nowadays, deep learning (DL) methods for prognostic and health management (PHM) have vastly broadened the scope of applications in this field. Numerous approaches based on deep neural networks have been presented and applied to the remaining useful life (RUL) estimation of bearings. However, few of these methods are yet fully competent for the task of extracting degradation-related information from raw signals both locally and globally. To fill this research gap, we proposed a novel convolutional Transformer (CoT) which combines the global context capturing of attention mechanism with the local dependencies modeling of convolutional operation. Specifically, we designed a multi-scale convolutional (MSC) module with Swish activation for Transformer architecture to embed local feature learning into global sequence modeling. Our CoT fuses intra-token convolution and inter-token self-attention operations to enable simultaneous extraction of local dependencies and global interactions from the raw temporal signal into a trainable class token. Then, an end-to-end RUL estimation framework based on CoT is presented, which provides a mapping from raw vibration signals to estimated RULs. Finally, comprehensive case studies, including comparative studies and ablation experiments, fully validate the effectiveness and advancements of our CoT-based RUL estimation method.

Integrity signals

Registry

Crossref · 10.1109/tim.2022.3181933

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Recent advancements in supervised learning focus on sophisticated loss functions and regularization techniques to enhance performance and generalization, ensuring robustness across tasks and data types.

    “Recent advancements have focused on developing sophisticated loss functions and regularization techniques, aimed at enhancing the performance and generalization capabilities of supervised learning models, ensuring they remain robust and effective across a wide range of tasks and data types [166], [167], [168].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Ding, Y., & Jia, M.
Affiliations
Southeast University (CN)
Venue
IEEE Transactions on Instrumentation and Measurement
Published
2022
Volume
71
Pages
1-10
ISSN
  • 0018-9456 (ISSN-L)
  • 1557-9662
OpenAlex
W4285186957
Cited by
120
References
38
Citations by year
2026: 18 · 2025: 39 · 2024: 39 · 2023: 21 · 2022: 3
FWCI
10.28
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Instrumentation and Measurement (publishedVersion)
Funders
  • National Natural Science Foundation of China (52075095)
  • Postgraduate Research and Practice Innovation Program of Jiangsu Province (KYCX21_0082)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Power Transformer Diagnostics and Insulation
Keywords
remaining useful life prediction, bearings, convolutional transformer, attention mechanism, multi-scale convolution, self-attention, vibration signals, degradation modeling, prognostics and health management, class token, local and global feature extraction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review