A Lightweight SHM Framework Based on Adaptive Multisensor Fusion Network and Multigeneration Knowledge Distillation
The DOI matches its Crossref record; 53 of the 55 references it cites were found in a registry or an index.
Abstract
Structural health monitoring (SHM) technology is of great importance to ensure the long-term and reliable operation of engineering structures. The monitoring systems for large structures are characterized by large numbers of measurement points and complex signal. In recent years, deep learning has been widely used in many fields, such as intelligent fault diagnosis and health monitoring due to its excellent feature extraction and nonlinear fitting ability. However, the existing deep networks for condition monitoring have some drawbacks. First, the multisensor information fusion is rarely considered, which is quite common in SHM systems. Second, most of the proposed models by current research are with large parameters and high complexity. To solve the problems mentioned above, we propose a lightweight SHM framework suitable for the multisensor monitoring tasks. In other words, the adaptive multisensor fusion network (ASF-Net) is proposed to dynamically mix with multichannel input samples and extract the efficient feature on different scales. Moreover, a joint loss function is established for network compression by transferring the knowledge from bulky teacher network to lightweight student network. Finally, to reduce the performance degradation during model compression, a multigeneration knowledge distillation (MGKD) strategy is proposed. The experiments on two SHM datasets show that the proposed method can achieve excellent classification accuracy, and model performance degradation of less than 2% can be obtained with at most 40.24 times less parameters and 128.82 times less computation, which has a great prospect on resource-constrained platforms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In the studied literature, vibration-based SHM is mainly used in crack [109], brace damage [110,111,112], bolt loosening [113,114], and stiffness reduction [115,116] detection.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [114]
Citations
Cites
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · cited 3×
“For Xception on the QUGS dataset, the Flops and Param are 2.82 and 3.56 times larger with 6.54% lower result.”
BackgroundMethodInfluentialDistilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201 · cited 2×
“To further illustrate the advantages of the proposed network compared with other neural networks, several commonly used networks are selected for comparison, including lightweight networks MobileNet [48], ShuffleNet [49], SqueezeNet [50], Xcep-tion [42], and our previously proposed WDCNN [51].”
BackgroundLarge-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · cited 1×
“The stochastic gradient descent (SGD) [47] is applied for the network parameters optimization.”
MethodFitNets: Hints for Thin Deep Nets
Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.6550 · Cited by 2,859
Zagoruyko, S., & Komodakis, N. (2016) · arXiv · doi:10.48550/arxiv.1612.03928 · Cited by 2,027
The discrete wavelet transform: wedding the a trous and Mallat algorithms
Shensa, M. J. (1992) · IEEE Transactions on Signal Processing · doi:10.1109/78.157290 · Cited by 1,994
Zhang, W., Peng, G., Li, C., Chen, Y., & Zhang, Z. (2017) · Sensors · doi:10.3390/s17020425 · Cited by 1,925 · cited 1×
“To further illustrate the advantages of the proposed network compared with other neural networks, several commonly used networks are selected for comparison, including lightweight networks MobileNet [48], ShuffleNet [49], SqueezeNet [50], Xcep-tion [42], and our previously proposed WDCNN [51].”
MethodSelf-citationRelational Knowledge Distillation
Park, W., Kim, D., Lu, Y., & Cho, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00409 · Cited by 1,681
A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning
Yim, J., Joo, D., Bae, J., & Kim, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.754 · Cited by 1,570
Avci, O., Abdeljaber, O., Kiranyaz, S., Hussein, M., Gabbouj, M., & Inman, D. J. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.107077 · Cited by 1,442
Zhang, W., Li, C., Peng, G., Chen, Y., & Zhang, Z. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.06.022 · Cited by 1,421 · cited 1×
“To enhance the generalization ability of the model during the training process, the overlap sampling proposed by Zhang et al. [38] is adopted to realize data augmentation, which is shown in Fig.”
MethodSelf-citationQuantized Convolutional Neural Networks for Mobile Devices
Wu, J., Leng, C., Wang, Y., Hu, Q., & Cheng, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.521 · Cited by 1,212
Similarity-Preserving Knowledge Distillation
Tung, F., & Mori, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00145 · Cited by 1,079
Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765695 · Cited by 817
Azimi, M., Eslamlou, A., & Pekcan, G. (2020) · Sensors · doi:10.3390/s20102778 · Cited by 769
Abdeljaber, O., Avci, O., Kiranyaz, M. S., Boashash, B., Sodano, H., & Inman, D. J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.09.069 · Cited by 521
Optimal selection of wavelet basis function applied to ECG signal denoising
Singh, B. N., & Tiwari, A. K. (2006) · Digital Signal Processing · doi:10.1016/j.dsp.2005.12.003 · Cited by 509
DCNN-Based Multi-Signal Induction Motor Fault Diagnosis
Shao, S., Yan, R., Lu, Y., Wang, P., & Gao, R. X. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2925247 · Cited by 442
Li, W., Zhong, X., Shao, H., Cai, B., & Yang, X. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101552 · Cited by 340
Wang, Z., & Cha, Y.-J. (2021) · Structural Health Monitoring · doi:10.1177/1475921720934051 · Cited by 336
Interleaved Group Convolutions
Zhang, T., Qi, G.-J., Xiao, B., & Wang, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.469 · Cited by 323 · cited 1×
“The group convolution operation [41] is adopted during the process of dynamic convolution to reduce the amount of computation of DDFC.”
MethodLike What You Like: Knowledge Distill via Neuron Selectivity Transfer
Huang, Z., & Wang, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01219 · Cited by 300
Cao, H., Shao, H., Zhong, X., Deng, Q., Yang, X., & Xuan, J. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.11.016 · Cited by 290
Structural health monitoring algorithm comparisons using standard data sets
Figueiredo, E., Park, G., Figueiras, J., Farrar, C., & Worden, K. (2009) · doi:10.2172/961604 · Cited by 262
Transfer fault diagnosis of bearing installed in different machines using enhanced deep auto-encoder
Zhiyi, H., Haidong, S., Lin, J., Junsheng, C., & Yu, Y. (2020) · Measurement · doi:10.1016/j.measurement.2019.107393 · Cited by 254
Avci, O., Abdeljaber, O., Kiranyaz, S., Hussein, M., & Inman, D. J. (2018) · Journal of Sound and Vibration · doi:10.1016/j.jsv.2018.03.008 · Cited by 234
Data-Driven Structural Health Monitoring Using Feature Fusion and Hybrid Deep Learning
Dang, H. V., Tran-Ngoc, H., Nguyen, T. V., Bui-Tien, T., De Roeck, G., & Nguyen, H. X. (2021) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.3034401 · Cited by 170 · cited 1×
“Researchers have proposed some improved CNN-based algorithms to achieve structural state monitoring and accurate evaluation [15], such as multiscale CNN [16], CNN long short-term memory (CNN-LSTM) [17], and fully convolutional networks (FCNs) [18].”
BackgroundZhang, K., Tang, B., Deng, L., Tan, Q., & Yu, H. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.107963 · Cited by 142
Xu, Z., Hsu, Y.-C., & Huang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.00513 · Cited by 121
Zhao, B., Cheng, C., Peng, Z., Dong, X., & Meng, G. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3005113 · Cited by 107
Self-citationLi, Y., Bao, T., Chen, H., Zhang, K., Shu, X., Chen, Z., & Hu, Y. (2021) · Measurement · doi:10.1016/j.measurement.2021.109377 · Cited by 90
Wang, B., Ma, F., Ge, L., Ma, H., Wang, H., & Mohamed, M. A. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3018831 · Cited by 75
Deng, J. Y., Jiang, W., Zhang, Y., Wang, G., Li, S., & Fang, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3091498 · Cited by 75
Self-citationFu, H., Sharif-Khodaei, Z., & Aliabadi, M. H. F. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2019.03.050 · Cited by 68
Fault detection and diagnosis with a novel source-aware autoencoder and deep residual neural network
Amini, N., & Zhu, Q. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.067 · Cited by 68
Li, Y., Liang, X., Yang, Y., Xu, M., & Huang, W. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2664599 · Cited by 55
Locating Defects in Anisotropic CFRP Plates Using ToF-Based Probability Matrix and Neural Networks
Feng, B., Pasadas, D. J., Ribeiro, A. L., & Ramos, H. G. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2893701 · Cited by 51
Li, S., Peng, G., Ji, M., Cheng, F., Zhao, C., & Li, Z. (2021) · Composite Structures · doi:10.1016/j.compstruct.2021.115144 · Cited by 51
Self-citationChen, F., & Jahanshahi, M. R. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2959292 · Cited by 46
Fault Detection of Harmonic Drive Using Multiscale Convolutional Neural Network
Yang, G., Zhong, Y., Yang, L., & Du, R. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3024355 · Cited by 46
Hasan, M. J., Islam, M. M. M., & Kim, J.-M. (2020) · Measurement · doi:10.1016/j.measurement.2020.108478 · Cited by 45
Zhang, B., Hong, X., & Liu, Y. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3091204 · Cited by 36
Sabato, A., Valente, N. A., & Niezrecki, C. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.2997774 · Cited by 35
Moore, E. Z., Nichols, J. M., & Murphy, K. D. (2011) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2011.09.022 · Cited by 33
Design of a Linear Walking Stage based on Two Types of Piezoelectric Actuators
Cai, J., Chen, F., Sun, L., & Dong, W. (2020) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2020.112067 · Cited by 32
Santos, A., Santos, R., da Silva, M. F. M., Figueiredo, E., Sales, C., & Costa, J. C. W. A. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2663478 · Cited by 31
An Anti-UAV Long-Term Tracking Method with Hybrid Attention Mechanism and Hierarchical Discriminator
Cheng, F., Liang, Z., Peng, G., Liu, S., Li, S., & Ji, M. (2022) · Sensors · doi:10.3390/s22103701 · Cited by 28
Self-citationYan, R., Chen, X., & Mukhopadhyay, S. C. (2017) · Smart sensors, measurement and instrumentation · doi:10.1007/978-3-319-56126-4 · Cited by 27
Cai, J., Chen, F., Gao, Y., & Dong, W. (2021) · Precision Engineering · doi:10.1016/j.precisioneng.2021.05.005 · Cited by 20
Multiscale Convolutional Generative Adversarial Network for Anchorage Grout Defect Detection
Han, G., Li, L., Di, W., Sun, X., Bu, T., & Lin, T. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3033411 · Cited by 9
Research works printed but not linked: 1
- Chen, Learning efficient object detection models with knowledge distillation, 30, 1
Cited by
Jia, J., & Li, Y. (2023) · Sensors · doi:10.3390/s23218824 · Cited by 182
“In the studied literature, vibration-based SHM is mainly used in crack [109], brace damage [110–112], bolt loosening [113,114], and stiffness reduction [115,116] detection.”
BackgroundMethodA Systematic Review of Multisensor Information Fusion for Equipment Fault Diagnosis
Lin, T., Ren, Z., Zhu, L., Zhu, Y., Feng, K., Ding, W., Yan, K. L., & Beer, M. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3529577 · Cited by 119
Few-shot learning for structural health diagnosis of civil infrastructure
Xu, Y., Fan, Y., Bao, Y., & Li, H. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2024.102650 · Cited by 68
Guo, W. J., Li, X., & Shen, Z. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123083 · Cited by 54
Xu, Y., Yan, X., Sun, B., Feng, K., Kou, L., Chen, Y., Li, Y., Chen, H., Tian, E., Ni, Q., et al. (2023) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2023.3313986 · Cited by 42
Metadata
- Authors
- Li, S., Liu, F., Peng, G., Cheng, F., Zhao, B., & Ji, M.
- Affiliations
- Harbin Institute of Technology (CN)
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2022
- Volume
- 71
- Pages
- 1-19
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W4312517768
- Cited by
- 18
- References
- 55
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 3 · 2023: 10
- FWCI
- 1.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Instrumentation and Measurement (publishedVersion)
- Funders
- National Natural Science Foundation of China, China (51875138, 52275099)
- Topics
- Physical Sciences › Engineering › Civil and Structural Engineering › Structural Health Monitoring Techniques
- Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Keywords
- structural health monitoring, lightweight neural networks, sensor fusion, knowledge distillation, model compression, joint loss function, resource-constrained platforms, fault diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.