Computer vision and deep learning–based data anomaly detection method for structural health monitoring
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
The widespread application of sophisticated structural health monitoring systems in civil infrastructures produces a large volume of data. As a result, the analysis and mining of structural health monitoring data have become hot research topics in the field of civil engineering. However, the harsh environment of civil structures causes the data measured by structural health monitoring systems to be contaminated by multiple anomalies, which seriously affect the data analysis results. This is one of the main barriers to automatic real-time warning, because it is difficult to distinguish the anomalies caused by structural damage from those related to incorrect data. Existing methods for data cleansing mainly focus on noise filtering, whereas the detection of incorrect data requires expertise and is very time-consuming. Inspired by the real-world manual inspection process, this article proposes a computer vision and deep learning–based data anomaly detection method. In particular, the framework of the proposed method includes two steps: data conversion by data visualization, and the construction and training of deep neural networks for anomaly classification. This process imitates human biological vision and logical thinking. In the data visualization step, the time series signals are transformed into image vectors that are plotted piecewise in grayscale images. In the second step, a training dataset consisting of randomly selected and manually labeled image vectors is input into a deep neural network or a cluster of deep neural networks, which are trained via techniques termed stacked autoencoders and greedy layer-wise training. The trained deep neural networks can be used to detect potential anomalies in large amounts of unchecked structural health monitoring data. To illustrate the training procedure and validate the performance of the proposed method, acceleration data from the structural health monitoring system of a real long-span bridge in China are employed. The results show that the multi-pattern anomalies of the data can be automatically detected with high accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
A scaled conjugate gradient algorithm for fast supervised learning
Møller, M. F. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80056-5 · Cited by 4,052
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Applied Multivariate Statistical Analysis
Härdle, W., & Simar, L. (2003) · Springer eBooks · doi:10.1007/978-3-662-05802-2 · Cited by 2,263
A review of structural health monitoring literature 1996-2001
Farrar, C. R., Czarnecki, J. J., Sohn, H., & Hemez, F. (2002) · Cited by 1,798
Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., & Fieguth, P. (2015) · Advanced Engineering Informatics · doi:10.1016/j.aei.2015.01.008 · Cited by 1,065
Failure diagnosis using deep belief learning based health state classification
Tamilselvan, P., & Wang, P. (2013) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2013.02.022 · Cited by 630
Buckland, W. R. (1979) · Journal of the Operational Research Society · doi:10.1057/jors.1979.165 · Cited by 562
Autoassociative neural networks
Kramer, M. A. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80051-a · Cited by 532
Yang, Y., Dorn, C. J., Mancini, T., Talken, Z., Kenyon, G. T., Farrar, C. R., & Mascareñas, D. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2016.08.041 · Cited by 436
An Overview of Intelligent Fault Detection in Systems and Structures
Worden, K., & Dulieu-Barton, J. M. (2004) · Structural Health Monitoring · doi:10.1177/1475921704041866 · Cited by 415
Park, J., Kim, K., & Cho, Y. K. (2017) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0001223 · Cited by 300
Li, C., Sanchez, R.-V., Zurita, G., Cerrada, M., Cabrera, D., & Vásquez, R. E. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.06.008 · Cited by 295
The state of the art in structural health monitoring of cable-stayed bridges
Li, H., & Ou, J. (2016) · Journal of Civil Structural Health Monitoring · doi:10.1007/s13349-015-0115-x · Cited by 267
Self-citationThe self-validating sensor: rationale, definitions and examples
Henry, M. P., & Clarke, D. W. (1993) · Control Engineering Practice · doi:10.1016/0967-0661(93)91382-7 · Cited by 217
Bayesian wavelet packet denoising for structural system identification
Jiang, X., Mahadevan, S., & Adeli, H. (2007) · Structural Control and Health Monitoring · doi:10.1002/stc.161 · Cited by 214
Li, S., Li, H., Liu, Y., Lan, C., Zhou, W., & Ou, J. (2014) · Structural Control and Health Monitoring · doi:10.1002/stc.1559 · Cited by 180
Self-citationŽvokelj, M., Zupan, S., & Prebil, I. (2011) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2011.03.002 · Cited by 159
Next Generation Wireless Smart Sensors Toward Sustainable Civil Infrastructure
Spencer, B. F., Park, J., Mechitov, K. A., Jo, H., & Agha, G. (2017) · Procedia Engineering · doi:10.1016/j.proeng.2017.01.304 · Cited by 109
Health Checks through Landmark Bridges to Sky-High Structures
Ni, Y., Wong, K. Y., & Xia, Y. (2011) · Advances in Structural Engineering · doi:10.1260/1369-4332.14.1.103 · Cited by 102
Calabrese, L., Campanella, G., & Proverbio, E. (2012) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2012.02.046 · Cited by 76
Wavelet Denoising of TSD Deflection Slope Measurements for Improved Pavement Structural Evaluation
Katicha, S. W., Flintsch, G. W., Bryce, J. M., & Ferne, B. (2013) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12052 · Cited by 69
Yang, Y., & Nagarajaiah, S. (2014) · Structural Control and Health Monitoring · doi:10.1002/stc.1624 · Cited by 61
Failure Detection, Isolation, and Recovery of Multifunctional Self-Validating Sensor
Shen, Z., & Wang, Q. (2012) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2012.2205509 · Cited by 51
A review of self‐validating sensor technology
Feng, Z., Wang, Q., & Shida, K. (2007) · Sensor Review · doi:10.1108/02602280710723488 · Cited by 39
Autonomous image localization for visual inspection of civil infrastructure
Yeum, C. M., Choi, J. B., & Dyke, S. J. (2017) · Smart Materials and Structures · doi:10.1088/1361-665x/aa510e · Cited by 37
Cited by
Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring
Spencer, B. F., Hoskere, V., & Narazaki, Y. (2019) · Engineering · doi:10.1016/j.eng.2018.11.030 · Cited by 1,282
Baduge, S. K., Thilakarathna, S., Perera, J. S., Arashpour, M., Sharafi, P., Teodosio, B., Shringi, A., & Mendis, P. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104440 · Cited by 1,007
“AI based SHM techniques have been used for: general SHM [189], multi-level damage detection [190], non-contact assessment of deflection [191], corrosion detection [192], concrete surface bug hole recognition [193], concrete crack detection [194], concrete spalling [195], steel crack detection…”
MethodAlzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Dorafshan, S., Thomas, R. J., & Maguire, M. (2018) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2018.08.011 · Cited by 774
Azimi, M., Eslamlou, A., & Pekcan, G. (2020) · Sensors · doi:10.3390/s20102778 · Cited by 769
Metadata
- Authors
- Bao, Y., Tang, Z., Li, H., & Zhang, Y.
- Venue
- Structural Health Monitoring
- Publisher
- SAGE Publications
- Published
- 2018-02-19
- Volume
- 18
- Issue
- 2
- Pages
- 401-421
- ISSN
- 1475-9217 (ISSN-L)
- 1741-3168
- OpenAlex
- W2791957585
- Cited by
- 616
- References
- 27
- FWCI
- 28.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.