Automatic seismic damage identification of reinforced concrete columns from images by a region-based deep convolutional neural network
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
This paper proposed a modified faster region-based convolutional neural network (faster R-CNN) for the multitype seismic damage identification and localization (i.e., concrete cracking, concrete spalling, rebar exposure, and rebar buckling) of damaged reinforced concrete columns from images. Four hundred raw images containing different damages and complicated background information are taken by a consumer-grade camera in various locations and arbitrary perspectives to simulate the diverse situations where real-world postearthquake damaged structural images are taken by nonprofessionals. Rectangular bounding boxes are obtained to localize multitype structural damages along with the corresponding category labels and classification probabilities. Data augmentation is implemented by rotation at every 90°, vertical and horizontal flipping operations. An interactive labeling process for the ground-truth regions of the aforementioned damages is performed by a semiautomatic MATLAB program. A four-step alternating training procedure is adopted on the basis of the mini-batch stochastic gradient decent algorithm with momentum by backpropagation. Test results show that the trained faster R-CNN can automatically identify and localize the aforementioned multitype seismic damages and the overall average precision reaches 80%. The relative errors of coordinates of the left-top point obey minimum extreme value distributions, and those of width and height obey three-parameter lognormal distributions. The intersection ratio between the identification and ground truth has a mean value of 0.88, and the width–height ratio obeys a two-parameter lognormal distribution. Updated convolutional kernels in the first layer have shown trending, focusing, and line detectors for the feature extraction of multitype damages. Trending and focusing detectors contribute to the recognition of local damage regions, for example, concrete spalling and rebar exposure, whereas line detectors are more sensitive to the segmentation geometry, that is, concrete cracks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259 · cited 3×
“A smooth‐L1 loss is used for regression because L1 loss is less sensitive to outliers than L2 loss and training with L1 loss does not require so careful tuning of learning rates in order to prevent exploding gradients.(52) A robust L1 loss is expressed as”
BackgroundMethodInfluentialWhat is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Cha, Y., Choi, W., Suh, G., Mahmoudkhani, S., & Büyüköztürk, O. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12334 · Cited by 1,558
Instance-aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.04412 · Cited by 1,273
Steel defect classification with Max-Pooling Convolutional Neural Networks
Masci, J., Meier, U., Ciresan, D., Schmidhuber, J., & Fricout, G. (2012) · The 2012 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252468 · Cited by 345 · cited 1×
“Restricted Boltzmann machine and CNNs are broadly used for crack identification in the surfaces of steel structures,(28-30) concrete structures,(31) pavement,(32,33) tunnel,(34,35) and railway.(36,37) Besides investigations on cracks, studies on other types of structural damages are also carried out.”
Method
Cited by
Azimi, M., Eslamlou, A., & Pekcan, G. (2020) · Sensors · doi:10.3390/s20102778 · Cited by 769
Machine learning paradigm for structural health monitoring
Bao, Y., & Li, H. (2021) · Structural Health Monitoring · doi:10.1177/1475921720972416 · Cited by 373
Self-citationTapeh, A. T. G., & Naser, M. Z. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09793-w · Cited by 320
“Other works adopted DL algorithms, such as Xu et al. [180], who achieved 80% accuracy using a modified faster R-CNN algorithm through Matlab software.”
MethodArtificial intelligence-assisted visual inspection for cultural heritage: State-of-the-art review
Mishra, M., & Lourenço, P. B. (2024) · Journal of Cultural Heritage · doi:10.1016/j.culher.2024.01.005 · Cited by 165
A Novel Structural Damage Identification Method Using a Hybrid Deep Learning Framework
He, Y., Huang, Z., Liu, D., Zhang, L., & Liu, Y. (2022) · Buildings · doi:10.3390/buildings12122130 · Cited by 16
Metadata
- Authors
- Xu, Y., Wei, S., Bao, Y., & Li, H.
- Venue
- Structural Control and Health Monitoring
- Publisher
- Wiley
- Published
- 2019-01-17
- Volume
- 26
- Issue
- 3
- Pages
- e2313
- ISSN
- 1545-2255 (ISSN-L)
- OpenAlex
- W2908753069
- Cited by
- 199
- References
- 11
- FWCI
- 18.50
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.