Engineering deep learning methods on automatic detection of damage in infrastructure due to extreme events
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
This paper presents a few comprehensive experimental studies for automated Structural Damage Detection (SDD) in extreme events using deep learning methods for processing 2D images. In the first study, a 152-layer Residual network (ResNet) is utilized to classify multiple classes in eight SDD tasks, which include identification of scene levels, damage levels, and material types. The proposed ResNet achieved high accuracy for each task while the positions of the damage are not identifiable. In the second study, the existing ResNet and a segmentation network (U-Net) are combined into a new pipeline, cascaded networks, for categorizing and locating structural damage. The results show that the accuracy of damage detection is significantly improved compared to only using a segmentation network. In the third and fourth studies, end-to-end networks are developed and tested as a new solution to directly detect cracks and spalling in the image collections of recent large earthquakes. One of the proposed networks can achieve an accuracy above 67 .6% for all tested images at various scales and resolutions, and shows its robustness for these human-free detection tasks. As a preliminary field study, we applied the proposed method to detect damage in a concrete structure that was tested to study its progressive collapse performance. The experiments indicate that these solutions for automatic detection of structural damage using deep learning methods are feasible and promising. The training datasets and codes will be made available for the public upon the publication of this paper.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Three different variants of Mask R-CNN were developed and compared, but the A-PaNet (Attention-based Path Aggregation Network) Mask R-CNN has the best performance [7].”
From Field monitoring and assessment of reinforced concrete building collapse using remote sensing and digital twins (2026) · cites this paper as [7]
In the citing paper
“Bai et al. [7] developed a Mask R-CNN (Mask Regional Convolutional Neural Network) variant to identify damage on the same building using images from cell phones and drones, achieving an overall accuracy of 65.8 % .”
From Field monitoring and assessment of reinforced concrete building collapse using remote sensing and digital twins (2026) · cites this paper as [7]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“Therefore, the network can be designed to have large number of layers for extracting high-level features.(28) A 152-layer ResNet with transfer learning and fine-tuning technique were used in our damage classification network for PEER Hub ImageNet Figure 2.”
MethodU-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Path Aggregation Network for Instance Segmentation
Liu, S., Qi, L., Qin, H., Shi, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00913 · Cited by 10,011
Image segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Albumentations: fast and flexible image augmentations
Buslaev, A., Iglovikov, V. I., Khvedchenya, E., Parinov, A., Druzhinin, M., & Kalinin, A. A. (2020) · Information · doi:10.3390/info11020125 · Cited by 2,714
MMDetection: Open MMLab Detection Toolbox and Benchmark
Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Xu, J., et al. (2019) · arXiv · doi:10.48550/arxiv.1906.07155 · Cited by 2,227
Research works printed but not linked: 8
- Goodfellow I, 2016, Deep Learning
- Hoskere V, Narazaki Y, Hoang T et al. Vision-based structural inspection using multiscale deep convolutional neural networks. arXiv preprint arXiv:180501055 2018: arXiv–1805.
- Ali L, 2019, Int J, 17, 98
- Kong X, 2018, Sensors Smart Struct Tech Civil, Mech Aerosp Syst, 10598, 212
- Brooks J, 2019, COCO Annotator
- Zha B, 2019, Int J Comput Vision, 115, 211
- Ren S, 2015, Adv Neural Inform Process Syst, 1, 91
- Purdue-University, 2018, Buildings Surveyed after 2017 mexico City Earthquakes
Cited by
Hütten, N., Gomes, M. A., Hölken, F., Andricevic, K., Meyes, R., & Meisen, T. (2024) · Applied System Innovation · doi:10.3390/asi7010011 · Cited by 248
Doğan, G., Arslan, M. H., & İlki, A. (2023) · Engineering Structures · doi:10.1016/j.engstruct.2023.115629 · Cited by 85
Recent advances in crack detection technologies for structures: a survey of 2022-2023 literature
Kaveh, H., & Alhajj, R. (2024) · Frontiers in Built Environment · doi:10.3389/fbuil.2024.1321634 · Cited by 58
A novel transformer-based semantic segmentation framework for structural condition assessment
Wang, R., Shao, Y., Li, Q., Li, L., Li, J., & Hao, H. (2023) · Structural Health Monitoring · doi:10.1177/14759217231182303 · Cited by 50
Earthquake Crack Detection From Aerial Images Using a Deformable Convolutional Neural Network
Yu, D., Ji, S., Li, X., Yuan, Z., & Shen, C. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3183157 · Cited by 39
Metadata
- Authors
- Bai, Y., Zha, B., Sezen, H., & Yilmaz, A.
- Affiliations
- The Ohio State University (US)
- Corresponding author
- Bai, Yongsheng
- Venue
- Structural Health Monitoring
- Publisher
- SAGE Publications
- Published
- 2022-05-05
- Volume
- 22
- Issue
- 1
- Pages
- 338-352
- ISSN
- 1475-9217 (ISSN-L)
- 1741-3168
- OpenAlex
- W4228997119
- Cited by
- 42
- References
- 36
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 11 · 2023: 11 · 2022: 3
- FWCI
- 3.93
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Structural Health Monitoring (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2036193)
- Topics
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Physical Sciences › Engineering › Civil and Structural Engineering › Structural Health Monitoring Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- structural damage detection, extreme events, earthquakes, crack detection, spalling, ResNet, U-Net, cascaded networks, damage localization, concrete structures, progressive collapse, infrastructure damage, image-based damage assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Engineering deep learning methods on automatic detection of damage in infrastructure due to extreme events. https://app.cochat.ai/papers/10.1177/14759217221083649
- The paper
- Bai, Y., Zha, B., Sezen, H., & Yilmaz, A. (2023). Engineering deep learning methods on automatic detection of damage in infrastructure due to extreme events. Structural Health Monitoring. https://doi.org/10.1177/14759217221083649
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.