The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types
Open accessAbstract
Computer vision-based techniques were developed to overcome the limitations of visual inspection by trained human resources and to detect structural damage in images remotely, but most methods detect only specific types of damage, such as concrete or steel cracks. To provide quasi real-time simultaneous detection of multiple types of damages, a Faster Region-based Convolutional Neural Network (Faster R-CNN)-based structural visual inspection method is proposed. To realize this, a database including 2,366 images (with 500 × 375 pixels) labeled for five types of damages—concrete crack, steel corrosion with two levels (medium and high), bolt corrosion, and steel delamination—is developed. Then, the architecture of the Faster R-CNN is modified, trained, validated, and tested using this database. Results show 90.6%, 83.4%, 82.1%, 98.1%, and 84.7% average precision (AP) ratings for the five damage types, respectively, with a mean AP of 87.8%. The robustness of the trained Faster R-CNN is evaluated and demonstrated using 11 new 6,000 × 4,000-pixel images taken of different structures. Its performance is also compared to that of the traditional CNN-based method. Considering that the proposed method provides a remarkably fast test speed (0.03 seconds per image with 500 × 375 resolution), a framework for quasi real-time damage detection on video using the trained networks is developed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
(2010) · International Conference on Machine Learning · Cited by 13,995
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Self-citationSpatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
(2011) · doi:10.5591/978-1-57735-516-8/ijcai11-210 · Cited by 1,229
Analysis of Edge-Detection Techniques for Crack Identification in Bridges
Abdel-Qader, I. M., Abudayyeh, O. Y., & Kelly, M. E. (2003) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)0887-3801(2003)17:4(255 · Cited by 894
Pothole detection in asphalt pavement images
Koch, C., & Brilakis, I. (2011) · Advanced Engineering Informatics · doi:10.1016/j.aei.2011.01.002 · Cited by 590
Vision‐Based Automated Crack Detection for Bridge Inspection
Yeum, C. M., & Dyke, S. J. (2015) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12141 · Cited by 521
Concrete Crack Detection by Multiple Sequential Image Filtering
Nishikawa, T., Yoshida, J., Sugiyama, T., & Fujino, Y. (2011) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/j.1467-8667.2011.00716.x · Cited by 361
Vision-based detection of loosened bolts using the Hough transform and support vector machines
Cha, Y., You, K., & Choi, W. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.06.008 · Cited by 330
Self-citationRoad Crack Detection Using Visual Features Extracted by Gabor Filters
Zalama, E., Gómez‐García‐Bermejo, J., Medina, R., & Llamas, J. (2013) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12042 · Cited by 301
Supervised Deep Restricted Boltzmann Machine for Estimation of Concrete
Rafiei, M. H., Khushefati, W. H., Demirboğa, R., & Adeli, H. (2017) · ACI Materials Journal · doi:10.14359/51689560 · Cited by 280
A closer look at Faster R-CNN for vehicle detection
Fan, Q., Brown, L., & Smith, J. V. (2016) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2016.7535375 · Cited by 222
Automatic Road Defect Detection by Textural Pattern Recognition Based on AdaBoost
Cord, A. M., & Chambon, S. (2011) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/j.1467-8667.2011.00736.x · Cited by 213
Visual Inspection of Highway Bridges
Graybeal, B. A., Phares, B. M., Rolander, D. D., Moore, M. E., & Washer, G. (2002) · Journal of Nondestructive Evaluation · doi:10.1023/a:1022508121821 · Cited by 205
Paal, S. G., Brilakis, I., & DesRoches, R. (2012) · Advanced Engineering Informatics · doi:10.1016/j.aei.2012.06.005 · Cited by 202
Adeli, H., & Jiang, X. (2008) · CRC Press eBooks · doi:10.1201/9781482281767 · Cited by 192
Beamlet Transform‐Based Technique for Pavement Crack Detection and Classification
Ying, L. L., & Salari, E. (2010) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/j.1467-8667.2010.00674.x · Cited by 185
(2008) · Medical Entomology and Zoology · Cited by 163
Imaging and machine learning techniques for diagnosis of Alzheimer’s disease
Mirzaei, G., Adeli, A., & Adeli, H. (2016) · Reviews in the Neurosciences · doi:10.1515/revneuro-2016-0029 · Cited by 141
Texture Analysis Based Damage Detection of Ageing Infrastructural Elements
O’Byrne, M., Schoefs, F., Ghosh, B., & Pakrashi, V. (2012) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/j.1467-8667.2012.00790.x · Cited by 121
Amann, J., & Borrmann, A. (2016) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000592 · Cited by 117
Detection of rust defects on steel bridge coatings via digital image recognition
Liao, K., & Lee, Y.-T. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.08.008 · Cited by 113
Support-vector-machine-based method for automated steel bridge rust assessment
Chen, P., Shen, H.-K., Lei, C.-Y., & Chang, L. (2012) · Automation in Construction · doi:10.1016/j.autcon.2011.12.001 · Cited by 112
Wu, L., Mokhtari, S., Nazef, A., Nam, B., & Yun, H. (2014) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000451 · Cited by 107
Computer Vision Techniques for Automatic Structural Assessment of Underground Pipes
Sinha, S. K., Fieguth, P., & Polak, M. A. (2003) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/1467-8667.00302 · Cited by 66
DeepBE: Learning Deep Binary Encoding for Multi-label Classification
Li, C., Kang, Q., Ge, G., Song, Q., Lu, H., & Cheng, J. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.98 · Cited by 19
BRIEF HISTORY OF NATURAL SCIENCES FOR NATURE-INSPIRED COMPUTING IN ENGINEERING
Siddique, N. H., & Adeli, H. (2016) · Journal of Civil Engineering and Management · doi:10.3846/13923730.2016.1157095 · Cited by 15
Flagged first, then by citations
Research works printed but not linked: 2
- Park, J., Kim, T. & Kim, J. (2015), Image‐based bolt‐loosening detection technique of bolt joint in steel bridges, in Proceedings of the 6th International Conference on Advances in Experimental Structural Engineering (6AESE), Urbana–Champaign, IL, 1–2 August 2015.
- Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R. & Lecun, Y. (2014), Overfeat: integrated recognition, localization and detection using convolutional networks, in Proceedings of the International Conference on Learning Representations (ICLR2014), Banff, Canada, 14–16 April 2014.
Cited by
Sorted by citations
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Self-citationAdvances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring
Spencer, B. F., Hoskere, V., & Narazaki, Y. (2019) · Engineering · doi:10.1016/j.eng.2018.11.030 · Cited by 1,273
Pan, Y., & Zhang, L. (2021) · Automation in Construction · doi:10.1016/j.autcon.2020.103517 · Cited by 1,336
Autonomous concrete crack detection using deep fully convolutional neural network
Dung, C. V., & Anh, L. D. (2019) · Automation in Construction · doi:10.1016/j.autcon.2018.11.028 · Cited by 1,170
Machine learning in materials science
Wei, J., Chu, X., Sun, X., Xu, K., Deng, H., Chen, J., Wei, Z., & Lei, M. (2019) · InfoMat · doi:10.1002/inf2.12028 · Cited by 1,069
Metadata
- Authors
- Cha, Y., Choi, W., Suh, G., Mahmoudkhani, S., & Büyüköztürk, O.
- Affiliations
- University of Manitoba (CA)
- Massachusetts Institute of Technology (US)
- Corresponding author
- Cha, Young‐Jin
- Venue
- Computer-Aided Civil and Infrastructure Engineering
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 33
- Issue
- 9
- Pages
- 731-747
- ISSN
- 1093-9687 (ISSN-L)
- OpenAlex
- W2768955070
- Cited by
- 1,558
- References
- 38
- Citations by year
- 2026: 107 · 2025: 205 · 2024: 264 · 2023: 264 · 2022: 231 · 2021: 186 · 2020: 160 · 2019: 98 · 2018: 43
- FWCI
- 86.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Computer-Aided Civil and Infrastructure Engineering (publishedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Physical Sciences › Engineering › Civil and Structural Engineering › Structural Health Monitoring Techniques
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Keywords
- damage detection, Faster R-CNN, region-based object detection, concrete cracking, steel corrosion, bolt corrosion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
