The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Image‐based post‐disaster inspection of reinforced concrete bridge systems using deep learning with Bayesian optimization
Open accessAbstract
Many bridge structures, one of the most critical components in transportation infrastructure systems, exhibit signs of deteriorations and are approaching or beyond the initial design service life. Therefore, structural health inspections of these bridges are becoming critically important, especially after extreme events. To enhance the efficiency of such an inspection, in recent years, autonomous damage detection based on computer vision has become a research hotspot. This article proposes a three‐level image‐based approach for post‐disaster inspection of the reinforced concrete bridge using deep learning with novel training strategies. The convolutional neural network for image classification, object detection, and semantic segmentation are, respectively, proposed to conduct system‐level failure classification, component‐level bridge column detection, and local damage‐level damage localization. To enable efficient training and prediction using a small data set, the model robustness is a crucial aspect to be taken into account, generally through its hyperparameters’ selection. This article, based on Bayesian optimization, proposes a principled manner of such selection, with which very promising results (well over 90% accuracies) and robustness are observed on all three‐level deep learning models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
(2010) · International Conference on Machine Learning · Cited by 13,995
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
(2012) · Cited by 9,062
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Eigen, D., & Fergus, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.304 · Cited by 2,862
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,011
Cha, Y., Choi, W., Suh, G., Mahmoudkhani, S., & Büyüköztürk, O. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12334 · Cited by 1,558
Proceedings of the 26th International Conference on Neural Information Processing Systems
Burges, C. J. C., Bottou, L., Welling, M., Zoubin Ghahramani, A., & Weinberger, K. Q. (2013) · Cited by 1,323
Abdeljaber, O., Avci, O., Kiranyaz, S., Gabbouj, M., & Inman, D. J. (2017) · Journal of Sound and Vibration · doi:10.1016/j.jsv.2016.10.043 · Cited by 1,278
Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., & Fieguth, P. (2015) · Advanced Engineering Informatics · doi:10.1016/j.aei.2015.01.008 · Cited by 1,065 · cited 3×
“In recent years, considerable efforts have been dedicated to automating the visual inspection (Jahanshahi, Kelly, Masri, & Sukhatme, 2009; Koch, Georgieva, Kasireddy, Akinci, & Fieguth, 2015; Rose et al., 2014) using computer vision-based approaches.”
BackgroundMethodStructural Health Monitoring: A Machine Learning Perspective
Farrar, C. R., & Worden, K. (2012) · Wiley eBooks · doi:10.1002/9781118443118 · Cited by 1,014
Automated Pixel‐Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep‐Learning Network
Zhang, A., Wang, K. C. P., Li, B., Yang, E., Dai, X., Peng, Y., Fei, Y., Liu, Y., Li, J. Q., & Chen, C. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12297 · Cited by 969
Analysis of Edge-Detection Techniques for Crack Identification in Bridges
Abdel-Qader, I., Abudayyeh, O., & Kelly, M. E. (2003) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)0887-3801(2003)17:4(255 · Cited by 892
Deep Transfer Learning for Image‐Based Structural Damage Recognition
Gao, Y., & Mosalam, K. M. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12363 · Cited by 766
What Makes for Effective Detection Proposals?
Hosang, J., Benenson, R., Dollar, P., & Schiele, B. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2465908 · Cited by 727
Max-pooling convolutional neural networks for vision-based hand gesture recognition
Nagi, J., Ducatelle, F., Di Caro, G. A., Ciresan, D., Meier, U., Giusti, A., Nagi, F., Schmidhuber, J., & Gambardella, L. M. (2011) · 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA) · doi:10.1109/icsipa.2011.6144164 · Cited by 644
Structural Damage Detection with Automatic Feature‐Extraction through Deep Learning
Lin, Y., Nie, Z., & Ma, H. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12313 · Cited by 634
Vision‐Based Automated Crack Detection for Bridge Inspection
Yeum, C. M., & Dyke, S. J. (2015) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12141 · Cited by 517
What is a good evaluation measure for semantic segmentation?
Csurka, G., Larlus, D., & Perronnin, F. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.32 · Cited by 500
Yamaguchi, T., & Hashimoto, S. (2010) · Machine Vision and Applications · doi:10.1007/s00138-009-0189-8 · Cited by 409
Rafiei, M. H., & Adeli, H. (2018) · Engineering Structures · doi:10.1016/j.engstruct.2017.10.070 · Cited by 401
Experimental validation of cost-effective vision-based structural health monitoring
Feng, D., & Feng, M. Q. (2017) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2016.11.021 · Cited by 355
Xue, Y., & Li, Y. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12367 · Cited by 347
A novel machine learning‐based algorithm to detect damage in high‐rise building structures
Rafiei, M. H., & Adeli, H. (2017) · The Structural Design of Tall and Special Buildings · doi:10.1002/tal.1400 · Cited by 346
Vetrivel, A., Gerke, M., Kerle, N., Nex, F., & Vosselman, G. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.03.001 · Cited by 330
Yoon, H., Elanwar, H., Choi, H., Golparvar-Fard, M., & Spencer, B. F. (2016) · Structural Control and Health Monitoring · doi:10.1002/stc.1850 · Cited by 287
Convolutional Neural Networks for Steel Surface Defect Detection from Photometric Stereo Images
Soukup, D., & Huber-Mörk, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-14249-4_64 · Cited by 286
Supervised Deep Restricted Boltzmann Machine for Estimation of Concrete
(2017) · ACI Materials Journal · doi:10.14359/51689560 · Cited by 278
Fernandez Galarreta, J., Kerle, N., & Gerke, M. (2015) · Natural Hazards and Earth System Sciences · doi:10.5194/nhess-15-1087-2015 · Cited by 248
How good are detection proposals, really?
Hosang, J., Benenson, R., & Schiele, B. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.24 · Cited by 215
Zhu, Z., Paal, S. G., & Brilakis, I. (2011) · Automation in Construction · doi:10.1016/j.autcon.2011.03.004 · Cited by 201
German, S., Brilakis, I., & DesRoches, R. (2012) · Advanced Engineering Informatics · doi:10.1016/j.aei.2012.06.005 · Cited by 201
Image-Based Automated 3D Crack Detection for Post-disaster Building Assessment
Torok, M. M., Golparvar-Fard, M., & Kochersberger, K. B. (2014) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000334 · Cited by 186
Jahanshahi, M. R., Kelly, J. S., Masri, S. F., & Sukhatme, G. S. (2009) · Structure and Infrastructure Engineering · doi:10.1080/15732470801945930 · Cited by 185
Deep Active Learning for Civil Infrastructure Defect Detection and Classification
Feng, C., Liu, M.-Y., Kao, C.-C., & Lee, T. (2017) · ASCE International Conference on Computing in Civil Engineering (i3CE) · doi:10.1061/9780784480823.036 · Cited by 168
Koziarski, M., & Cyganek, B. (2017) · Integrated Computer-Aided Engineering · doi:10.3233/ica-170551 · Cited by 160
Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation
Hong, S., Noh, H., & Han, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04924 · Cited by 159
Deep Learning for Accelerated Seismic Reliability Analysis of Transportation Networks
Nabian, M. A., & Meidani, H. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12359 · Cited by 156
Unified Vision‐Based Methodology for Simultaneous Concrete Defect Detection and Geolocalization
Li, R., Yuan, Y., Zhang, W., & Yuan, Y. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12351 · Cited by 142
Achievements and Challenges in Machine Vision-Based Inspection of Large Concrete Structures
Koch, C., Paal, S. G., Rashidi, A., Zhu, Z., König, M., & Brilakis, I. (2014) · Advances in Structural Engineering · doi:10.1260/1369-4332.17.3.303 · Cited by 136
Dai, H., & Cao, Z. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12257 · Cited by 128
Concrete Column Recognition in Images and Videos
Zhu, Z., & Brilakis, I. (2010) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000053 · Cited by 96
Layer multiplexing FPGA implementation for deep back-propagation learning
Ortega-Zamorano, F., Jerez, J. M., Gómez, I., & Franco, L. (2017) · Integrated Computer-Aided Engineering · doi:10.3233/ica-170538 · Cited by 74
Object-Proposal Evaluation Protocol is ‘Gameable’
Chavali, N., Agrawal, H., Mahendru, A., & Batra, D. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.97 · Cited by 65
Deep faster R-CNN-based automated detection and localization of multiple types of damage
Suh, G., & Cha, Y. (2018) · Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems · doi:10.1117/12.2295954 · Cited by 46
Supervised Computer-Vision-Based Sensing of Concrete Bridges for Crack-Detection and Assessment
Rose, P., Aaron, B., Tamir, D. E., Lu, L., Hu, J., & Shi, H. (2014) · Transportation Research Board 93rd Annual MeetingTransportation Research Board · Cited by 11
Cited by
Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring
Spencer, B. F., Hoskere, V., & Narazaki, Y. (2019) · Engineering · doi:10.1016/j.eng.2018.11.030 · Cited by 1,282
A review of computer vision–based structural health monitoring at local and global levels
Dong, C.-Z., & Catbas, F. N. (2021) · Structural Health Monitoring · doi:10.1177/1475921720935585 · Cited by 795
Azimi, M., Eslamlou, A., & Pekcan, G. (2020) · Sensors · doi:10.3390/s20102778 · Cited by 769
Machine Learning Algorithms in Civil Structural Health Monitoring: A Systematic Review
Flah, M., Nunez, I., Ben Chaabene, W., & Nehdi, M. L. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-020-09471-9 · Cited by 533
Applications of artificial intelligence for disaster management
Sun, W., Bocchini, P., & Davison, B. D. (2020) · Natural Hazards · doi:10.1007/s11069-020-04124-3 · Cited by 491
Metadata
- Authors
- Liang, X.
- Venue
- Computer-Aided Civil and Infrastructure Engineering
- Publisher
- Elsevier BV
- Published
- 2018-12-05
- Volume
- 34
- Issue
- 5
- Pages
- 415-430
- ISSN
- 1093-9687 (ISSN-L)
- 1467-8667
- OpenAlex
- W2903155537
- Cited by
- 398
- References
- 68
- FWCI
- 30.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.