Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
This study conducts crack identification from real-world images containing complicated disturbance information (cracks, handwriting scripts, and background) inside steel box girders of bridges. Considering the multilevel and multi-scale features of the input images, a modified fusion convolutional neural network architecture is proposed. As input, 350 raw images are taken with a consumer-grade camera and divided into sub-images with resolution of 64 × 64 pixels (67,200 in total). A regular convolutional neural network structure is employed as baseline to demonstrate the accuracy benefits from the proposed fusion convolutional neural network structure. The confusion matrix is defined for prediction performance evaluation on the test set. A total of six additional entire raw images are used to investigate the robustness and feasibility of the proposed approach. A binary conversion process based on the optimal entropy threshold method is applied and closely followed to identify the crack pixels in the sub-images. The effect of the super-resolution inputs on accuracy is investigated. Results show that the trained modified fusion convolutional neural network can automatically detect the cracks, handwriting, and background from the raw images. The recognition errors of the fusion convolutional neural network in both the training and validation processes are smaller than those of the regular convolutional neural network. The super-resolution process hurts the general identification accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
(2014) · Cited by 33,419
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Digital Image Processing Using MATLAB
González, R. C., Woods, R. E., & Eddins, S. L. (2003) · Cited by 7,079
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
An analysis of single-layer networks in unsupervised feature learning
Coates, A., Ng, A. Y., & Lee, H. (2011) · International Conference on Artificial Intelligence and Statistics · Cited by 4,675
A new method for gray-level picture thresholding using the entropy of the histogram
Kapur, J. N., Sahoo, P. K., & Wong, A. K. C. (1985) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(85)90125-2 · Cited by 3,658
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Adams, R., & Bischof, L. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.295913 · Cited by 3,138
MatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259 · cited 3×
“If the learning rate is low, then the learning process will be slow.(61) The momentum values of weights and biases are the same and are set to 0.”
BackgroundMethodInfluentialStochastic Gradient Descent Tricks
Bottou, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_25 · Cited by 1,929
Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition
Scherer, D., Müller, A., & Behnke, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15825-4_10 · Cited by 1,503
LeCun, Y. A., Bottou, L., Orr, G. B., & Müller, K.-R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_3 · Cited by 1,264
Chen, F.-C., & Jahanshahi, M. R. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2764844 · Cited by 930
Richer Convolutional Features for Edge Detection
Liu, Y., Cheng, M.-M., Hu, X., Wang, K., & Bai, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.622 · Cited by 780
Proceedings of the International Joint Conference on Neural Networks (IJCNN) 2005
(2005) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1556327 · Cited by 553
Automatic Road Crack Detection and Characterization
Oliveira, H., & Correia, P. L. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2208630 · Cited by 537
Vision‐Based Automated Crack Detection for Bridge Inspection
Yeum, C. M., & Dyke, S. J. (2015) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12141 · Cited by 517
Training restricted Boltzmann machines: An introduction
Fischer, A., & Igel, C. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.025 · Cited by 504
Temperature effect on vibration properties of civil structures: a literature review and case studies
Xia, Y., Chen, B., Weng, S., Ni, Y.-Q., & Xu, Y.-L. (2012) · Journal of Civil Structural Health Monitoring · doi:10.1007/s13349-011-0015-7 · Cited by 315
Self-citationYoon, H., Elanwar, H., Choi, H., Golparvar-Fard, M., & Spencer, B. F. (2016) · Structural Control and Health Monitoring · doi:10.1002/stc.1850 · Cited by 287
Jahanshahi, M. R., Masri, S. F., Padgett, C. W., & Sukhatme, G. S. (2013) · Machine Vision and Applications · doi:10.1007/s00138-011-0394-0 · Cited by 265
Bridge inspection robot system with machine vision
Oh, J.-K., Jang, G., Oh, S., Lee, J. H., Yi, B.-J., Moon, Y. S., Lee, J. S., & Choi, Y. (2009) · Automation in Construction · doi:10.1016/j.autcon.2009.04.003 · Cited by 258
Penalized-distance volumetric skeleton algorithm
Bitter, I., Kaufman, A. E., & Sato, M. (2001) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.942688 · Cited by 248
ENVIRONMENTAL VARIABILITY OF MODAL PROPERTIES
Cornwell, P., Farrar, C. R., Doebling, S. W., & Sohn, H. (1999) · Experimental Techniques · doi:10.1111/j.1747-1567.1999.tb01320.x · Cited by 238
A Robotic Crack Inspection and Mapping System for Bridge Deck Maintenance
Lim, R. S., La, H. M., & Sheng, W. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2013.2294687 · Cited by 201
Jahanshahi, M. R., Kelly, J. S., Masri, S. F., & Sukhatme, G. S. (2009) · Structure and Infrastructure Engineering · doi:10.1080/15732470801945930 · Cited by 185
Deep Active Learning for Civil Infrastructure Defect Detection and Classification
Feng, C., Liu, M.-Y., Kao, C.-C., & Lee, T.-Y. (2017) · Computing in Civil Engineering 2017 · doi:10.1061/9780784480823.036 · Cited by 156
Xu, Y., Li, S., Zhang, D., Jin, Y., Zhang, F., Li, N., & Li, H. (2018) · Structural Control and Health Monitoring · doi:10.1002/stc.2075 · Cited by 129
Self-citationNagarajaiah, S., & Yang, Y. (2017) · Structural Control and Health Monitoring · doi:10.1002/stc.1851 · Cited by 121
Localization of acoustic emission sources in structural health monitoring of masonry bridge
Han, Q., Xu, J., Carpinteri, A., & Lacidogna, G. (2014) · Structural Control and Health Monitoring · doi:10.1002/stc.1675 · Cited by 119
Li, S., Zhu, S., Xu, Y. L., Chen, Z., & Li, H. (2010) · Structural Control and Health Monitoring · doi:10.1002/stc.427 · Cited by 112
Self-citationChen, Z., Li, H., Bao, Y., Li, N., & Jin, Y. (2015) · Structural Control and Health Monitoring · doi:10.1002/stc.1780 · Cited by 106
Self-citationYang, Y., & Nagarajaiah, S. (2014) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2013.09.009 · Cited by 101
Yang, Y., & Nagarajaiah, S. (2016) · Structural Control and Health Monitoring · doi:10.1002/stc.1856 · Cited by 58
Yang, Y., & Nagarajaiah, S. (2015) · Journal of Structural Engineering · doi:10.1061/(asce)st.1943-541x.0001334 · Cited by 51
Jaeger, H. (2016) · Nature · doi:10.1038/nature19477 · Cited by 36
Cited by
Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring
Spencer, B. F., Hoskere, V., & Narazaki, Y. (2019) · Engineering · doi:10.1016/j.eng.2018.11.030 · Cited by 1,282
Baduge, S. K., Thilakarathna, S., Perera, J. S., Arashpour, M., Sharafi, P., Teodosio, B., Shringi, A., & Mendis, P. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104440 · Cited by 1,007
“…corrosion detection [192], concrete surface bug hole recognition [193], concrete crack detection [194], concrete spalling [195], steel crack detection [196], fatigue detection [197], and surface and subsurface damages [198], pavement crack detection [199], brick building condition assessment [200].”
BackgroundA review of computer vision–based structural health monitoring at local and global levels
Dong, C.-Z., & Catbas, F. N. (2021) · Structural Health Monitoring · doi:10.1177/1475921720935585 · Cited by 795
Azimi, M., Eslamlou, A., & Pekcan, G. (2020) · Sensors · doi:10.3390/s20102778 · Cited by 769
Richer Convolutional Features for Edge Detection
Liu, Y., Cheng, M.-M., Hu, X., Bian, J.-W., Zhang, L., Bai, X., & Tang, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2878849 · Cited by 751
Metadata
- Authors
- Xu, Y., Bao, Y., Chen, J., Zuo, W., & Li, H.
- Venue
- Structural Health Monitoring
- Publisher
- SAGE Publications
- Published
- 2018-04-02
- Volume
- 18
- Issue
- 3
- Pages
- 653-674
- ISSN
- 1475-9217 (ISSN-L)
- 1741-3168
- OpenAlex
- W2795998052
- Cited by
- 292
- References
- 41
- FWCI
- 20.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.