Combining the YOLOv4 Deep Learning Model with UAV Imagery Processing Technology in the Extraction and Quantization of Cracks in Bridges
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Bridges are often at risk due to the effects of natural disasters, such as earthquakes and typhoons. Bridge inspection assessments normally focus on cracks. However, numerous concrete structures with cracked surfaces are highly elevated or over water, and is not easily accessible to a bridge inspector. Furthermore, poor lighting under bridges and a complex visual background can hinder inspectors in their identification and measurement of cracks. In this study, cracks on bridge surfaces were photographed using a UAV-mounted camera. A YOLOv4 deep learning model was used to train a model for identifying cracks; the model was then employed in object detection. To perform the quantitative crack test, the images with identified cracks were first converted to grayscale images and then to binary images the using local thresholding method. Next, the two edge detection methods, Canny and morphological edge detectors were applied to the binary images to extract the edges of the cracks and obtain two types of crack edge images. Then, two scale methods, the planar marker method, and the total station measurement method, were used to calculate the actual size of the crack edge image. The results indicated that the model had an accuracy of 92%, with width measurements as precise as 0.22 mm. The proposed approach can thus enable bridge inspections and obtain objective and quantitative data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





![Figure 6 Architecture of the one-stage and two-stage object detectors [32].](https://figures.cochat.ai/paper-figures/6ea5e1eac39e4031a2d3ca18e3c66673/combining-the-yolov4-deep-learning-model-with-uav-imagery-processing-technology-figure-6.jpg)
![Figure 7 YOLOv4 model architecture [23].](https://figures.cochat.ai/paper-figures/c97028fcd01d495ba143d5c3eb794fb2/combining-the-yolov4-deep-learning-model-with-uav-imagery-processing-technology-figure-7.jpg)












Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In addition, DL has also been applied to SHM to identify, locate, and evaluate various damages by extracting advanced damage features from data such as pictures and vibration signals [15,35,36].”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [36]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Generally, the training set’s ratio to the test set is 8:2 [27,36,182,198] or 7:3 [15,58,187].”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
(2016) · Cited by 31,590
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 2×
“Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; Reed, S.; Fu, C.Y.; Berg, A.C. SSD: Single shot multibox detector.”
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks
Cha, Y., Choi, W., & Büyüköztürk, O. (2017) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12263 · Cited by 3,295
Region-based convolutional networks for accurate object detection and segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2437384 · Cited by 2,912
Adaptive document image binarization
Sauvola, J., & Pietikäinen, M. (2000) · Pattern Recognition · doi:10.1016/s0031-3203(99)00055-2 · Cited by 2,339
Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring
Spencer, B. F., Hoskere, V., & Narazaki, Y. (2019) · Engineering · doi:10.1016/j.eng.2018.11.030 · Cited by 1,282
Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., & Fieguth, P. (2015) · Advanced Engineering Informatics · doi:10.1016/j.aei.2015.01.008 · Cited by 1,065
A review of computer vision–based structural health monitoring at local and global levels
Dong, C.-Z., & Catbas, F. N. (2021) · Structural Health Monitoring · doi:10.1177/1475921720935585 · Cited by 795
Dorafshan, S., Thomas, R. J., & Maguire, M. (2018) · Data in Brief · doi:10.1016/j.dib.2018.11.015 · Cited by 388
Image‐based concrete crack assessment using mask and region‐based convolutional neural network
Kim, B., & Cho, S. (2019) · Structural Control and Health Monitoring · doi:10.1002/stc.2381 · Cited by 283
Kim, I.-H., Jeon, H., Baek, S.-C., Hong, W.-H., & Jung, H.-J. (2018) · Sensors · doi:10.3390/s18061881 · Cited by 274
Concrete Crack Identification Using a UAV Incorporating Hybrid Image Processing
Kim, H., Lee, J., Ahn, E., Cho, S., Shin, M., & Sim, S.-H. (2017) · Sensors · doi:10.3390/s17092052 · Cited by 236
Concrete crack detection and quantification using deep learning and structured light
Park, S. E., Eem, S.-H., & Jeon, H. (2020) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2020.119096 · Cited by 227
Ullah, F., & Al-Turjman, F. (2023) · Neural Computing and Applications · doi:10.1007/s00521-021-05800-6 · Cited by 198
Convective Precipitation Nowcasting Using U-Net Model
Han, L., He, L., Chen, H., Zhang, W., & Ge, Y. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3100847 · Cited by 189
Real-Time Detection of Cracks on Concrete Bridge Decks Using Deep Learning in the Frequency Domain
Zhang, Q., Barri, K., Babanajad, S. K., & Alavi, A. H. (2020) · Engineering · doi:10.1016/j.eng.2020.07.026 · Cited by 175
Concrete Crack Assessment Using Digital Image Processing and 3D Scene Reconstruction
Liu, Y.-F., Cho, S., Spencer, B. F., & Fan, J.-S. (2016) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000446 · Cited by 169
Automatic Pixel-Level Pavement Crack Detection Using Information of Multi-Scale Neighborhoods
Ai, D., Jiang, G., Siew Kei, L., & Li, C. (2018) · IEEE Access · doi:10.1109/access.2018.2829347 · Cited by 166
A deep learning approach for fast detection and classification of concrete damage
Jiang, Y., Pang, D., & Li, C. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103785 · Cited by 161
Xiong, P., Zhong, X., Zhao, C., Chen, A., & Zhang, T. (2021) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2021.123896 · Cited by 150
Computer-vision based crack detection and analysis
Prasanna, P., Dana, K., Gucunski, N., & Basily, B. (2012) · SPIE Proceedings · doi:10.1117/12.915384 · Cited by 82
Ali, L., Alnajjar, F., Khan, W., Serhani, M. A., & Jassmi, H. A. (2022) · Buildings · doi:10.3390/buildings12040432 · Cited by 75
Ullah, F., Sepasgozar, S. M. E., Shirowzhan, S., & Davis, S. (2021) · Telematics and Informatics · doi:10.1016/j.tele.2021.101660 · Cited by 73
Teng, S., Liu, Z., & Li, X. (2022) · Buildings · doi:10.3390/buildings12081225 · Cited by 70
Automatic Detection of Cracks on Concrete Surfaces in the Presence of Shadows
Palevičius, P., Pal, M., Landauskas, M., Orinaitė, U., Timofejeva, I., & Ragulskis, M. K. (2022) · Sensors · doi:10.3390/s22103662 · Cited by 44
A Real-Time Detection Method for Concrete Surface Cracks Based on Improved YOLOv4
Yao, G., Sun, Y., Wong, M., & Lv, X. (2021) · Symmetry · doi:10.3390/sym13091716 · Cited by 32
Ullah, F., Al-Turjman, F. M., Qayyum, S., Inam, H., & Imran, M. A. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22422 · Cited by 29
Concrete Crack Identification and Image Mosaic Based on Image Processing
Tian, F., Zhao, Y., Che, X., Zhao, Y., & Xin, D. (2019) · Applied Sciences · doi:10.3390/app9224826 · Cited by 25
Digital image correlation-based structural state detection through deep learning
Teng, S., Chen, G., Wang, S., Zhang, J., & Sun, X. (2022) · Frontiers of Structural and Civil Engineering · doi:10.1007/s11709-021-0777-x · Cited by 24
Crack Texture Feature Identification of Fiber Reinforced Concrete Based on Deep Learning
Zhou, S., Pan, Y., Huang, X., di Yang, D., Ding, Y., & Duan, R. (2022) · Materials · doi:10.3390/ma15113940 · Cited by 21
Bridge Crack Inspection Efficiency of an Unmanned Aerial Vehicle System with a Laser Ranging Module
Kao, S., Wang, F.-L., Lin, J.-S., Tsai, J., Chu, Y.-D., & Hung, P.-S. (2022) · Sensors · doi:10.3390/s22124469 · Cited by 19
Self-citationKim, B., Choi, S.-W., Hu, G., Lee, D., & Juan, R. O. S. (2022) · Sensors · doi:10.3390/s22093118 · Cited by 17
Sharma, M. (2018) · Science & Technology Asia · doi:10.14456/scitechasia.2018.11 · Cited by 13
Analytical Modeling of Crack Widths and Cracking Loads in Structural RC Members
Yankelevsky, D. Z., Karinski, Y. S., & Feldgun, V. R. (2022) · Infrastructures · doi:10.3390/infrastructures7030040 · Cited by 11
Enhancing Railway Maintenance Safety Using Open-Source Computer Vision
Shin, D., JangWon, J., & Kim, J. (2021) · Journal of Advanced Transportation · doi:10.1155/2021/5575557 · Cited by 10
Automatic Road Crack Segmentation Using Thresholding Methods
Kasmin, F. B., Othman, Z. B., & Ahmad, S. S. S. (2018) · International Journal of Human and Technology Interaction (IJHaTI) · Cited by 4
Probability-Based Crack Width Estimation Model for Flexural Members of Underground RC Box Culverts
Kim, S., Shah, S. H. A., Woo, S.-K., Chu, I., & Sim, C. (2022) · Applied Sciences · doi:10.3390/app12042063 · Cited by 4
Research works printed but not linked: 2
- Yang L. Li B. Li W. Liu Z. Yang G. Xiao J. Deep Concrete Inspection Using Unmanned Aerial Vehicle Towards CSSC Database Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems Vancouver, BC, Canada 24–28 September 2017
- Bochkovskiy A. Wang C. Liao H.M. YOLOv4: Optimal Speed and Accuracy of Object Detection arXiv 2020 2004.10934
Cited by
Computer Vision-Based Bridge Inspection and Monitoring: A Review
Luo, K., Kong, X., Zhang, J., Hu, J., Li, J., & Tang, H. J. (2023) · Sensors · doi:10.3390/s23187863 · Cited by 195
Jia, J., & Li, Y. (2023) · Sensors · doi:10.3390/s23218824 · Cited by 182
“Generally, the training set’s ratio to the test set is 8:2 [27,36,182,198] or 7:3 [15,58,187].”
BackgroundYuan, Q., Shi, Y., & Li, M. (2024) · Remote Sensing · doi:10.3390/rs16162910 · Cited by 158
Recent advances in crack detection technologies for structures: a survey of 2022-2023 literature
Kaveh, H., & Alhajj, R. (2024) · Frontiers in Built Environment · doi:10.3389/fbuil.2024.1321634 · Cited by 58
A scientometric analysis of drone-based structural health monitoring and new technologies
Fayyad, T. M., Taylor, S. E., Feng, K., & Hui, F. K. P. (2024) · Advances in Structural Engineering · doi:10.1177/13694332241255734 · Cited by 44
Metadata
- Authors
- Kao, S.-P., Chang, Y.-C., & Wang, F.-L.
- Affiliations
- National Chung Hsing University (TW)
- Corresponding author
- Wang, Feng-Liang
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2023-02-25
- Volume
- 23
- Issue
- 5
- Pages
- 2572
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC10007411
- OpenAlex
- W4322502428
- Cited by
- 40
- References
- 42
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 14 · 2023: 11
- FWCI
- 4.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science and Technology Council (NSTC) of Taiwan (NSTC 111-2622-M-005-001)
- Topics
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Physical Sciences › Engineering › Civil and Structural Engineering › Structural Health Monitoring Techniques
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Keywords
- bridge crack detection, crack width measurement, UAV imagery, YOLOv4, object detection, bridge inspection, edge detection, Canny edge detection, morphological edge detection, total station measurements, concrete structures, automated structural inspection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.