Application of Combining YOLO Models and 3D GPR Images in Road Detection and Maintenance
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Improving the detection efficiency and maintenance benefits is one of the greatest challenges in road testing and maintenance. To address this problem, this paper presents a method for combining the you only look once (YOLO) series with 3D ground-penetrating radar (GPR) images to recognize the internal defects in asphalt pavement and compares the effectiveness of traditional detection and GPR detection by evaluating the maintenance benefits. First, traditional detection is conducted to survey and summarize the surface conditions of tested roads, which are missing the internal information. Therefore, GPR detection is implemented to acquire the images of concealed defects. Then, the YOLOv5 model with the most even performance of the six selected models is applied to achieve the rapid identification of road defects. Finally, the benefits evaluation of maintenance programs based on these two detection methods is conducted from economic and environmental perspectives. The results demonstrate that the economic scores are improved and the maintenance cost is reduced by $49,398/km based on GPR detection; the energy consumption and carbon emissions are reduced by 792,106 MJ/km (16.94%) and 56,289 kg/km (16.91%), respectively, all of which indicates the effectiveness of 3D GPR in pavement detection and maintenance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
(2016) · Cited by 31,590
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581 · cited 1×
“This method primarily includes YOLO [18–20], RetinaNet [21], the single shot multibox detector (SSD) [22,23], and CenterNet [24].”
MethodSSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 2×
“This method primarily includes YOLO [18–20], RetinaNet [21], the single shot multibox detector (SSD) [22,23], and CenterNet [24].”
MethodYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression
Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00075 · Cited by 6,612 · cited 2×
“As for the loss of the bounding box regression, intersection over union (IoU) [39] is”
BackgroundHow transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 1×
“Therefore, transfer learning was adopted to train the models to overcome this hidden danger [40].”
MethodCenterNet: Keypoint Triplets for Object Detection
Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., & Tian, Q. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00667 · Cited by 4,079 · cited 2×
“This method primarily includes YOLO [18–20], RetinaNet [21], the single shot multibox detector (SSD) [22,23], and CenterNet [24].”
MethodCrackTree: Automatic crack detection from pavement images
Zou, Q., Cao, Y., Li, Q., Mao, Q., & Wang, S. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.11.004 · Cited by 1,124 · cited 1×
“However, the inspection results cannot reflect the true conditions of the road at the scene because the setpoint is random and incidental [1,2].”
BackgroundDSOD: Learning Deeply Supervised Object Detectors from Scratch
Shen, Z., Liu, Z., Li, J., Jiang, Y.-G., Chen, Y., & Xue, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.212 · Cited by 646
Self-citationWai-Lok Lai, W., Dérobert, X., & Annan, P. (2018) · NDT & E International · doi:10.1016/j.ndteint.2017.04.002 · Cited by 589 · cited 1×
“GPR is already well recognized for its role in improving the efficiency, security, and anti-interference [3,4].”
BackgroundPavement distress detection and classification based on YOLO network
Du, Y., Pan, N., Xu, Z., Deng, F., Shen, Y., & Kang, H. (2021) · International Journal of Pavement Engineering · doi:10.1080/10298436.2020.1714047 · Cited by 404
Detection of concealed cracks from ground penetrating radar images based on deep learning algorithm
Li, S., Gu, X., Xu, X., Xu, D., Zhang, T., Liu, Z., & Dong, Q. (2021) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2020.121949 · Cited by 279 · cited 1×
“The workflow of dataset construction for GPR images [36].”
MethodSelf-citationEarly recognition of tomato gray leaf spot disease based on MobileNetv2-YOLOv3 model
Liu, J., & Wang, X. (2020) · Plant Methods · doi:10.1186/s13007-020-00624-2 · Cited by 257 · cited 1×
“Above all, YOLO version 3 (YOLOv3) is a mainstream method, and it has been widely used in remote sensing [25,26], agriculture [27], and energy [28].”
MethodZhang, J., Yang, X., Li, W., Zhang, S., & Jia, Y. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103119 · Cited by 182 · cited 1×
“The development of 3D GPR further reinforces these effects [6].”
BackgroundDeep reinforcement learning for long‐term pavement maintenance planning
Yao, L., Dong, Q., Jiang, J., & Ni, F. (2020) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12558 · Cited by 174 · cited 1×
“On the other hand, researchers have performed many studies of the standardization of road testing and maintenance [33,34].”
BackgroundGlobal Road Damage Detection: State-of-the-art Solutions
Arya, D., Maeda, H., Kumar Ghosh, S., Toshniwal, D., Omata, H., Kashiyama, T., & Sekimoto, Y. (2020) · 2020 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata50022.2020.9377790 · Cited by 164
Autonomous pavement distress detection using ground penetrating radar and region-based deep learning
Gao, J., Yuan, D., Zheng, T., Yang, J., & Yu, D. (2020) · Measurement · doi:10.1016/j.measurement.2020.108077 · Cited by 134 · cited 1×
“As for image recognition of GPR detection, many researchers have tried to apply the complex manual processes to automatically inspect internal defects in a road, but this goal is difficult to realize [11,12].”
BackgroundAsphalt Pavement Pothole Detection using Deep learning method based on YOLO Neural Network
Ukhwah, E. N., Yuniarno, E. M., & Suprapto, Y. K. (2019) · International Seminar on Intelligent Technology and Its Applications · doi:10.1109/isitia.2019.8937176 · Cited by 133
Rasol, M., Pérez‐Gracia, V., Fernandes, F. M., Pais, J. C., Santos‐Assunção, S., Santos, C. R. G., & Sossa, V. (2020) · Measurement · doi:10.1016/j.measurement.2020.107662 · Cited by 132 · cited 1×
“[10] presented a formula relating the hidden crack width with the relative amplitude measured in the vertex of the hyperbola.”
BackgroundInnovative method for recognizing subgrade defects based on a convolutional neural network
Zheng, T., Gao, J., & Zhang, H. (2018) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2018.02.081 · Cited by 124
Pang, L., Liu, H., Chen, Y., & Miao, J. (2020) · Sensors · doi:10.3390/s20061678 · Cited by 118 · cited 1×
“Above all, YOLO version 3 (YOLOv3) is a mainstream method, and it has been widely used in remote sensing [25,26], agriculture [27], and energy [28].”
MethodPavement-distress detection using ground-penetrating radar and network in networks
Zheng, T., Yuan, D., Gao, J., Wei, Y., & Dou, H. (2019) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2019.117352 · Cited by 117
Pavement defect detection with fully convolutional network and an uncertainty framework
Zheng, T., Yuan, D., Gao, J., & Wang, Z. (2020) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12533 · Cited by 88
3D GPR Image-based UcNet for Enhancing Underground Cavity Detectability
Kang, M.-S., Kim, N., Im, S. B., et al. (2019) · Remote Sensing · doi:10.3390/rs11212545 · Cited by 66 · cited 1×
“It was not until the appearance of deep learning (DL), the real, efficient, automatic detection of concealed defects became possible in asphalt pavement [13,14].”
BackgroundZhao, S., & Al‐Qadi, I. L. (2016) · Signal Processing · doi:10.1016/j.sigpro.2016.06.015 · Cited by 57 · cited 1×
“GPR is already well recognized for its role in improving the efficiency, security, and anti-interference [3,4].”
BackgroundImproved UAV Opium Poppy Detection Using an Updated YOLOv3 Model
Zhou, J., Tian, Y., Yuan, C., Yin, K., Yang, G., & Meiping, W. (2019) · Sensors · doi:10.3390/s19224851 · Cited by 55 · cited 1×
“Above all, YOLO version 3 (YOLOv3) is a mainstream method, and it has been widely used in remote sensing [25,26], agriculture [27], and energy [28].”
MethodSuper-Resolution of 3-D GPR Signals to Estimate Thin Asphalt Overlay Thickness Using the XCMP Method
Zhao, S., & Al‐Qadi, I. L. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2862627 · Cited by 46 · cited 1×
“Radar-collected data can provide the basis for recognizing hidden defects and be used to conduct the later maintenance and management of roads [5].”
MethodResearch on GPR image recognition based on deep learning
Gong, Z., & Zhang, H. (2020) · MATEC Web of Conferences · doi:10.1051/matecconf/202030903027 · Cited by 17
Cited by
Chen, J., Dan, H., Ding, Y., Gao, Y., Guo, M., Guo, S., Han, B., Hong, B., Hou, Y., Hu, C., et al. (2021) · Journal of Traffic and Transportation Engineering (English Edition) · doi:10.1016/j.jtte.2021.10.001 · Cited by 183
Self-citation
Metadata
- Authors
- Liu, Z., Wu, W., Gu, X., Li, S., Wang, L., & Zhang, T.
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2021-03-12
- Volume
- 13
- Issue
- 6
- Pages
- 1081
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W3139399265
- Cited by
- 183
- References
- 30
- FWCI
- 14.80
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.