Bolt Loosening Detection Using Key-Point Detection Enhanced by Synthetic Datasets
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Machine vision based on deep learning is gaining more and more applications in structural health monitoring (SHM) due to the rich information that can be achieved in the images. Bolts are widely used in the connection of steel structures, and their loosening can compromise the safety of steel structures and lead to serious accidents. Therefore, this paper proposes a method for the automatic detection of the bolt loosening angle based on the latest key point detection technology using machine vision and deep learning. First, we built a virtual laboratory in Unreal Engine5 that could automatically label and generate synthetic datasets, and the datasets with bolts were collected. Second, the datasets were trained using the YOLOv7-pose framework, and the resulting model was able to accurately detect key points of bolts in images obtained under different angles and lighting conditions. Third, a bolt loosening angle calculation method was proposed according to the detected key points and the position relationship between neighboring bolts. Our results demonstrate that the proposed method is effective at detecting the bolt loosening angle and that the use of synthetic datasets significantly improves the efficiency of datasets establishment while also improving the performance of model training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“DL-based SHM mainly uses structural damage images to classify or segment surface defects to achieve crack detection [130,131,132], bolt loosening detection [47], steel bar exposure detection [49,133], or vehicle recognition through vehicle images captured by road cameras [134,135].”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
Papandreou, G., Zhu, T., Chen, L.-C., Gidaris, S., Tompson, J., & Murphy, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_17 · Cited by 621
PifPaf: Composite Fields for Human Pose Estimation
Kreiss, S., Bertoni, L., & Alahi, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01225 · Cited by 538
YOLO-Pose: Enhancing YOLO for Multi Person Pose Estimation Using Object Keypoint Similarity Loss
Maji, D., Nagori, S., Mathew, M., & Poddar, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00297 · Cited by 533
Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression
Geng, Z., Sun, K., Xiao, B., Zhang, Z., & Wang, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01444 · Cited by 401
Vision-based detection of loosened bolts using the Hough transform and support vector machines
Cha, Y.-J., You, K., & Choi, W. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.06.008 · Cited by 328
Handbook of Bolts and Bolted Joints
(1998) · CRC Press eBooks · doi:10.1201/9781482273786 · Cited by 300
Learning Semantic Segmentation of Large-Scale Point Clouds with Random Sampling
Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., & Markham, A. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3083288 · Cited by 223
Huynh, T.-C., Park, J.-H., Jung, H.-J., & Kim, J.-T. (2019) · Automation in Construction · doi:10.1016/j.autcon.2019.102844 · Cited by 208
Autonomous bolt loosening detection using deep learning
Zhang, Y., Sun, X., Loh, K. J., Su, W., Xue, Z., & Zhao, X. (2020) · Structural Health Monitoring · doi:10.1177/1475921719837509 · Cited by 189
Self-citationA comprehensive review of loosening detection methods for threaded fasteners
Huang, J., Liu, J., Gong, H., & Deng, X. (2022) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.108652 · Cited by 177
A Review Paper on Looseness Detection Methods in Bolted Structures
Nikravesh, S. M. Y., & Goudarzi, M. (2017) · Latin American Journal of Solids and Structures · doi:10.1590/1679-78254231 · Cited by 163
A Review of Bolt Tightening Force Measurement and Loosening Detection
Miao, R., Shen, R., Zhang, S., & Xue, S. (2020) · Sensors · doi:10.3390/s20113165 · Cited by 163
Chaki, S., Corneloup, G., Lillamand, I., & Walaszek, H. (2006) · Journal of Pressure Vessel Technology · doi:10.1115/1.2748821 · Cited by 143
Bolt loosening angle detection technology using deep learning
Zhao, X., Zhang, Y., & Wang, N. (2019) · Structural Control and Health Monitoring · doi:10.1002/stc.2292 · Cited by 133
Self-citationReview of research on loosening of threaded fasteners
Gong, H., Ding, X., Liu, J., & Feng, H. (2021) · Friction · doi:10.1007/s40544-021-0497-1 · Cited by 112
Image Registration-Based Bolt Loosening Detection of Steel Joints
Kong, X., & Li, J. (2018) · Sensors · doi:10.3390/s18041000 · Cited by 111
Pan, X., & Yang, T. Y. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12797 · Cited by 91
Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
Pham, H. C., Ta, Q.-B., Kim, J.-T., Ho, D.-D., Tran, X.-L., & Huynh, T.-C. (2020) · Sensors · doi:10.3390/s20123382 · Cited by 86
Chen, D., Huo, L., Li, H., & Song, G. (2018) · Sensors · doi:10.3390/s18082586 · Cited by 83
Vision-Based Detection of Bolt Loosening Using YOLOv5
Sun, Y., Li, M., Dong, R., Chen, W., & Jiang, D. (2022) · Sensors · doi:10.3390/s22145184 · Cited by 78
Gong, H., Deng, X., Liu, J., & Huang, J. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.104009 · Cited by 74
Near real‐time bolt‐loosening detection using mask and region‐based convolutional neural network
Yuan, C., Chen, W., Hao, H., & Kong, Q. (2021) · Structural Control and Health Monitoring · doi:10.1002/stc.2741 · Cited by 64
Monitoring of Corroded and Loosened Bolts in Steel Structures via Deep Learning and Hough Transforms
Ta, Q.-B., & Kim, J. (2020) · Sensors · doi:10.3390/s20236888 · Cited by 52
Bolt-loosening identification of bolt connections by vision image-based technique
Nguyen, T.-C., Huynh, T., Ryu, J.-Y., Park, J. H., & Kim, J. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2219055 · Cited by 48
A Vision-Based Monitoring Method for the Looseness of High-Strength Bolt
Pan, Y., Ma, Y., Dong, Y., Gu, Z., & Wang, D. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3101316 · Cited by 44
Detection of loosening angle for mark bolted joints with computer vision and geometric imaging
Deng, X., Liu, J., Gong, H., & Huang, J. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104517 · Cited by 41
Yu, Y., Liu, Y., Chen, J., Jiang, D., Zhuang, Z., & Wu, X. (2021) · Sensors · doi:10.3390/s21093106 · Cited by 40
Zheng, C., Bian, F., Li, L., Xie, X., Liu, H., Liang, J., Chen, X., Wang, Z., Qiao, T., Yang, J., et al. (2021) · Translational Vision Science & Technology · doi:10.1167/tvst.10.4.34 · Cited by 39
Meher, U., Mishra, S., & Sunny, M. R. (2022) · Structural Control and Health Monitoring · doi:10.1002/stc.3049 · Cited by 35
Automated Vision-Based Loosened Bolt Detection Using the Cascade Detector
Ramana, L., Choi, W., & Cha, Y. (2017) · Conference proceedings of the Society for Experimental Mechanics · doi:10.1007/978-3-319-54987-3_4 · Cited by 22
Hou, X., Guo, W., Ren, S., Li, Y., Si, Y., & Su, L. (2022) · Materials · doi:10.3390/ma15196757 · Cited by 19
Pal, J., Sikdar, S., Banerjee, S., & Banerji, P. (2022) · Applied Sciences · doi:10.3390/app122111107 · Cited by 11
A Detection Method of Bolts on Axlebox Cover Based on Cascade Deep Convolutional Neural Network
Wang, J., Li, L., Zheng, S., Zhao, S., Chai, X., Peng, L., Qi, W., & Tong, Q. (2022) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2022.022143 · Cited by 10
An image-based feature tracking approach for bolt loosening detection in steel connections
Kong, X., & Li, J. (2018) · Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems · doi:10.1117/12.2296609 · Cited by 8
Deng, X., Liu, J., Gong, H., & Huang, J. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-01948-7 · Cited by 6
A novel bottom-up keypoints based hexagon bolts detection method
Wu, Y., & Sun, J. (2020) · Applied Optics and Photonics China (AOPC) · doi:10.1117/12.2579855 · Cited by 1
Research works printed but not linked: 2
- Li, 2019, Cascade convolutional neural network based abnormal detection of fasteners, J. Electron. Meas. Instrum., 33, 171
- Wang, C., Alexey, B., and Liao, M.H. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.
Cited by
Jia, J., & Li, Y. (2023) · Sensors · doi:10.3390/s23218824 · Cited by 182
“…defect images of bridges, frame structures, dams, tunnels, and other infrastructures for crack detection [40–44], bolt loosening detection [45–47], rebar surface defect detection [48], delamination and reinforcement exposure detection [49], displacement detection [50–53], voids detection…”
BackgroundMethodQiu, S., Cai, B., Wang, W., Wang, J., Zaheer, Q., Liu, X., Hu, W., & Peng, J. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105363 · Cited by 94
Lin, T.-H., Chang, C.-T., & Putranto, A. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108618 · Cited by 29
Zhang, W., Wan, H., & Todd, M. D. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103373 · Cited by 26
Nieminen, W., Gebreweld, H. B., Liuha, A., Nissinen, M., Verdugo, M., Mikkola, A., & Kutvonen, A. (2026) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-026-02795-6 · Cited by 21
Metadata
- Authors
- Lu, Q., Jing, Y., & Zhao, X.
- Affiliations
- Dalian University of Technology (CN)
- Corresponding author
- Zhao, Xuefeng
- ORCID
- Zhao, Xuefeng
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2023-02-03
- Volume
- 13
- Issue
- 3
- Pages
- 2020
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W4319319095
- Cited by
- 28
- References
- 43
- Citations by year
- 2026: 11 · 2025: 10 · 2024: 6 · 2023: 1
- FWCI
- 3.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Physical Sciences › Engineering › Mechanical Engineering › Engineering Structural Analysis Methods
- Keywords
- bolt loosening detection, keypoint detection, synthetic data generation, Unreal Engine 5, structural health monitoring, virtual laboratory, machine vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.