A Generic Automated Surface Defect Detection Based on a Bilinear Model
Open accessThe DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
Aiming at the problems of complex texture, variable interference factors and large sample acquisition in surface defect detection, a generic method of automated surface defect detection based on a bilinear model was proposed. To realize the automatic classification and localization of surface defects, a new Double-Visual Geometry Group16 (D-VGG16) is firstly designed as feature functions of the bilinear model. The global and local features fully extracted from the bilinear model by D-VGG16 are output to the soft-max function to realize the automatic classification of surface defects. Then the heat map of the original image is obtained by applying Gradient-weighted Class Activation Mapping (Grad-CAM) to the output features of D-VGG16. Finally, the defects in the original input image can be located automatically after processing the heat map with a threshold segmentation method. The training process of the proposed method is characterized by a small sample, end-to-end, and is weakly-supervised. Furthermore, experiments are performed on two public and two industrial datasets, which have different defective features in texture, shape and color. The results show that the proposed method can simultaneously realize the classification and localization of defects with different defective features. The average precision of the proposed method is above 99% on the four datasets, and is higher than the known latest algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures












Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
(2016) · Cited by 31,590
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Research works printed but not linked: 5
- Santoyo, 2019, Reconocimiento de patrones y evaluación del daño generado en aceros de baja aleación a partir del procesamiento digital de imágenes e inteligencia artificial, DYNA Ing. Ind., 94, 357
- Lin, M., Chen, Q., and Yan, S. (2013, January 2–4). Network in network. Proceedings of the International Conference on Learning Representations (ICLR), Scottsdale, AZ, USA.
- Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. How transferable are features in deep neural networks? In Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada, 8–13 December 2014; pp.
- Ostu, 1975, A threshold selection method from gray-histogram, IEEE Trans. Syst. Man Cybern., 9, 62
- Song, 2014, Automatic recognition of surface defects on hot-rolled steel strip using scattering convolution network, J. Comput. Inf. Syst., 10, 3049
Cited by
Automated Visual Defect Detection for Flat Steel Surface: A Survey
Luo, Q., Fang, X., Liu, L., Yang, C., & Sun, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2963555 · Cited by 559
Deep CNN-based visual defect detection: Survey of current literature
Jha, S. B., & Babiceanu, R. F. (2023) · Computers in Industry · doi:10.1016/j.compind.2023.103911 · Cited by 224
Steel Surface Defect Recognition: A Survey
Wen, X., Shan, J., He, Y., & Song, K. (2022) · Coatings · doi:10.3390/coatings13010017 · Cited by 210
Research Progress of Automated Visual Surface Defect Detection for Industrial Metal Planar Materials
Fang, X., Luo, Q., Zhou, B., Li, C., & Tian, L. (2020) · Sensors · doi:10.3390/s20185136 · Cited by 160
A lightweight detector based on attention mechanism for aluminum strip surface defect detection
Ma, Z., Li, Y., Huang, M., Huang, Q., Cheng, J., & Tang, S. Y. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103585 · Cited by 131
Ieracitano, C., Paviglianiti, A., Campolo, M., Hussain, A., Pasero, E. G. A., & Morabito, F. C. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003387 · Cited by 101
Auto-Annotated Deep Segmentation for Surface Defect Detection
Tsai, D., Fan, S. S., & Chou, Y.-H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3087826 · Cited by 100
Damage detection using in-domain and cross-domain transfer learning
Bukhsh, Z. A., Jansen, N., & Saeed, A. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06279-x · Cited by 69
Wu, Q., Qin, X., Dong, K., Shi, A., & Hu, Z. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118966 · Cited by 69
A Survey of Vision-Based Methods for Surface Defects’ Detection and Classification in Steel Products
Ibrahim, A. A. M. S., & Tapamo, J. (2024) · Informatics · doi:10.3390/informatics11020025 · Cited by 70
Tout, K., Meguenani, A., Urban, J.-P., & Cudel, C. (2021) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-020-06467-4 · Cited by 48
Defect attention template generation cycleGAN for weakly supervised surface defect segmentation
Niu, S., Li, B., Wang, X., He, S., & Peng, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108396 · Cited by 48
Automated detection of textured-surface defects using UNet-based semantic segmentation network
Enshaei, N., Ahmad, S., & Naderkhani, F. (2020) · IEEE Conference on Prognostics and Health Management · doi:10.1109/icphm49022.2020.9187023 · Cited by 41
Pervez, M. R., Ahamed, M. H., Ahmed, M. A., Takrim, S. M., & Dario, P. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.11.009 · Cited by 45
Nahar, L., Awrangjeb, M., & Islam, M. S. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.104067 · Cited by 48
Zeng, L., Zhang, S., Wang, P., Li, Z., Hu, Y., & Xie, T. (2023) · Measurement Science and Technology · doi:10.1088/1361-6501/acb9ae · Cited by 29
Steel Strip Surface Defect Identification using Multiresolution Binarized Image Features
Mentouri, Z., Moussaoui, A., Boudjehem, D., & Doghmane, H. (2020) · Journal of Failure Analysis and Prevention · doi:10.1007/s11668-020-01012-7 · Cited by 31
TL-SDD: A Transfer Learning-Based Method for Surface Defect Detection with Few Samples
Cheng, J., Guo, B., Liu, J., Liu, S., Wu, G., Sun, Y., & Yu, Z. (2021) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom53800.2021.00023 · Cited by 24
Deep multi-sensorial data analysis for production monitoring in hard metal industry
Kotsiopoulos, T., Leontaris, L., Dimitriou, N., Ioannidis, D., Oliveira, F. J., Sacramento, J., Amanatiadis, S. A., Karagiannis, G. T., Votis, K., Tzovaras, D. K., et al. (2020) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-020-06173-1 · Cited by 22
Hussain, T., Hong, J., & Seok, J. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.050884 · Cited by 25
Faster Metallic Surface Defect Detection Using Deep Learning with燙hannel燬huffling
Yasir, S. M., & Ahn, H. (2023) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.035698 · Cited by 35
Wu, Q., Hu, Z., Qin, X., Huang, B., Dong, K., & Shi, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122225 · Cited by 20
Tian, S., Ma, H., Huang, P., Wang, X., Li, T., & Huang, R. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108887 · Cited by 21
Canned Food Surface Defect Classification Using YOLOv4
Asenci, A. G., Bulawan, J. E. D. C., & Padilla, D. A. (2022) · International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) · doi:10.1109/isriti56927.2022.10052809 · Cited by 14
Improved cross pattern approach for steel surface defect recognition
Mentouri, Z., Doghmane, H., Moussaoui, A., & Bourouba, H. (2020) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-020-06050-x · Cited by 15
Enhancing surface detection: A comprehensive analysis of various YOLO models
Raj, G. D., & Prabadevi, B. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e42433 · Cited by 20
Breitenbach, J., Eckert, I., Mahal, V., Baumgartl, H., & Buettner, R. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.151 · Cited by 14
Qiao, J., Sun, C., Cheng, X., Yang, J., & Chen, N. (2023) · Measurement Science and Technology · doi:10.1088/1361-6501/ad1228 · Cited by 12
Boudiaf, A., Benlahmidi, S., Dahane, A., & Bouguettaya, A. (2024) · Journal of Failure Analysis and Prevention · doi:10.1007/s11668-024-01927-5 · Cited by 14
de Lacalle, L. N. L., & Posada, J. (2019) · Applied Sciences · doi:10.3390/app9204323 · Cited by 8
Defect Detection of Metal Nuts Applying Convolutional Neural Networks
Sauter, D., Schmitz, A., Dikici, F., Baumgartl, H., & Buettner, R. (2021) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac51774.2021.00043 · Cited by 9
Klamert, V., Achsel, T., Toker, E., Bublin, M., & Otto, A. (2023) · Applied Sciences · doi:10.3390/app132011273 · Cited by 5
Surface Defect Detection based on Improved YOLOv3-Tiny Algorithm
Yuan, H., He, Y., Zheng, X., Li, C., & Wu, A. (2022) · Chinese Control Conference (CCC) · doi:10.23919/ccc55666.2022.9902500 · Cited by 6
Surface Defect Detection of High Precision Cylindrical Metal Parts Based on Machine Vision
Jiang, Y., Li, C., Zhang, X., Wang, J., & Liu, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89098-8_76 · Cited by 4
Deep-Learning-Based Surface Texture Feature Simulation for Surface Defect Inspection
Ho, C.-C., Tai, L.-L., & Su, E. (2022) · Symmetry · doi:10.3390/sym14071465 · Cited by 4
Automatic Anode Rod Inspection in Aluminum Smelters using Deep-Learning Techniques: A Case Study
Chehri, H., Chehri, A., Kiss, L. I., & Zimmerman, A. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.09.033 · Cited by 4
Çift Doğrusal CNN Kullanarak Çelik Yüzey Kusurlarının Sınıflandırılması
Güçlü, E., Aydın, İ., & Akın, E. (2024) · Fırat Üniversitesi Mühendislik Bilimleri Dergisi · doi:10.35234/fumbd.1323339 · Cited by 2
A deep transfer learning-based algorithm for concrete surface defect detection
Jin, Z., & Wang, L. (2024) · Engineering Research Express · doi:10.1088/2631-8695/ad5e34 · Cited by 1
Stanisavljev, S., Ćoćkalo, D., Kavalić, M., Gluvakov, V., Bakator, M., Djordjević, L., & Ugrinov, S. (2025) · Systems · doi:10.3390/systems13080628 · Cited by 1
Machine Learning in Smart Manufacturing: Challenges and Solutions
Adalat, O., Polovina, N., & Konur, S. (2026) · Applied Sciences · doi:10.3390/app16178599 · Cited by 1
Tahir, M. N., Khalid, Z., & Aslam, A. (2022) · International Conference on Mechatronics and Machine Vision in Practice (M2VIP) · doi:10.1109/m2vip55626.2022.10041095 · Cited by 1
Reinforcement learning-based approach for plastic texture surface defects inspection
Ho, C.-C., Chiao, Y.-C., & Su, E. (2023) · The Visual Computer · doi:10.1007/s00371-023-03077-5 · Cited by 1
Schwarze, B., & Edelkamp, S. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02306-x · Cited by 3
Surface Defect Detection of Bearings based on Machine Vision
Yao, J., & Dong, T. (2025) · International Journal of High Speed Electronics and Systems · doi:10.1142/s012915642540261x · Cited by 1
Defects Detection by Approximation, Multilevel Segmentation and Comparison of Samples
Melnyk, R. A., Tushnytskyy, R., & Havrylko, Y. (2020) · IEEE International Conference on Computer Sciences and Information Technologies (CSIT) · doi:10.1109/csit49958.2020.9321870
Detection System Based on Deep Learning Applied to the Synthesis of Plastic Texture Surface DefectsPreprint
Ho, C.-C., Chiao, Y.-C., Tai, L.-L., & Su, E. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4132017
LCD-YOLO: an automatic steel surface defect detection model based on YOLOv11
Song, J., Liu, X., Du, H., & Yang, M. (2026) · International Journal of Structural Integrity · doi:10.1108/ijsi-07-2025-0176 · Cited by 2
Metadata
- Authors
- Zhou, F., Liu, G., Xu, F., & Deng, H.
- Affiliations
- Southwest University of Science and Technology (CN)
- Corresponding author
- Liu, Guihua
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2019-08-03
- Volume
- 9
- Issue
- 15
- Pages
- 3159
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W2965258271
- Semantic Scholar
- 08b361036d68c16a57a1b17e0d623ef10a02d4ee
- Cited by
- 47
- References
- 33
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 7 · 2023: 7 · 2022: 8 · 2021: 10 · 2020: 8 · 2019: 1
- FWCI
- 4.98
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Natural Science Foundation of China (11602292, 61701421, 61601381)
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Physical Sciences › Engineering › Mechanical Engineering › Non-Destructive Testing Techniques
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Keywords
- surface defect detection, bilinear model, Grad-CAM, heatmaps, defect localization, defect classification, weakly supervised learning, end-to-end learning, thresholding, industrial inspection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.