Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Automatic metallic surface defect inspection has received increased attention in relation to the quality control of industrial products. Metallic defect detection is usually performed against complex industrial scenarios, presenting an interesting but challenging problem. Traditional methods are based on image processing or shallow machine learning techniques, but these can only detect defects under specific detection conditions, such as obvious defect contours with strong contrast and low noise, at certain scales, or under specific illumination conditions. This paper discusses the automatic detection of metallic defects with a twofold procedure that accurately localizes and classifies defects appearing in input images captured from real industrial environments. A novel cascaded autoencoder (CASAE) architecture is designed for segmenting and localizing defects. The cascading network transforms the input defect image into a pixel-wise prediction mask based on semantic segmentation. The defect regions of segmented results are classified into their specific classes via a compact convolutional neural network (CNN). Metallic defects under various conditions can be successfully detected using an industrial dataset. The experimental results demonstrate that this method meets the robustness and accuracy requirements for metallic defect detection. Meanwhile, it can also be extended to other detection applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





![Figure 6 Segmentation results. The six rows are examples of defective images. ( a1 -a6 ) raw images, ( b1 -b6 ) results of Kittler [19], ( c1 -c6 ) results of Otsu [17], ( d1 -d6 ) results of a fully convolutional network (FCN) [36], ( e1 -e6 ) results of the cascaded autoencoder (CASAE) (proposed).](https://figures.cochat.ai/paper-figures/1442a57acfde49c0bea5ff40d56e9144/automatic-metallic-surface-defect-detection-and-recognition-with-convolutional-figure-6.png)



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Be of rotation and gray invariance, fast calculation speed.”
From Automated Visual Defect Classification for Flat Steel Surface: A Survey (2020) · cites this paper as [85]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Sensitive to scale variation and noise interference.”
From Automated Visual Defect Classification for Flat Steel Surface: A Survey (2020) · cites this paper as [85]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“Our proposed CNN is a compact network that is smaller than the classic classification networks such as GoogleNet [41] and ResNet [42].”
MethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 1×
“We double the number of features after each max pooling layer in order to reduce the loss of semantic information [38,39].”
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517 · cited 1×
“In this paper, atrous convolution [40] is unitized to increase the receptive fields of the network for detecting large defects.”
MethodA survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239 · cited 1×
“AE networks are widely used for information coding and reconstruction [37].”
BackgroundSelf-citationCha, Y., Choi, W., Suh, G., Mahmoudkhani, S., & Büyüköztürk, O. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12334 · Cited by 1,558 · cited 1×
“[33] developed a structural damage detection method based on Faster R-CNN to detect five types of surface damages: concrete cracks, steel corrosion (medium and high levels), bolt corrosion, and steel delamination.”
MethodSong, K., & Yan, Y. (2013) · Applied Surface Science · doi:10.1016/j.apsusc.2013.09.002 · Cited by 1,026 · cited 2×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundImage deformation using moving least squares
Schaefer, S., McPhail, T., & Warren, J. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141920 · Cited by 674
Jia, F., Lei, Y., Lu, N., & Xing, S. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.03.025 · Cited by 587
A Generic Deep-Learning-Based Approach for Automated Surface Inspection
Ren, R., Hung, T., & Tan, K. C. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2668395 · Cited by 485 · cited 1×
“The traditional image processing method uses the primitive attributes reflected by local anomalies to detect and segment defects, which can be further divided into the structural method, threshold method, spectral method, and model-based method [11].”
MethodWang, T., Chen, Y., Qiao, M., & Snoussi, H. (2018) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-017-0882-0 · Cited by 477 · cited 2×
“For the FCN method [32], it can achieve good detection effects for most of the defects.”
MethodChen, J., Liu, Z., Wang, H., Nunez, A., & Han, Z. (2018) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2775345 · Cited by 456 · cited 1×
“[35] proposed a detection system that has three deep convolutional neural network (DCNN) based detection stages, including two detectors to localize key components and a classifier to diagnose their status.”
BackgroundDeep Multitask Learning for Railway Track Inspection
Gibert, X., Patel, V. M., & Chellappa, R. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2568758 · Cited by 441 · cited 2×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundDeformable Patterned Fabric Defect Detection With Fisher Criterion-Based Deep Learning
Li, Y., Zhao, W., & Pan, J. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2016.2520955 · Cited by 265 · cited 1×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundAutomatic surface defect detection for mobile phone screen glass based on machine vision
Jian, C., Gao, J., & Ao, Y. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2016.10.030 · Cited by 242 · cited 1×
“The structural method includes edge [12], skeleton [13], template match [14], and morphological operations [15].”
MethodAutomated defect inspection of LED chip using deep convolutional neural network
Lin, H., Li, B., Wang, X., Shu, Y., & Niu, S. (2019) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-018-1415-x · Cited by 241 · cited 1×
“[34] built a convolutional neural network (CNN) for light emitting diode (LED) chip defect inspection.”
BackgroundFabric defect detection using morphological filters
Mak, K. L., Peng, P., & Yiu, K. F. C. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.03.007 · Cited by 238 · cited 1×
“The structural method includes edge [12], skeleton [13], template match [14], and morphological operations [15].”
MethodAn improved Otsu method using the weighted object variance for defect detection
Yuan, X.-C., Wu, L.-S., & Peng, Q. (2015) · Applied Surface Science · doi:10.1016/j.apsusc.2015.05.033 · Cited by 228 · cited 5×
“The Kittler [19] method tends to miss the detection of defects, while the Otsu [17] method easily over-detects, resulting in a large amount of background noise also being segmented, e.g., in Figure 6(c3,c5).”
BackgroundMethodInfluentialSaliency-Based Defect Detection in Industrial Images by Using Phase Spectrum
Bai, X., Fang, Y., Lin, W., Wang, L., & Ju, B.-F. (2014) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2014.2359416 · Cited by 225 · cited 1×
“The spectral methods commonly include Fourier transform [21], wavelet transform [22], and Gabor transform [23].”
MethodGated Feedback Refinement Network for Dense Image Labeling
Islam, M. A., Rochan, M., Bruce, N. D. B., & Wang, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.518 · Cited by 218 · cited 1×
“We double the number of features after each max pooling layer in order to reduce the loss of semantic information [38,39].”
Tsanakas, J. A., Chrysostomou, D., Botsaris, P. N., & Gasteratos, A. (2015) · International Journal of Sustainable Energy · doi:10.1080/14786451.2013.826223 · Cited by 202 · cited 1×
“The structural method includes edge [12], skeleton [13], template match [14], and morphological operations [15].”
MethodAcoustic based fault diagnosis of three-phase induction motor
Glowacz, A. (2018) · Applied Acoustics · doi:10.1016/j.apacoust.2018.03.010 · Cited by 189
A Contrast Adjustment Thresholding Method for Surface Defect Detection Based on Mesoscopy
Win, M., Bushroa, A. R., Hassan, M. A., Hilman, N. M., & Ide-Ektessabi, A. (2015) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2015.2417676 · Cited by 142 · cited 1×
“The threshold methods include the iterative optimal threshold [16], Otsu method [17], contrast adjustment threshold method [18], Kittler method [19], and watershed method [20], etc.”
MethodDefect Detection in SEM Images of Nanofibrous Materials
Carrera, D., Manganini, F., Boracchi, G., & Lanzarone, E. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2641472 · Cited by 133
A UAV-Based Visual Inspection Method for Rail Surface Defects
Wu, Y., Qin, Y., Wang, Z., & Jia, L. (2018) · Applied Sciences · doi:10.3390/app8071028 · Cited by 126 · cited 1×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundTransfer learning for automated optical inspection
Kim, S., Kim, W., Noh, Y.-K., & Park, F. C. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966162 · Cited by 101 · cited 1×
“As for manufacturers, a lot of efforts have been made to inspect surface defects and the quality control of products [1].”
BackgroundAdaBoost learning for fabric defect detection based on HOG and SVM
Shumin, D., Liu, Z., & Li, C. (2011) · International Conference on Multimedia Technology (ICMT) · doi:10.1109/icmt.2011.6001937 · Cited by 96 · cited 4×
“These features include the local binary patterns (LBP) feature [2], a gray level co-occurrence matrix (GLCM) [7], a histogram of oriented gradient (HOG) features [25], and other grayscale statistical features [8,10].”
BackgroundInfluentialFeature selection for surface defect classification of extruded aluminum profiles
Chondronasios, A., Popov, I., & Jordanov, I. (2015) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-015-7514-3 · Cited by 86 · cited 4×
“(1) GLCM [7]: this feature is the classical texture feature, which includes four typical descriptions: energy, contrast, entropy, and correlation.”
BackgroundInfluentialQuantitative Surface Crack Evaluation Based on Eddy Current Pulsed Thermography
Li, X., Gao, B., Woo, W. L., Tian, G. Y., Qiu, X., & Gu, L. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2625815 · Cited by 86 · cited 1×
“The threshold methods include the iterative optimal threshold [16], Otsu method [17], contrast adjustment threshold method [18], Kittler method [19], and watershed method [20], etc.”
MethodAutomatic texture defect detection using Gaussian mixture entropy modeling
Susan, S., & Sharma, M. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.021 · Cited by 85 · cited 1×
“Model-based methods include the Gaussian mixture entropy model [24] and low-rank matrix model [4].”
MethodAutomated defect detection in textured surfaces using optimal elliptical Gabor filters
Hu, G. (2015) · Optik · doi:10.1016/j.ijleo.2015.04.017 · Cited by 79 · cited 1×
“The spectral methods commonly include Fourier transform [21], wavelet transform [22], and Gabor transform [23].”
MethodConvolutional networks for voting-based anomaly classification in metal surface inspection
Natarajan, V., Hung, T.-Y., Vaikundam, S., & Chia, L.-T. (2017) · 2017 IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit.2017.7915495 · Cited by 79 · cited 1×
“[31] proposed a flexible multi-layered deep feature extraction framework based on CNN via transfer learning to detect anomalies in anomaly datasets.”
BackgroundDefect inspection for TFT-LCD images based on the low-rank matrix reconstruction
Cen, Y., Zhao, R., Cen, L., Cui, L., Miao, Z., & Wei, Z. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.09.007 · Cited by 60 · cited 2×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundMethodMulti-scale pyramidal pooling network for generic steel defect classification
Masci, J., Meier, U., Fricout, G., & Schmidhuber, J. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706920 · Cited by 59 · cited 1×
“[30] used a multi-scale pyramidal pooling network for the classification of steel defects, which can adapt to the input images of different size.”
MethodBeans quality inspection using correlation-based granulometry
de Araújo, S. A., Pessota, J. H., & Kim, H. Y. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.01.004 · Cited by 58 · cited 1×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundWang, L., Zhao, Y., Zhou, Y., & Hao, J. (2016) · Circuit World · doi:10.1108/cw-07-2014-0027 · Cited by 54 · cited 1×
“The threshold methods include the iterative optimal threshold [16], Otsu method [17], contrast adjustment threshold method [18], Kittler method [19], and watershed method [20], etc.”
MethodWeak scratch detection and defect classification methods for a large-aperture optical element
Tao, X., Xu, D., Zhang, Z., Zhang, F., Liu, X.-L., & Zhang, D. (2016) · Optics Communications · doi:10.1016/j.optcom.2016.10.062 · Cited by 52 · cited 2×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundSelf-citationScale insensitive and focus driven mobile screen defect detection in industry
Lei, J., Gao, X., Feng, Z., Qiu, H., & Song, M. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.013 · Cited by 52 · cited 1×
“These machine vision-based inspection systems occur in many industrial applications, such as steel strip inspection [2,3], liquid crystal display (LCD) inspection [4], fabric inspection [5,6], aluminum profiles [7], railway track inspection [8], food inspection [9], and optical components inspection [10].”
BackgroundNeural Networks In Mining Sciences – General Overview And Some Representative Examples
Tadeusiewicz, R. (2015) · Archives of Mining Sciences · doi:10.1515/amsc-2015-0064 · Cited by 51
Borwankar, R. M., & Ludwig, R. (2018) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2783098 · Cited by 48 · cited 1×
“The spectral methods commonly include Fourier transform [21], wavelet transform [22], and Gabor transform [23].”
MethodDesign of the Model for the On-line Control of the AWJ Technology based on Neural Networks
Gánovská, B., Molitoris, M., Hošovský, A., Piteľ, J., Królczyk, J. B., Ruggierio, A., Królczyk, G., & Hloch, S. (2016) · Indian Journal of Engineering and Materials Sciences · Cited by 27
Xiao, Z., Leng, Y., Geng, L., & Xi, J. (2018) · Research Online (University of Wollongong) · Cited by 9
Research works printed but not linked: 2
- Tastimur, 2016, Rail defect detection and classification with real time image processing technique, Int. J. Comput. Sci. Softw. Eng., 5, 283
- Kalaiselvi, 2015, A rapid automatic brain tumor detection method for MRI images using modified minimum error thresholding technique, Int. J. Imaging Syst. Technol., 1, 77
Cited by
A Brief Survey on Semantic Segmentation with Deep Learning
Hao, S., Zhou, Y., & Guo, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.118 · Cited by 596
Survey on semantic segmentation using deep learning techniques
Lateef, F., & Ruichek, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.003 · Cited by 559
“It has several applications in computer vision & artificial intelligence − autonomous driving [2, 3], robot navigation [4], industrial inspection [5]; remote sensing [6]; In cognitive and computational sciences − saliency object detection [7, 8]; In Agriculture sciences [9]; Fashion − categorizing…”
BackgroundAutomated Visual Defect Detection for Flat Steel Surface: A Survey
Luo, Q., Fang, X., Liu, L., Yang, C., & Sun, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2963555 · Cited by 559
“[116] proposed a novel cascaded AE (CASAE) framework to detect some complex defects under industrial environment, which converts test images into pixel-wise prediction mask based on semantic segmentation.”
BackgroundDeep Industrial Image Anomaly Detection: A Survey
Liu, J., Xie, G., Wang, J., Li, S., Wang, C., Zheng, F., & Jin, Y. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1459-z · Cited by 463
Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY
Czimmermann, T., Ciuti, G., Milazzo, M., Chiurazzi, M., Roccella, S., Oddo, C. M., & Dario, P. (2020) · Sensors · doi:10.3390/s20051459 · Cited by 441
Metadata
- Authors
- Tao, X., Zhang, D., Ma, W., Liu, X., & Xu, D.
- Affiliations
- Chinese Academy of Sciences (CN)
- China University of Mining and Technology - Beijing (CN)
- Corresponding author
- Tao, Xian
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2018-09-06
- Volume
- 8
- Issue
- 9
- Pages
- 1575
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W2890747436
- Semantic Scholar
- 10447a2738ff7ac47f8d93c85222ee737412cf53
- Cited by
- 471
- References
- 43
- Citations by year
- 2026: 29 · 2025: 42 · 2024: 60 · 2023: 94 · 2022: 72 · 2021: 82 · 2020: 58 · 2019: 32 · 2018: 2
- FWCI
- 36.08
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- ELARTU (Ternopil National Technical University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Natural Science Foundation of China (61703399, 61503376, 61673383)
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Physical Sciences › Engineering › Mechanical Engineering › Non-Destructive Testing Techniques
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Keywords
- defect localization, defect classification, semantic segmentation, convolutional neural networks, manufacturing quality control, industrial inspection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.