A deep learning-based surface defect inspection system using multi-scale and channel-compressed features
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
In machine vision-based surface inspection tasks, defects are typically considered as local anomalies in homogeneous background. However, industrial workpieces commonly contain complex structures, including hallow regions, welding joints, or rivet holes. Such obvious structural interference will inevitably cause a cluttered background and mislead the classification results. Moreover, the sizes of various surface defects might change significantly. Last but not least, it is extremely time-consuming and not scalable to capture large-scale defect data sets to train deep CNN models. To address the challenges mentioned earlier, we first proposed to incorporate multiple convolutional layers with different kernel sizes to increase the receptive field and to generate multiscale features. As a result, the proposed model can better handle the cluttered background and defects of various sizes. Also, we purposely compress the size of parameters in the newly added convolutional layers for better learning of defect-related features using a limited number of training samples. Evaluated in a newly constructed surface defect data set (images contain complex structures and defects of various sizes), our proposed model achieves more accurate recognition results compared with the state-of-the-art surface defect classifiers. Moreover, it is a lightweight model and can deliver real-time processing speed (>100 frames/s) on a computer equipped with a single NVIDIA TITAN X Graphics Processing Unit (12-GB memory).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 2×
“However, they directly apply the pretrained Decaf model [26] for defect-specific feature extraction.”
MethodContext Encoding for Semantic Segmentation
Zhang, H., Dana, K., Shi, J., Zhang, Z., Wang, X., Tyagi, A., & Agrawal, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00747 · Cited by 1,464
A convolutional neural network cascade for face detection
Li, H., Lin, Z., Shen, X., Brandt, J., & Hua, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299170 · Cited by 1,390
An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features
He, Y., Song, K., Meng, Q., & Yan, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2915404 · Cited by 1,341 · cited 1×
“Different from many previous data sets (e.g., hot-rolled steel [15], [31], wood [32], or fabric [33]), the target workpieces (USB connectors) contain complex structures, including hallow areas, welding joints, and rivet holes.”
BackgroundEnd-to-End Incremental Learning
Castro, F. M., Marín-Jiménez, M. J., Guil, N., Schmid, C., & Alahari, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01258-8_15 · Cited by 1,184
Fully Convolutional Instance-Aware Semantic Segmentation
Li, Y., Qi, H., Dai, J., Ji, X., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.472 · Cited by 1,116 · cited 1×
“It is also worth investigating how to improve the existing semantic segmentation techniques [18], [44], [45] for fast and accurate pixelwise surface defect detection/classification in industrial inspection tasks.”
BackgroundSong, K., & Yan, Y. (2013) · Applied Surface Science · doi:10.1016/j.apsusc.2013.09.002 · Cited by 1,026 · cited 8×
“We compare the proposed SN-MRF-CC model with a number of state-of-the-art surface defect recognition methods [15], [24], [25], [27], [34], [38].”
BackgroundMethodResultInfluentialA Generic Deep-Learning-Based Approach for Automated Surface Inspection
Ren, R., Hung, T., & Tan, K. C. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2668395 · Cited by 485
Fabric defect detection by Fourier analysis
Chan, C.-H., & Pang, G. K. H. (2000) · IEEE Transactions on Industry Applications · doi:10.1109/28.871274 · Cited by 443
Review of vision-based steel surface inspection systems
Neogi, N., Mohanta, D. K., & Dutta, P. K. (2014) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2014-50 · Cited by 322 · cited 1×
“However, it is highly subjective, labor-intensive, and time-consuming to train/deploy human inspectors to perform visual quality inspection on a daily basis [4].”
BackgroundAutomatic Defect Detection on Hot-Rolled Flat Steel Products
Ghorai, S., Mukherjee, A., Gangadaran, M., & Dutta, P. K. (2013) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2012.2218677 · Cited by 317 · cited 1×
“Then, various feature classifiers, such as thresholding scheme [11], support vector machine (SVM) [12], Markov random fields (MRFs) [13], and neural networks (NNs) [14], are utilized to differentiate defect and normal image patches.”
MethodA deep-learning-based approach for fast and robust steel surface defects classification
Fu, G., Sun, P., Zhu, W., Yang, J., Cao, Y., Yang, M. Y., & Cao, Y. (2019) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2019.05.005 · Cited by 271
Self-citationAn End‐to‐End Steel Strip Surface Defects Recognition System Based on Convolutional Neural Networks
Yi, L., Li, G., & Jiang, M. (2017) · steel research international · doi:10.1002/srin.201600068 · Cited by 173 · cited 7×
“In our experiments, we consider the ETE CNN model proposed by Li et al. [24], the Decaf model-based approach (DECAF + MLR) proposed by Ren et al. [25], and the SqueezeNet-based model proposed by Fu et al. [27].”
BackgroundMethodResultInfluential
Metadata
- Authors
- Yang, J., Fu, G., Zhu, W., Cao, Y., Cao, Y., & Yang, M. Y.
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2020
- Pages
- 1-1
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W3015382364
- Cited by
- 189
- References
- 20
- FWCI
- 14.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.