A Generic Deep-Learning-Based Approach for Automated Surface Inspection
The DOI matches its Crossref record; 39 of the 44 references it cites were found in a registry or an index.
Abstract
Automated surface inspection (ASI) is a challenging task in industry, as collecting training dataset is usually costly and related methods are highly dataset-dependent. In this paper, a generic approach that requires small training data for ASI is proposed. First, this approach builds classifier on the features of image patches, where the features are transferred from a pretrained deep learning network. Next, pixel-wise prediction is obtained by convolving the trained classifier over input image. An experiment on three public and one industrial data set is carried out. The experiment involves two tasks: 1) image classification and 2) defect segmentation. The results of proposed algorithm are compared against several best benchmarks in literature. In the classification tasks, the proposed method improves accuracy by 0.66%-25.50%. In the segmentation tasks, the proposed method reduces error escape rates by 6.00%-19.00% in three defect types and improves accuracies by 2.29%-9.86% in all seven defect types. In addition, the proposed method achieves 0.0% error escape rate in the segmentation task of industrial data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Be of rotation and gray invariance, fast calculation speed.”
From Automated Visual Defect Classification for Flat Steel Surface: A Survey (2020) · cites this paper as [84]
In the citing paper
“Sensitive to scale variation and noise interference.”
From Automated Visual Defect Classification for Flat Steel Surface: A Survey (2020) · cites this paper as [84]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 7×
“In terms of the quality of fc6 and fc7 as image representation, fc6 is a more generalized image feature than fc7 and the former outperforms the latter in majority of image-related tasks [23].”
BackgroundMethodInfluentialOverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680 · cited 1×
“The second challenge is that ASI requires precise identification of defect area, while conventional DL networks are usually for image classification or bounding box generation [21], [22].”
BackgroundDescribing Textures in the Wild
Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., & Vedaldi, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.461 · Cited by 2,438
Song, K., & Yan, Y. (2013) · Applied Surface Science · doi:10.1016/j.apsusc.2013.09.002 · Cited by 1,026 · cited 2×
“The first public database is the NEU surface defect [29].”
BackgroundA Review of Recent Advances in Surface Defect Detection using Texture analysis Techniques
Xie, X. (2008) · ELCVIA Electronic Letters on Computer Vision and Image Analysis · doi:10.5565/rev/elcvia.268 · Cited by 500
GDXray: The Database of X-ray Images for Nondestructive Testing
Mery, D., Riffo, V., Zscherpel, U., Mondragón, G., Lillo, I., Zuccar, I., Lobel, H., & Carrasco, M. (2015) · Journal of Nondestructive Evaluation · doi:10.1007/s10921-015-0315-7 · Cited by 492
Pattern recognition engineering
Nadler, M., & Smith, E. P. (1993) · Cited by 362
Automated inspection of textile fabrics using textural models
Cohen, F. S., Fan, Z., & Attali, S. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.85670 · Cited by 320
Valavanis, I., & Kosmopoulos, D. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.04.082 · Cited by 208
Identifying and Locating Surface Defects in Wood: Part of an Automated Lumber Processing System
Conners, R. W., Mcmillin, C. W., Lin, K., & Vasquez-Espinosa, R. E. (1983) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1983.4767446 · Cited by 201
An intelligent real-time vision system for surface defect detection
Jia, H., Murphey, Y. L., Shi, J., & Chang, T.-S. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1334512 · Cited by 174 · cited 1×
“Existing ASI methods for microstructured data usually apply on regular patterns [40], [41].”
MethodWood inspection with non-supervised clustering
Silv�n, O., Niskanen, M., & Kauppinen, H. (2003) · Machine Vision and Applications · doi:10.1007/s00138-002-0084-z · Cited by 164
TEXEMS: Texture Exemplars for Defect Detection on Random Textured Surfaces
Xie, X., & Mirmehdi, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1038 · Cited by 159
Fourier Transform Analysis of Plain Weave Fabric Appearance
Hosseini Ravandi, S. A., & Toriumi, K. (1995) · Textile Research Journal · doi:10.1177/004051759506501108 · Cited by 138
Detection of surface defects on raw steel blocks using Bayesian network classifiers
Pernkopf, F. (2004) · Pattern Analysis and Applications · doi:10.1007/s10044-004-0232-3 · Cited by 113
A fractal image analysis system for fabric inspection based on a box-counting method
Conci, A., & Proença, C. B. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00211-6 · Cited by 85
Detecting Defects in Fabric with Laser-Based Morphological Image Processing
Mallik-Goswami, B., & Datta, A. K. (2000) · Textile Research Journal · doi:10.1177/004051750007000902 · Cited by 82
Estimated accuracy of classification of defects detected in welded joints by radiographic tests
da Silva, R. R., Siqueira, M. H. S., de Souza, M. P. V., Rebello, J. M. A., & Calôba, L. P. (2004) · NDT & E International · doi:10.1016/j.ndteint.2004.10.007 · Cited by 81
How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier
Hu, J., Tang, H., Tan, K. C., & Li, H. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2016.2532268 · Cited by 76
Self-citationA Structural Approach To Identify Defects In Textured Images
Chen, J., & Jain, A. K. (2005) · Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1988.754234 · Cited by 67
Liu, J. J., & MacGregor, J. F. (2006) · Machine Vision and Applications · doi:10.1007/s00138-005-0009-8 · Cited by 63
Statistical classification of raw textile defects
Murino, V., Bicego, M., & Rossi, I. A. (2004) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2004.1333765 · Cited by 62
Hierarchical classification of surface defects on dusty wood boards
Kim, C.-W., & Koivo, A. J. (1994) · Pattern Recognition Letters · doi:10.1016/0167-8655(94)90076-0 · Cited by 61
Automatic visual inspection of woven textiles using a two-stage defect detector
Campbell, J. G. (1998) · Optical Engineering · doi:10.1117/1.601692 · Cited by 58
Statistical classification of raw textile defects
Murino, V., Bicego, M., & Rossi, I. A. (2004) · Cited by 48
Verifying edges for visual inspection purposes
Wen, W., & Xia, A. (1999) · Pattern Recognition Letters · doi:10.1016/s0167-8655(98)00150-0 · Cited by 48
Color And Texture Based Wood Inspection With Non-Supervised Clustering
Niskanen, M., Sílven, O., & Kauppinen, H. (2001) · Cited by 35
Detection of defects in colour texture surfaces
Kittler, J., Mařík, R., Mirmehdi, M., Petrou, M., & Song, J. (1994) · Cited by 31
Song, W., Chen, T., Gu, Z., Gai, W., Huang, W., & Wang, B. (2015) · Advances in intelligent systems research/Advances in Intelligent Systems Research · doi:10.2991/icismme-15.2015.163 · Cited by 27
Wood Defects Classification Using a SOM/FFP Approach with Minimum Dimension Feature Vector
Chacon, M. I. M., & Ramírez-Alonso, G. M. D. J. (2006) · Lecture notes in computer science · doi:10.1007/11760191_161 · Cited by 20
Statistical feature representations for automatic wood defects recognition research and applications
Wu, S., Zhang, Z., & Feng, L. (2009) · Pacific-Asia Workshop on Computational Intelligence and Industrial Application · doi:10.1109/paciia.2009.5406462 · Cited by 5
Research works printed but not linked: 2
- song, 2014, Automatic recognition of surface defects on hot-rolled steel strip using scattering convolution network, J Comput Inf Syst, 10, 3049
- ade, 1984, Comparison of various filter sets for defect detection in textiles, Proc Int Conf Pattern Recognit, 1, 428
Cited by
Deep learning for smart manufacturing: Methods and applications
Wang, J., Ma, Y., Zhang, L., Gao, R. X., & Wu, D. (2018) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2018.01.003 · Cited by 1,740
An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features
He, Y., Song, K., Meng, Q., & Yan, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2915404 · Cited by 1,341
“[17] perform an extra defect segmentation task on classification results to define the boundary of a defect.”
MethodA transfer convolutional neural network for fault diagnosis based on ResNet-50
Wen, L., Li, X., & Gao, L. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04097-w · Cited by 764
Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network
Lv, X., Duan, F., Jiang, J.-J., Fu, X., & Gan, L. (2020) · Sensors · doi:10.3390/s20061562 · Cited by 643
“Traditional image processing techniques extract hand-crafted features to describe and detect defects, which can be mainly divided into four categories: structural-based, threshold-based, spectral-based, and model-based methods [7].”
BackgroundAutomated Visual Defect Detection for Flat Steel Surface: A Survey
Luo, Q., Fang, X., Liu, L., Yang, C., & Sun, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2963555 · Cited by 559
Metadata
- Authors
- Ren, R., Hung, T., & Tan, K. C.
- Affiliations
- National University of Singapore (SG)
- Rolls-Royce (United Kingdom) (GB)
- City University of Hong Kong (HK)
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2018-03
- Volume
- 48
- Issue
- 3
- Pages
- 929-940
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2589306531
- Semantic Scholar
- 1d2105616d122389efbd1b0ac7c04c0c2f8ac996
- Cited by
- 485
- References
- 44
- Citations by year
- 2026: 19 · 2025: 36 · 2024: 41 · 2023: 69 · 2022: 84 · 2021: 76 · 2020: 75 · 2019: 56 · 2018: 28
- FWCI
- 48.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Cybernetics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Economic Development Board Industrial Postgraduate Fund (R-263-000-A70-592)
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Physical Sciences › Engineering › Mechanical Engineering › Non-Destructive Testing Techniques
- Keywords
- automated surface inspection, defect detection, defect segmentation, image classification, transfer learning, image patches, limited training data, pixel-wise prediction, industrial inspection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.