The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Research Progress of Automated Visual Surface Defect Detection for Industrial Metal Planar Materials
Open accessAbstract
The computer-vision-based surface defect detection of metal planar materials is a research hotspot in the field of metallurgical industry. The high standard of planar surface quality in the metal manufacturing industry requires that the performance of an automated visual inspection system and its algorithms are constantly improved. This paper attempts to present a comprehensive survey on both two-dimensional and three-dimensional surface defect detection technologies based on reviewing over 160 publications for some typical metal planar material products of steel, aluminum, copper plates and strips. According to the algorithm properties as well as the image features, the existing two-dimensional methodologies are categorized into four groups: statistical, spectral, model, and machine learning-based methods. On the basis of three-dimensional data acquisition, the three-dimensional technologies are divided into stereoscopic vision, photometric stereo, laser scanner, and structured light measurement methods. These classical algorithms and emerging methods are introduced, analyzed, and compared in this review. Finally, the remaining challenges and future research trends of visual defect detection are discussed and forecasted at an abstract level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features
He, Y., Song, K., Meng, Q., & Yan, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2915404 · Cited by 1,341 · cited 1×
“For example, in the literature [127], Song et al. applied an end-to-end defect detection network (DDN), which combined ResNet and RPN for accurate defect detection and location and tested them on the database NEU defect detection dataset (NEU-DET).”
MethodSong, K., & Yan, Y. (2013) · Applied Surface Science · doi:10.1016/j.apsusc.2013.09.002 · Cited by 1,026
Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network
Lv, X., Duan, F., Jiang, J.-J., Fu, X., & Gan, L. (2020) · Sensors · doi:10.3390/s20061562 · Cited by 643
A Survey of Automated Visual Inspection
Newman, T. S., & Jain, A. K. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1017 · Cited by 619
Automated Visual Defect Detection for Flat Steel Surface: A Survey
Luo, Q., Fang, X., Liu, L., Yang, C., & Sun, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2963555 · Cited by 559 · cited 2×
“[35] 2020 This paper made a detail review of two-dimensional visual detection methods for flat steel (including con-casting slabs, hot-and cold-rolled steel strips) surface defects.”
BackgroundSelf-citationDong, H., Song, K., He, Y., Xu, J., Yan, Y., & Meng, Q. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2958826 · Cited by 559
A Review of Recent Advances in Surface Defect Detection using Texture analysis Techniques
Xie, X. (2008) · ELCVIA Electronic Letters on Computer Vision and Image Analysis · doi:10.5565/rev/elcvia.268 · Cited by 500
Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks
Tao, X., Zhang, D., Ma, W., Liu, X., & Xu, D. (2018) · Applied Sciences · doi:10.3390/app8091575 · Cited by 471 · cited 1×
“To break through this limitation, Tao et al. [123] established a cascaded autoencoder (CASAE) framework for connecting the two subtasks of defect detection and classification in complex industrial environments.”
BackgroundVisual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY
Czimmermann, T., Ciuti, G., Milazzo, M., Chiurazzi, M., Roccella, S., Oddo, C. M., & Dario, P. (2020) · Sensors · doi:10.3390/s20051459 · Cited by 441 · cited 2×
“…including those for a particular material (e.g., fabric [26,27] and semiconductors [28]), or those covering a wide range of materials (including fabrics, food, steel, wood, and ceramic tiles) [29–32]; nevertheless, none of them can specifically review the detection of metal surface defects.”
BackgroundAutomated Visual Inspection: A Survey
Chin, R. T., & Harlow, C. A. (1982) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1982.4767309 · Cited by 400 · cited 2×
“Some scholars have summarized and compared the relevant research results [22–25]; however, most of them are relatively old.”
BackgroundResultReview of vision-based steel surface inspection systems
Neogi, N., Mohanta, D. K., & Dutta, P. K. (2014) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2014-50 · Cited by 322 · cited 4×
“In 2014, Neogi et al. [33] made a brief review of steel surface defect detection methods based on AVI, covering the defect detection and classification technology of steel products, including slab, billet, steel plate, hot-rolled strip, cold-rolled strip, and bar.”
BackgroundMethodInfluentialAutomatic Defect Detection on Hot-Rolled Flat Steel Products
Ghorai, S., Mukherjee, A., Gangadaran, M., & Dutta, P. K. (2013) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2012.2218677 · Cited by 317
Automated visual inspection in the semiconductor industry: A survey
Huang, S.-H., & Pan, Y.-C. (2015) · Computers in Industry · doi:10.1016/j.compind.2014.10.006 · Cited by 307
Defect Image Sample Generation With GAN for Improving Defect Recognition
Niu, S., Li, B., Wang, X., & Lin, H. (2020) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.2967415 · Cited by 251
Surface defect classification of steels with a new semi-supervised learning method
Di, H., Ke, X., Peng, Z., & Dongdong, Z. (2019) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2019.01.011 · Cited by 241 · cited 3×
“…adversarial network (GAN) Requires only a small number of labeled samples and the result is stable, but requires many interactions and reduces e ffi ciency [8] Convolutional auto-encoder (CAE) and semi-supervised GAN fusion schemes [115] Convolutional neural network based on a residual structure”
BackgroundMethodInfluentialGeneralized Completed Local Binary Patterns for Time-Efficient Steel Surface Defect Classification
Luo, Q., Sun, Y., Li, P., Simpson, O., Tian, L., & He, Y. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2852918 · Cited by 178
Self-citationSteel Surface Defect Detection Using a New Haar–Weibull-Variance Model in Unsupervised Manner
Liu, K., Wang, H., Chen, H., Qu, E., Tian, Y., & Sun, H. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2712838 · Cited by 161
Improving Automatic Detection of Defects in Castings by Applying Wavelet Technique
Li, X., Tso, S. K., Guan, X.-P., & Huang, Q. (2006) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2006.885448 · Cited by 154 · cited 1×
“…the Gabor filter, wavelet transform has a more powerful adaptive ability and is in line with human visual characteristics ideally, which could not only locomote the time-frequency window but also automatically modify the window size according to the variation of the window center frequency [77,78].”
BackgroundSurface Defect Detection via Entity Sparsity Pursuit With Intrinsic Priors
Wang, J., Li, Q., Gan, J., Yu, H., & Yang, X. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2917522 · Cited by 141
He, D., Xu, K., & Zhou, P. (2019) · Computers & Industrial Engineering · doi:10.1016/j.cie.2018.12.043 · Cited by 140
Morphology-Based Crack Detection for Steel Slabs
Landstrom, A., & Thurley, M. J. (2012) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2212416 · Cited by 137
Lian, J., Jia, W., Zareapoor, M., Zheng, Y., Luo, R., Jain, D. K., & Kumar, N. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2945403 · Cited by 137 · cited 2×
“…for training but is susceptible to noise and highly influenced by initial values [37] Convolutional automatic encoder Semi-supervised learning [114] Generative adversarial network (GAN) Requires only a small number of labeled samples and the result is stable, but requires many interactions…”
BackgroundImage acquisition techniques for automatic visual inspection of metallic surfaces
Pernkopf, F., & O'Leary, P. (2003) · NDT & E International · doi:10.1016/s0963-8695(03)00081-1 · Cited by 117
Anomaly Detection in Images With Smooth Background via Smooth-Sparse Decomposition
Yan, H., Paynabar, K., & Shi, J. (2017) · Technometrics · doi:10.1080/00401706.2015.1102764 · Cited by 111
Research Progress of Visual Inspection Technology of Steel Products—A Review
Sun, X., Gu, J., Tang, S., & Li, J. (2018) · Applied Sciences · doi:10.3390/app8112195 · Cited by 109
Improved Sobel algorithm for defect detection of rail surfaces with enhanced efficiency and accuracy
Shi, T., Kong, J.-Y., Wang, X.-D., Liu, Z., & Zheng, G. (2016) · Journal of Central South University · doi:10.1007/s11771-016-3350-3 · Cited by 94 · cited 3×
“Operators Results respectively, which has limitations [39] Eight directional Sobel operator Rail Suppresses false edge detection that is easy to trigger well The computational burden is relatively high [45] Double-threshold Cannyoperator Copper strip Avoid false detection as far as possible Poor…”
BackgroundYoukachen, S., Ruchanurucks, M., Phatrapomnant, T., & Kaneko, H. (2019) · 2019 10th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES) · doi:10.1109/ictemsys.2019.8695928 · Cited by 87
Automatic texture defect detection using Gaussian mixture entropy modeling
Susan, S., & Sharma, M. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.021 · Cited by 85
An Improved MB-LBP Defect Recognition Approach for the Surface of Steel Plates
Liu, Y., Xu, K., & Xu, J. (2019) · Applied Sciences · doi:10.3390/app9204222 · Cited by 78
Surface Defects Classification of Hot-Rolled Steel Strips Using Multi-directional Shearlet Features
Ashour, M. W., Khalid, F., Abdul Halin, A., Abdullah, L. N., & Darwish, S. H. (2019) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-018-3329-5 · Cited by 77
Luo, Q., Fang, X., Sun, Y., Liu, L., Ai, J., Yang, C., & Simpson, O. (2019) · IEEE Access · doi:10.1109/access.2019.2898215 · Cited by 75 · cited 1×
“creatively used the reverse thinking to explore the non-uniform pattern to supplement the description information hidden in the uniform pattern in [7] and [61].”
MethodSelf-citationA fast regularity measure for surface defect detection
Tsai, D.-M., Chen, M.-C., Li, W.-C., & Chiu, W.-Y. (2012) · Machine Vision and Applications · doi:10.1007/s00138-011-0403-3 · Cited by 70
Non-parametric texture defect detection using Weibull features
Timm, F., & Barth, E. (2011) · SPIE Proceedings · doi:10.1117/12.872463 · Cited by 68
Steel Surface Defect Detection Using Texture Segmentation Based on Multifractal Dimension
Yazdchi, M., Yazdi, M., & Mahyari, A. G. (2009) · 2009 International Conference on Digital Image Processing · doi:10.1109/icdip.2009.68 · Cited by 65
Surface defects inspection of cold rolled strips based on neural network
Kang, G.-W., & Liu, H.-B. (2005) · 2005 International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2005.1527830 · Cited by 62
Wang, Y., Xia, H., Yuan, X., Li, L., & Sun, B. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5238-0 · Cited by 61
Zhao, Y. J., Yan, Y. H., & Song, K. C. (2017) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-016-9489-0 · Cited by 59
Deep Active Learning for Surface Defect Detection
Lv, X., Duan, F., Jiang, J.-J., Fu, X., & Gan, L. (2020) · Sensors · doi:10.3390/s20061650 · Cited by 58
Automatic Visual Defect Detection Using Texture Prior and Low-Rank Representation
Huangpeng, Q., Zhang, H., Zeng, X., & Huang, W. (2018) · IEEE Access · doi:10.1109/access.2018.2852663 · Cited by 53
A Generic Automated Surface Defect Detection Based on a Bilinear Model
Zhou, F., Liu, G., Xu, F., & Deng, H. (2019) · Applied Sciences · doi:10.3390/app9153159 · Cited by 47
Pinhole detection in steel slab images using Gabor filter and morphological features
Choi, D.-C., Jeon, Y.-J., Yun, J. P., & Kim, S. W. (2011) · Applied Optics · doi:10.1364/ao.50.005122 · Cited by 43
A Non-Invasive Technique for Online Defect Detection on Steel Strip Surfaces
Bulnes, F. G., García, D. F., de la Calle, F. J., Usamentiaga, R., & Molleda, J. (2016) · Journal of Nondestructive Evaluation · doi:10.1007/s10921-016-0370-8 · Cited by 42
Chu, M., & Gong, R. (2015) · ISIJ International · doi:10.2355/isijinternational.isijint-2015-201 · Cited by 34 · cited 1×
“Chu et al. [57] proposed a smooth local binary pattern (SLBP) and combined it with GLCM, which can not only e ff ectively suppress noise but also extract features with rotation, illumination, and translation invariance.”
BackgroundDouble Low-Rank and Sparse Decomposition for Surface Defect Segmentation of Steel Sheet
Zhou, S., Wu, S., Liu, H., Lu, Y., & Hu, N. (2018) · Applied Sciences · doi:10.3390/app8091628 · Cited by 28
Vision-Based Sensor for Early Detection of Periodical Defects in Web Materials
Bulnes, F. G., Usamentiaga, R., García, D. F., & Molleda, J. (2012) · Sensors · doi:10.3390/s120810788 · Cited by 28
A surface defects inspection method based on multidirectional gray-level fluctuation
Ma, Y., Li, Q., Zhou, Y., He, F., & Xi, S. (2017) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881417703114 · Cited by 26
Using fractal features of digital images for the detection of surface defects
Zhiznyakov, A. L., Privezentsev, D. G., & Zakharov, A. A. (2015) · Pattern Recognition and Image Analysis · doi:10.1134/s105466181501023x · Cited by 23
Liu, W., & Yan, Y. (2014) · International Journal of Industrial and Systems Engineering · doi:10.1504/ijise.2014.061995 · Cited by 23
Vibrations in Steel Strips: Effects on Flatness Measurement and Filtering
Usamentiaga, R., Garcia, D. F., Molleda, J., Bulnes, F. G., & Bonet Brana, G. (2014) · IEEE Transactions on Industry Applications · doi:10.1109/tia.2014.2308359 · Cited by 21
Application of Hidden Markov Tree Model to On-line Detection of Surface Defects for Steel Strips
XU, K. (2013) · Journal of Mechanical Engineering · doi:10.3901/jme.2013.22.034 · Cited by 16 · cited 1×
“…random field, the spatial correlation of the image neighborhood pixels is well represented. surface images of di ff erent scales meets the Markov property, Xu et al. [82] proposed an adaptive hidden Markov tree model (CAHMT) which significantly reduced the detection error rate from 18.8% to 3.7%.”
BackgroundInfluentialMagnetic imaging and machine vision NDT for the on-line inspection of stainless steel strips
Ricci, M., Ficola, A., Fravolini, M. L., Battaglini, L., Palazzi, A., Burrascano, P., Valigi, P., Appolloni, L., Cervo, S., & Rocchi, C. (2013) · Measurement Science and Technology · doi:10.1088/0957-0233/24/2/025401 · Cited by 11
Zhang, X., Li, W., Xi, J., Zhang, Z., & Fan, X. (2013) · Mathematical Problems in Engineering · doi:10.1155/2013/504895 · Cited by 11
Cited by
Automated surface defect detection framework using machine vision and convolutional neural networks
Singh, S. A., & Desai, K. A. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-021-01878-w · Cited by 286
A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Images
Cui, Y., Liu, Z., & Lian, S. (2022) · arXiv · doi:10.48550/arxiv.2204.11161 · Cited by 154
“A thorough survey [1] is provided of both two-dimensional and three-dimensional surface defect detection systems for various common metal planar material products such as steel, aluminum, copper plates, and strips.”
BackgroundWan, X., Zhang, X., & Liu, L. (2021) · Applied Sciences · doi:10.3390/app11062606 · Cited by 90
Metadata
- Authors
- Fang, X., Luo, Q., Zhou, B., Li, C., & Tian, L.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2020-09-09
- Volume
- 20
- Issue
- 18
- Pages
- 5136
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W3084093109
- Cited by
- 160
- References
- 54
- FWCI
- 7.67
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.