An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features
Open accessThe DOI matches its Crossref record; 43 of the 53 references it cites were found in a registry or an index.
Abstract
A complete defect detection task aims to achieve the specific class and precise location of each defect in an image, which makes it still challenging for applying this task in practice. The defect detection is a composite task of classification and location, leading to related methods is often hard to take into account the accuracy of both. The implementation of defect detection depends on a special detection data set that contains expensive manual annotations. In this paper, we proposed a novel defect detection system based on deep learning and focused on a practical industrial application: steel plate defect inspection. In order to achieve strong classification ability, this system employs a baseline convolution neural network (CNN) to generate feature maps at each stage, and then the proposed multilevel feature fusion network (MFN) combines multiple hierarchical features into one feature, which can include more location details of defects. Based on these multilevel features, a region proposal network (RPN) is adopted to generate regions of interest (ROIs). For each ROI, a detector, consisting of a classifier and a bounding box regressor, produces the final detection results. Finally, we set up a defect detection data set NEU-DET for training and evaluating our method. On the NEU-DET, our method achieves 74.8/82.3 mAP with baseline networks ResNet34/50 by using 300 proposals. In addition, by using only 50 proposals, our method can detect at 20 ft/s on a single GPU and reach…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are some shortcomings in manual testing, such as low confidence and high labor intensity.”
From A New Steel Defect Detection Algorithm Based on Deep Learning (2021) · cites this paper as [5]
In the citing paper
“most classification tasks can only find the defects with the highest confidence level in the defect category, resulting in imprecise classification results [3].”
From Steel Surface Defect Recognition: A Survey (2022) · cites this paper as [3]
In the citing paper
“there are many types of steel surface defects and some of these defects may overlap”
From Steel Surface Defect Recognition: A Survey (2022) · cites this paper as [3]
In the citing paper
“Using manual inspection of steel surface defects, it is difficult to distinguish the type of defect and accurately detect the location of the defect [2].”
From A deep learning model for steel surface defect detection (2024) · cites this paper as [2]
In the citing paper
“There are many categories of steel surface defects and the size of each defect category varies widely. The average size of each category in the NEU-DET [34] dataset is shown in Table1.”
From A deep learning model for steel surface defect detection (2024) · cites this paper as [34]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“The third type is ResNet using residual blocks to make networks deeper without overfitting [23].”
MethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“cessful networks are based on the sequential pipeline architecture [25], which establish the basic structure of CNN and prove the importance of depth of networks.”
BackgroundLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 6×
“Next, RPN [14] is employed to generate region proposals”
BackgroundMethodInfluentialFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812 · cited 6×
“Next, RPN [14] is employed to generate region proposals”
BackgroundMethodInfluentialImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“As current research in transfer learning [15], the key to drive large networks is pretraining on ImageNet [22].”
BackgroundGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“combined? There are two essential conditions: nonadjacent, because adjacent layers have highly local correlation [32], and”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 1×
“The representative direct regression methods are YOLO [29] and SSD [30].”
MethodFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · cited 2×
“The most famous region-based detectors are the “R-CNN family” [27] [28] [14].”
BackgroundMethod
Cited by
Fan, D.-P., Ji, G.-P., Cheng, M.-M., & Shao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3085766 · Cited by 779
“trast, artificial camouflage is usually used in art design/ gaming to hide information, occurs in products during the manufacturing process (so-called surface defects [42], defect detection [43], [44]), or appears in our daily life (e.”
BackgroundDong, H., Song, K., He, Y., Xu, J., Yan, Y., & Meng, Q. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2958826 · Cited by 559
Self-citationYang, J., Li, S., Wang, Z., Dong, H., Wang, J., & Tang, S. (2020) · Materials · doi:10.3390/ma13245755 · Cited by 488
“LeNet network structure can be used to detect defects in two situations: one is to design a complex multi-layer CNN structure, use different network structure to extra image content features, and complete end-to-end training to detect defects in images [56,83]; the other is to combine CNN with CRF model, train CNN wit…”
MethodSurface Defect Detection Methods for Industrial Products: A Review
Chen, Y., Ding, Y., Zhao, F., Zhang, E., Wu, Z., & Shao, L. (2021) · Applied Sciences · doi:10.3390/app11167657 · Cited by 457
Machine learning and deep learning based predictive quality in manufacturing: a systematic review
Tercan, H., & Meisen, T. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-01963-8 · Cited by 376
“…of image-based defect classification, such as the GRIMA X-Ray casting data (Mery et al., 2015) used by Ferguson et al. (2018), the NEU-DET data set (He et al., 2020) for surface defects in hot-rolling (Liu et al., 2021), and the Xuelang manufacturing AI challenge data set (Tianchi, 2021) used…”
BackgroundMethodImage-Based Surface Defect Detection Using Deep Learning: A Review
Bhatt, P. M., Malhan, R. K., Rajendran, P., Shah, B. C., Thakar, S., Yoon, Y. J., & Gupta, S. K. (2021) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4049535 · Cited by 362
Triplet-Graph Reasoning Network for Few-Shot Metal Generic Surface Defect Segmentation
Bao, Y., Song, K., Liu, J., Wang, Y., Yan, Y., Yu, H., & Li, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3083561 · Cited by 319
“For quantitative metal surface defect inspection, there are two main different network architectures, detection network [6], [7] and segmentation network [8], [9].”
BackgroundSelf-citationEDRNet: Encoder–Decoder Residual Network for Salient Object Detection of Strip Steel Surface Defects
Song, G., Song, K., & Yan, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3002277 · Cited by 309
Self-citationDevelopment of a YOLO-V3-based model for detecting defects on steel strip surface
Kou, X., Liu, S., Cheng, K., & Qian, Y. (2021) · Measurement · doi:10.1016/j.measurement.2021.109454 · Cited by 294
Review of surface defect detection of steel products based on machine vision
Tang, B., Chen, L., Sun, W., & Lin, Z. (2023) · IET Image Processing · doi:10.1049/ipr2.12647 · Cited by 271
A New Steel Defect Detection Algorithm Based on Deep Learning
Zhao, W., Chen, F., Huang, H., Li, D., & Cheng, W. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/5592878 · Cited by 259
“…of several common defects on the steel surface are shown in Figure 1, including crazing, inclusions, patches, and pitted surface, rolled in scale and scratches. traditional steel surface defect detection [2–4] is completed by manual visual inspection combined with traditional machine vision [5–7].”
MethodA Review on Recent Advances in Vision-based Defect Recognition towards Industrial Intelligence
Gao, Y., Li, X., Wang, X. V., Wang, L., & Gao, L. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.05.008 · Cited by 253
Khanam, R., Hussain, M., Hill, R., & Allen, P. (2024) · IEEE Access · doi:10.1109/access.2024.3425166 · Cited by 237
“Building upon existing work, He et al. [312] proposed a novel end-to-end DL system for steel plate defect inspection.”
ResultEfficient Detection Model of Steel Strip Surface Defects Based on YOLO-V7
Wang, Y., Wang, H., & Xin, Z. (2022) · IEEE Access · doi:10.1109/access.2022.3230894 · Cited by 223
“The NEU-DET dataset was produced by the team at Northeastern University [28].”
MethodDeep CNN-based visual defect detection: Survey of current literature
Jha, S. B., & Babiceanu, R. F. (2023) · Computers in Industry · doi:10.1016/j.compind.2023.103911 · Cited by 224
DCC-CenterNet: A rapid detection method for steel surface defects
Tian, R., & Jia, M. (2022) · Measurement · doi:10.1016/j.measurement.2021.110211 · Cited by 222
Ameri, R., Hsu, C.-C., & Band, S. S. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107717 · Cited by 213
Steel Surface Defect Recognition: A Survey
Wen, X., Shan, J., He, Y., & Song, K. (2022) · Coatings · doi:10.3390/coatings13010017 · Cited by 210
Self-citationZhou, X., Shen, K., Weng, L., Cong, R., Zheng, B., Zhang, J., & Yan, C. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3163152 · Cited by 193
Yang, J., Fu, G., Zhu, W., Cao, Y., Cao, Y., & Yang, M. Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2986875 · Cited by 189
“Different from many previous data sets (e.g., hot-rolled steel [15], [31], wood [32], or fabric [33]), the target workpieces (USB connectors) contain complex structures, including hallow areas, welding joints, and rivet holes.”
BackgroundA steel surface defect inspection approach towards smart industrial monitoring
Hao, R., Lu, B., Cheng, Y., Li, X., & Huang, B. (2021) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-020-01670-2 · Cited by 175
“Our model can infer 43.5 images per second on a single GPU, much higher than 20 reported in He et al. (2020).”
MethodInfluentialLiu, Y., Guo, L., Gao, H., You, Z., Ye, Y., & Zhang, B. (2022) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.108068 · Cited by 174
Research Progress of Automated Visual Surface Defect Detection for Industrial Metal Planar Materials
Fang, X., Luo, Q., Zhou, B., Li, C., & Tian, L. (2020) · Sensors · doi:10.3390/s20185136 · Cited by 160
“For example, in the literature [127], Song et al. applied an end-to-end defect detection network (DDN), which combined ResNet and RPN for accurate defect detection and location and tested them on the database NEU defect detection dataset (NEU-DET).”
MethodX-SDD: A New Benchmark for Hot Rolled Steel Strip Surface Defects Detection
Feng, X., Gao, X., & Luo, L. (2021) · Symmetry · doi:10.3390/sym13040706 · Cited by 158
MSC-DNet: An efficient detector with multi-scale context for defect detection on strip steel surface
Liu, R., Huang, M., Gao, Z., Cao, Z., & Cao, P. (2023) · Measurement · doi:10.1016/j.measurement.2023.112467 · Cited by 159
A convolutional neural network-based method for workpiece surface defect detection
Xing, J., & Jia, M. (2021) · Measurement · doi:10.1016/j.measurement.2021.109185 · Cited by 170
Unsupervised Saliency Detection of Rail Surface Defects using Stereoscopic Images
Niu, M., Song, K., Huang, L., Wang, Q., Yan, Y., & Meng, Q. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3004397 · Cited by 181
“Machine vision detection systems usually rely on analysis of images content [3], [4], and defects’ characteristics [33], [34].”
BackgroundSelf-citationFPCB Surface Defect Detection: A Decoupled Two-Stage Object Detection Framework
Luo, J., Yang, Z., Li, S., & Wu, Y. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3092510 · Cited by 175
HLU2-Net: A Residual U-Structure Embedded U-Net With Hybrid Loss for Tire Defect Inspection
Zheng, Z., Yang, H., Zhou, L., Yu, B., & Zhang, Y. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3126847 · Cited by 146
Deep Learning for Automatic Vision-Based Recognition of Industrial Surface Defects: A Survey
Prunella, M., Scardigno, R. M., Buongiorno, D., Brunetti, A., Longo, N., Carli, R., Dotoli, M., & Bevilacqua, V. (2023) · IEEE Access · doi:10.1109/access.2023.3271748 · Cited by 196
“The authors have found the upgrade of one type of class label to a more specific one to allow fully-supervised learning [202], [276].”
BackgroundSong, G., Song, K., & Yan, Y. (2020) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2019.106000 · Cited by 153
Self-citationES-Net: Efficient Scale-Aware Network for Tiny Defect Detection
Yu, X., Lyu, W., Zhou, D., Wang, C., & Xu, W. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3168897 · Cited by 177
Advances in deep concealed scene understanding
Fan, D.-P., Ji, G.-P., Xu, P., Cheng, M., Sakaridis, C., & Gool, L. V. (2023) · Visual Intelligence · doi:10.1007/s44267-023-00019-6 · Cited by 173
“5 • NEU5 provides three different databases: oil pollution defect images [209] (OPDI), spot defect images [210] (SDI), and steel pit defect images [211] (SPDI).”
BackgroundEnd-to-end deep learning framework for printed circuit board manufacturing defect classification
Bhattacharya, A., & Cloutier, S. G. (2022) · Scientific Reports · doi:10.1038/s41598-022-16302-3 · Cited by 167
Chen, H.-X., Du, Y., Fu, Y., Zhu, J., & Zeng, H.-Q. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3238698 · Cited by 137
“…algorithm’s accuracy and applicability in the surface defect detection of steel plates, inspired by the methods described in the literature [25], [26], [27], [28], [29], [30], [31], this article uses YOLOX as the basis of the object detection model to build a rapid detection network for…”
BackgroundMethodSDDNet: A Fast and Accurate Network for Surface Defect Detection
Cui, L., Jiang, X., Xu, M., Li, W., Lv, P., & Zhou, B. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3056744 · Cited by 133
“He et al. [21] fuse multiple pyramidal feature maps into one for steel plate defect inspection based on the Faster R-CNN.”
BackgroundMethodInfluentialA survey of real-time surface defect inspection methods based on deep learning
Liu, Y., Zhang, C., & Dong, X. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10475-7 · Cited by 154
“Currently, surface defect inspection methods based on deep learning are widely used in steel strip (He et al. 2019b; Di et al. 2019; Song et al. 2021), welding (Sassi et al. 2019; Le et al. 2020), aluminum profile (Wei and Bi 2019; Chen et al. 2021a; Zeng et al. 2021), solar cell (Bartler et al.…”
MethodA deep learning model for steel surface defect detection
Li, Z., Wei, X., Hassaballah, M., Li, Y., & Jiang, X. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01180-7 · Cited by 122
“The average size of each category in the NEU-DET [34] dataset is shown in Table1 The third branch only has a 1 × 1 Conv module.”
A lightweight detector based on attention mechanism for aluminum strip surface defect detection
Ma, Z., Li, Y., Huang, M., Huang, Q., Cheng, J., & Tang, S. Y. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103585 · Cited by 131
Efficient Fused-Attention Model for Steel Surface Defect Detection
Yeung, C.-C., & Lam, K. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3176239 · Cited by 163
WSS-YOLO: An improved industrial defect detection network for steel surface defects
Lu, M. L., Sheng, W., Zou, Y. Y., Chen, Y., & Chen, Z. (2024) · Measurement · doi:10.1016/j.measurement.2024.115060 · Cited by 131
Cao, J., Yang, G., & Yang, X. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3033726 · Cited by 131
“In [17], ResNet was used to extract defect features, and multilevel feature fusion network combined multilevel features, and finally produced results with bounding boxes, as shown in Fig.”
BackgroundMethodZhang, Y., Wang, W., Li, Z., Shu, S., Lang, X., Zhang, T., & Dong, J. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105628 · Cited by 118
Deep Metric Learning-Based for Multi-Target Few-Shot Pavement Distress Classification
Dong, H., Song, K., Wang, Q., Yan, Y., & Jiang, P. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3090036 · Cited by 110
Self-citationSurface defect detection of steel strips based on classification priority YOLOv3-dense network
Zhang, J., Kang, X., Ni, H., & Ren, F. (2020) · Ironmaking & Steelmaking Processes Products and Applications · doi:10.1080/03019233.2020.1816806 · Cited by 106
“6% higher than the DNN network used in reference [55], and it is slightly higher than the state-of-the-art object detectors.”
BackgroundTiny Defect Detection in High-Resolution Aero-Engine Blade Images via a Coarse-to-Fine Framework
Li, D., Li, Y., Xie, Q., Wu, Y., Yu, Z., & Wang, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3062175 · Cited by 121
“In recent years, the techniques [5]–[10] based on computer vision (CV) and deep learning (DL) have been developed rapidly, which are applied in many fields for defect detection [11]–[14], [15].”
BackgroundReal-Time Steel Surface Defect Detection with Improved Multi-Scale YOLO-v5
Wang, L., Liu, X., Ma, J., Su, W., & Li, H. (2023) · Processes · doi:10.3390/pr11051357 · Cited by 109
“He et al. utilized a multi-level feature fusion network and classified the different kinds of defects [8].”
BackgroundETDNet: Efficient Transformer-Based Detection Network for Surface Defect Detection
Zhou, H., Yang, R., Hu, R., Shu, C., Tang, X., & Li, X. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3307753 · Cited by 146
“To demonstrate the impressive performance of our method, we evaluate the proposed ETDNet on NEU-DET and compare it with seven representative or SOTA detectors, including Faster R-CNN [16], Cascade R-CNN [17], RetinaNet [21], Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
BackgroundMethodInfluentialZhang, D., Song, K., Wang, Q., He, Y., Wen, X., & Yan, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3045196 · Cited by 102
Self-citationSSA-YOLO: An Improved YOLO for Hot-Rolled Strip Steel Surface Defect Detection
Huang, X., Zhu, J., & Huo, Y. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3488136 · Cited by 125
“A. Dataset and Experimental Setup 1) Dataset: We utilize the NEU-DET Steel Surface defect dataset [33] to evaluate the efficacy of SSA-YOLO.”
BackgroundMethodDefect detection of injection molding products on small datasets using transfer learning
Liu, J., Guo, F., Gao, H., Li, M., Zhang, Y., & Zhou, H. (2021) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2021.08.034 · Cited by 106
Zhang, X., Zhang, Y., Liu, J., Zhang, C., Xue, X., Zhang, H., & Zhang, W. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3120796 · Cited by 98
Caiazzo, B., Nardo, M. D., Murino, T., Petrillo, A., Piccirillo, G., & Santini, S. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103548 · Cited by 111
Semi-supervised anomaly detection with dual prototypes autoencoder for industrial surface inspection
Liu, J., Song, K., Feng, M., Yan, Y., Tu, Z., & Liu, Z. (2020) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2020.106324 · Cited by 102
Self-citationDigital Twin and Data-Driven Quality Prediction of Complex Die-Casting Manufacturing
Liu, D., Du, Y., Chai, W., Lu, C., & Cong, M. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3168309 · Cited by 102
“He et al. [23] proposed a deep learning model suitable for steel strip surface defect detection, which integrates the multilevel features obtained from the feature extraction network into a single feature to improve the detection efficiency.”
BackgroundGlobal attention module and cascade fusion network for steel surface defect detection
Liu, G., Chu, M., Gong, R., & Zheng, Z. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110979 · Cited by 113
Wan, X., Zhang, X., & Liu, L. (2021) · Applied Sciences · doi:10.3390/app11062606 · Cited by 90
“Author [22] proposed a baseline ResNet convolution neural network (CNN) with a multilevel feature fusion network (MFN) module.”
BackgroundZhang, H., Li, S., Miao, Q., Fang, R., Song, X., Hu, Q., Hu, J., & Chan, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-57990-3 · Cited by 104
“Deep learning-based methods usually address this issue by fusing feature maps from multiple different levels 7,20–23 .”
MethodAuto-Annotated Deep Segmentation for Surface Defect Detection
Tsai, D., Fan, S. S., & Chou, Y.-H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3087826 · Cited by 97
“CNNs have been applied to the detection of cracks on reactors [15], steel surfaces [16], and liquid crystal display (LCD) panels [17].”
MethodMultiple Diseases and Pests Detection Based on Federated Learning and Improved Faster R-CNN
Deng, F., Mao, W., Zeng, Z., Zeng, H., & Wei, B. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3201937 · Cited by 94
“Image detection technologies based on deep learning are widely used in various fields [2], [3], [4].”
BackgroundWang, G.-Q., Zhang, C., Chen, M.-S., Lin, Y. C., Tan, X.-H., Kang, Y., Wang, Q., Zeng, W., & Zhao, W. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102280 · Cited by 97
Joining Spatial Deformable Convolution and a Dense Feature Pyramid for Surface Defect Detection
Huang, Z., Zhang, C., Ge, L., Chen, Z., Lü, K., & Wu, C. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3370962 · Cited by 118
“Deep learning-based methods can be roughly divided into detection-based methods [24], [25], [26], [27], [28] and segmentation-based methods [29], [30], [31].”
BackgroundMethodInfluentialSewer pipe defect detection via deep learning with local and global feature fusion
Li, D., Xie, Q., Yu, Z., Wu, Q., Zhou, J., & Wang, J. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103823 · Cited by 87
Surface Defect Detection Algorithm Based on Feature-Enhanced YOLO
Xie, Y., Hu, W., Xie, S., & He, L. (2022) · Cognitive Computation · doi:10.1007/s12559-022-10061-z · Cited by 97
ESMNet: An enhanced YOLOv7-based approach to detect surface defects in precision metal workpieces
Xu, H., Han, F., Zhou, W., Liu, Y., Ding, F., & Zhu, J. (2024) · Measurement · doi:10.1016/j.measurement.2024.114970 · Cited by 98
Few-Shot Steel Surface Defect Detection
Wang, H., Li, Z., & Wang, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3128208 · Cited by 117
Lu, H., Zhu, Y., Yin, M., Yin, G., & Xie, L. (2022) · IEEE Access · doi:10.1109/access.2022.3180725 · Cited by 85
“It shows excellent performance in many fields, e.g., image classification [14], target recognition [15], semantic segmentation [16], natural language processing [17], machine translation [18], and so on.”
BackgroundA light weight multi-scale feature fusion steel surface defect detection model based on YOLOv8
Xie, W., Sun, X., & Ma, W. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad296d · Cited by 95
“In this paper, the generalization performance of the model is verified by two steel surface defects datasets, NEU-DET [56] and GC10-DET [57].”
Steel Surface Defect Detection Algorithm Based on YOLOv8
Song, X., Cao, S., Zhang, J., & Hou, Z. (2024) · Electronics · doi:10.3390/electronics13050988 · Cited by 93
“He et al. [22] introduced an improved Fast R-CNN network model that integrates multi-scale feature maps from different network layers, minimizing feature loss and improving steel defect detection.”
MethodMultimodal Hierarchical CNN Feature Fusion for Stress Detection
Kuttala, R., Subramanian, R., & Murthy, O. V. R. (2023) · IEEE Access · doi:10.1109/access.2023.3237545 · Cited by 88
“Amultiple hierarchical feature fusion for an end-to-end steel surface flaw detection is presented by He et al. [51].”
Cross Position Aggregation Network for Few-Shot Strip Steel Surface Defect Segmentation
Feng, H., Song, K., Cui, W., Zhang, Y., & Yan, Y. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3246519 · Cited by 84
“STRIP steel is an essential raw material in industrial production and manufacturing [1], [2], [3], [4], and the surface quality of strip steel will directly influence its production-grade and work performance.”
BackgroundSelf-citationTLU-Net: A Deep Learning Approach for Automatic Steel Surface Defect Detection
Damacharla, P., V., A. R. M., Ringenberg, J., & Javaid, A. Y. (2021) · International Conference on Applied Artificial Intelligence (ICAPAI) · doi:10.1109/icapai49758.2021.9462060 · Cited by 101
“[14] uses a pre-trained ResNet to extract the multi-scale features, and the features from different scales are fused using a multilevel feature fusion network (MFN).”
MethodA robust instance segmentation framework for underground sewer defect detection
Li, Y., Wang, H., Dang, L. M., Piran, M. J., & Moon, H. (2022) · Measurement · doi:10.1016/j.measurement.2022.110727 · Cited by 79
Caiazzo, B., Murino, T., Petrillo, A., Piccirillo, G., & Santini, S. (2022) · Journal of Manufacturing Technology Management · doi:10.1108/jmtm-02-2022-0092 · Cited by 107
Üzen, H., Türkoğlu, M., Yanikoglu, B. A., & Hanbay, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118269 · Cited by 80
Lin, Q., Zhou, J., Ma, Q., Ma, Y., Kang, L., & Wang, J. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3151926 · Cited by 86
“According to the different network structures and classification tasks, the deep learning detection methods include the classi-fication network, the detection network, and the segmentation network, which can realize image-level, regional-level, and pixel-level defect detections [1], [18].”
BackgroundMethodDigital Twin of Intelligent Small Surface Defect Detection with Cyber-manufacturing Systems
Wu, Y., Cao, H., Yang, G., Lü, T., & Wan, S. (2022) · ACM Transactions on Internet Technology · doi:10.1145/3571734 · Cited by 82
“To avoid this, He et al. [13] propose a system for steel plate defect detection, which uses a baseline CNN and a multi-level feature fusion network to combine multiple levels of features, greatly enhancing weak features to represent defect details.”
MethodSteel Surface Defect Diagnostics Using Deep Convolutional Neural Network and Class Activation Map
Lee, S. Y., Tama, B. A., Moon, S. J., & Lee, S. (2019) · Applied Sciences · doi:10.3390/app9245449 · Cited by 90
“The traditional human inspection system has several disadvantages such as a less-automatic and time-consuming procedure [4,5].”
BackgroundA Transfer Residual Neural Network Based on ResNet-50 for Detection of Steel Surface Defects
Zhang, L., Bian, Y., Jiang, P., & Zhang, F. (2023) · Applied Sciences · doi:10.3390/app13095260 · Cited by 91
Depth-wise Squeeze and Excitation Block-based Efficient-Unet model for surface defect detection
Üzen, H., Türkoğlu, M., Aslan, M., & Hanbay, D. (2022) · The Visual Computer · doi:10.1007/s00371-022-02442-0 · Cited by 81
“[12] proposed a multi-level fusion network model used by combining different layers of CNN.”
BackgroundMethodAero-Engine Blade Defect Detection: A Systematic Review of Deep Learning Models
Abdulrahman, Y., Eltoum, M. A. M., Ayyad, A., Moyo, B., & Zweiri, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3280992 · Cited by 83
“Multiple experimental studies continue to report high levels of accuracy in metal surface defect detection via computer vision and deep learning [18], [19], [20], [21], [22].”
BackgroundSteel Surface Defect Detection via Deformable Convolution and Background Suppression
Song, C., Chen, J., Lu, Z., Li, F., & Liu, Y. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3277989 · Cited by 72
“For example, He et al. [3] proposed an end-to-end steel surface defect detection approach, in which a multilevel feature fusion network (MFN) was proposed to combine multiple hierarchical features into one feature.”
BackgroundMethodLiu, Q., Liu, M., Wu, Q. M. J., & Shen, W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123199 · Cited by 77
Steel surface defect detection algorithm in complex background scenarios
Zhao, B., Chen, Y., Jia, X., & Ma, T. (2024) · Measurement · doi:10.1016/j.measurement.2024.115189 · Cited by 81
Tu, Z., Wu, S., Kang, G., & Lin, J. T. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3117357 · Cited by 79
Research on arc fault detection using ResNet and gamma transform regularization
Zhang, S., Qu, N., Zheng, T., Hu, C., & Lu, S. (2022) · Frontiers in Energy Research · doi:10.1109/tim.2022.3158990 · Cited by 71
FDD: a deep learning–based steel defect detectors
Akhyar, F., Liu, Y., Hsu, C.-Y., Shih, T. K., & Lin, C. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-023-11087-9 · Cited by 82
“The second is a two-stage method [7, 12, 32–34].”
BackgroundMethodInfluentialZhou, X., Fang, H., Fei, X., Shi, R., & Zhang, J. (2021) · IEEE Access · doi:10.1109/access.2021.3124814 · Cited by 70
Intelligent Detection of Steel Defects Based on Improved Split Attention Networks
Hao, Z., Wang, Z., Bai, D., Tao, B., Tong, X., & Chen, B. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2021.810876 · Cited by 67
A Real-Time Steel Surface Defect Detection Approach With High Accuracy
Wang, W., Mi, C., Wu, Z., Lu, K., Long, H., Pan, B., Li, D., Zhang, J., Chen, P., & Wang, B. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3127648 · Cited by 77
“See https://www.ieee.org/publications/rights/index.html for more information. increased the detection speed to 20 FPS, the mAP of the detection model drops to 70% [16].”
BackgroundA Dynamic Weights-Based Wavelet Attention Neural Network for Defect Detection
Liu, J., Zhao, H. M., Chen, Z., Wang, Q., Shen, X., & Zhang, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3292512 · Cited by 70
“We employ five datasets to evaluate our method, namely NEU-DET [21], GC10-DET [22], MFL dataset, MFL noise data, and VOC dataset.”
BackgroundMethodHan, Q., Qian, X., Xu, H., Wu, K., Meng, L., Qiu, Z., Weng, T., Zhou, B., & Gao, X. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107758 · Cited by 88
Online Detection of Surface Defects Based on Improved YOLOV3
Chen, X., Lv, J., Fang, Y., & Du, S. (2022) · Sensors · doi:10.3390/s22030817 · Cited by 70
“…(mix-up, random distort, random expand, random crop, random horizontal flip) on the train set to improve the diversity of sample data and increase the generalization performance of our model. set to improve the diversity of sample data and increase the generalization performance of our model”
BackgroundCross-Scale Edge Purification Network for salient object detection of steel defect images
Ding, T., Li, G., Liu, Z., & Wang, Y. (2022) · Measurement · doi:10.1016/j.measurement.2022.111429 · Cited by 67
“He et al. [54] first fused features from baseline into multi-level features and then fed the more representative features into a region proposal network to determine the location and class of defects.”
BackgroundHou, X., Liu, M., Zhang, S., Wei, P., & Chen, B. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109558 · Cited by 68
Xie, W., Ma, W., & Sun, X. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128775 · Cited by 73
PCBNet: A Lightweight Convolutional Neural Network for Defect Inspection in Surface Mount Technology
Wu, H., Lei, R., & Peng, Y. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3193183 · Cited by 78
Systematic review of class imbalance problems in manufacturing
de Giorgio, A., Cola, G., & Wang, L. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.10.014 · Cited by 87
A Review on Industrial Surface Defect Detection Based on Deep Learning Technology
Qi, S., Yang, J., & Zhong, Z. (2020) · International Conference on Machine Learning and Machine Intelligence (MLMI) · doi:10.1145/3426826.3426832 · Cited by 86
“Recently, He et al. [23] also provided an end-to-end system for steel plate defect inspection by deep learning.”
BackgroundAGCA: An Adaptive Graph Channel Attention Module for Steel Surface Defect Detection
Xiang, X., Wang, Z., Zhang, J., Xia, Y., Chen, P., & Wang, B. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3248111 · Cited by 87
Metadata
- Authors
- He, Y., Song, K., Meng, Q., & Yan, Y.
- Affiliations
- Northeastern University (CN)
- Loughborough University (GB)
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2020-04
- Volume
- 69
- Issue
- 4
- Pages
- 1493-1504
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W2944303778
- Semantic Scholar
- 46d4a2b7ccf38b80b09574cf17544ff2297a8fbf
- Cited by
- 1,341
- References
- 53
- Citations by year
- 2026: 188 · 2025: 304 · 2024: 269 · 2023: 238 · 2022: 186 · 2021: 111 · 2020: 34
- FWCI
- 65.18
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- Locations
- IEEE Transactions on Instrumentation and Measurement (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (51805078, 51374063)
- National Basic Research Program of China (2017YFB0304200)
- Fundamental Research Funds for the Central Universities (N170304014, N150308001)
- China Scholarship Council (201806085007)
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- multi-level feature fusion, hierarchical features, region proposal network, bounding box regression, NEU-DET dataset, real-time defect detection, industrial visual inspection, object detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.