The DOI matches its Crossref record; 43 of the 53 references it cites were found in a registry or an index.
An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features
Open accessAbstract
A complete defect detection task aims to achieve the specific class and precise location of each defect in an image, which makes it still challenging for applying this task in practice. The defect detection is a composite task of classification and location, leading to related methods is often hard to take into account the accuracy of both. The implementation of defect detection depends on a special detection data set that contains expensive manual annotations. In this paper, we proposed a novel defect detection system based on deep learning and focused on a practical industrial application: steel plate defect inspection. In order to achieve strong classification ability, this system employs a baseline convolution neural network (CNN) to generate feature maps at each stage, and then the proposed multilevel feature fusion network (MFN) combines multiple hierarchical features into one feature, which can include more location details of defects. Based on these multilevel features, a region proposal network (RPN) is adopted to generate regions of interest (ROIs). For each ROI, a detector, consisting of a classifier and a bounding box regressor, produces the final detection results. Finally, we set up a defect detection data set NEU-DET for training and evaluating our method. On the NEU-DET, our method achieves 74.8/82.3 mAP with baseline networks ResNet34/50 by using 300 proposals. In addition, by using only 50 proposals, our method can detect at 20 ft/s on a single GPU and reach…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are some shortcomings in manual testing, such as low confidence and high labor intensity.”
From A New Steel Defect Detection Algorithm Based on Deep Learning (2021) · cites this paper as [5]
In the citing paper
“most classification tasks can only find the defects with the highest confidence level in the defect category, resulting in imprecise classification results [3].”
From Steel Surface Defect Recognition: A Survey (2022) · cites this paper as [3]
In the citing paper
“there are many types of steel surface defects and some of these defects may overlap”
From Steel Surface Defect Recognition: A Survey (2022) · cites this paper as [3]
In the citing paper
“Using manual inspection of steel surface defects, it is difficult to distinguish the type of defect and accurately detect the location of the defect [2].”
From A deep learning model for steel surface defect detection (2024) · cites this paper as [2]
In the citing paper
“There are many categories of steel surface defects and the size of each defect category varies widely. The average size of each category in the NEU-DET [34] dataset is shown in Table1.”
From A deep learning model for steel surface defect detection (2024) · cites this paper as [34]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“The third type is ResNet using residual blocks to make networks deeper without overfitting [23].”
MethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“cessful networks are based on the sequential pipeline architecture [25], which establish the basic structure of CNN and prove the importance of depth of networks.”
BackgroundLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 6×
“Next, RPN [14] is employed to generate region proposals”
BackgroundMethodInfluentialFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812 · cited 6×
“Next, RPN [14] is employed to generate region proposals”
BackgroundMethodInfluentialImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“As current research in transfer learning [15], the key to drive large networks is pretraining on ImageNet [22].”
BackgroundGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“combined? There are two essential conditions: nonadjacent, because adjacent layers have highly local correlation [32], and”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 1×
“The representative direct regression methods are YOLO [29] and SSD [30].”
MethodFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · cited 2×
“The most famous region-based detectors are the “R-CNN family” [27] [28] [14].”
BackgroundMethodRethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · cited 1×
“Subsequently, the inception networks employed modular units, which increase both the depth and width of a network without the increment of computational cost [26].”
Background(2016) · Cited by 31,590
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 1×
“The representative direct regression methods are YOLO [29] and SSD [30].”
Method(2010) · Cited by 14,134
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 1×
“As current research in transfer learning [15], the key to drive large networks is”
BackgroundSelective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980 · cited 2×
“To verify MFN is able to improve localization accuracy, we compare with several region proposal extractors, sliding window, Edge Boxes [35], and Selective Search [36].”
MethodMarr, D. (1982) · Cumulative Index of Computer Aided Architectural Design · Cited by 5,733
Computer Vision: A Modern Approach
Forsyth, D. A., & Ponce, J. (2002) · Cited by 3,739
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Edge Boxes: Locating Object Proposals from Edges
Zitnick, C. L., & Dollár, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_26 · Cited by 2,656 · cited 2×
“To verify MFN is able to improve localization accuracy, we compare with several region proposal extractors, sliding window, Edge Boxes [35], and Selective Search [36].”
MethodSong, K., & Yan, Y. (2013) · Applied Surface Science · doi:10.1016/j.apsusc.2013.09.002 · Cited by 1,026 · cited 4×
“For instance, Song and Yan [3] improve the LBP to against noise and adopt NNC and SVM to classify defects.”
BackgroundMethodInfluentialSelf-citationHyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection
Kong, T., Yao, A., Chen, Y., & Sun, F. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.98 · Cited by 934 · cited 10×
“But this does not mean HyperNet can work well with ResNet due to the severe dimensionality decline. detection tasks, our system can provide detailed and valuable indicators for quality assessment system, such as the quantity, category, complexity, and area of a defect.”
BackgroundMethodInfluentialWhat Makes for Effective Detection Proposals?
Hosang, J., Benenson, R., Dollar, P., & Schiele, B. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2465908 · Cited by 727
A Generic Deep-Learning-Based Approach for Automated Surface Inspection
Ren, R., Hung, T., & Tan, K. C. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2668395 · Cited by 485 · cited 2×
“[17] perform an extra defect segmentation task on classification results to define the boundary of a defect.”
MethodCross-Modal Retrieval With CNN Visual Features: A New Baseline
Wei, Y., Zhao, Y., Lu, C., Wei, S., Liu, L., Zhu, Z., & Yan, S. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2519449 · Cited by 370 · cited 1×
“Unsurprisingly, the performance of the methods based on convolutional features is strongly higher than the methods without CNN [37].”
MethodAutomatic Defect Detection on Hot-Rolled Flat Steel Products
Ghorai, S., Mukherjee, A., Gangadaran, M., & Dutta, P. K. (2013) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2012.2218677 · Cited by 317 · cited 2×
“For example, some methods perform binary classification to find the regions of defects [9], [10] or only provide a coarse region of a defect [11], [12].”
MethodDo We Need More Training Data?
Zhu, X., Vondrick, C., Fowlkes, C. C., & Ramanan, D. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0812-2 · Cited by 204 · cited 1×
“As we known, an object detector can improve performance with more training data [39].”
BackgroundAn End‐to‐End Steel Strip Surface Defects Recognition System Based on Convolutional Neural Networks
Yi, L., Li, G., & Jiang, M. (2017) · steel research international · doi:10.1002/srin.201600068 · Cited by 173 · cited 3×
“However, most methods can only perform defect classification due to the lack of special data sets [18]–[21].”
BackgroundMethodSteel Surface Defect Detection Using a New Haar–Weibull-Variance Model in Unsupervised Manner
Liu, K., Wang, H., Chen, H., Qu, E., Tian, Y., & Sun, H. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2712838 · Cited by 161 · cited 2×
“For example, some methods perform binary classification to find the regions of defects [9], [10] or only provide a coarse region of a defect [11], [12].”
MethodFeature Correlation Hypergraph: Exploiting High-order Potentials for Multimodal Recognition
Zhang, L., Gao, Y., Hong, C., Feng, Y., Zhu, J., & Cai, D. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2285219 · Cited by 143 · cited 1×
“Obviously, the simplest way is to assemble feature maps from multiple layers [31].”
BackgroundClassification of surface defects on steel sheet using convolutional neural networks
Zhou, S., Chen, Y., Zhang, D., Xie, J., & Zhou, Y. (2017) · Materiali in tehnologije · doi:10.17222/mit.2015.335 · Cited by 130 · cited 1×
“to [18] and [19], they demonstrate that using a sequential CNN to extract features can improve classification accuracy”
BackgroundA cost-effective and automatic surface defect inspection system for hot-rolled flat steel
Luo, Q., & He, Y. (2016) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2015.09.008 · Cited by 129 · cited 1×
“For example, some methods perform binary classification to find the regions of defects [9], [10] or only provide a coarse region of a defect [11], [12].”
MethodSelf-citationTexture Classification and Retrieval Using Shearlets and Linear Regression
Dong, Y., Tao, D., Li, X., et al. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2326059 · Cited by 112 · cited 1×
“The previous ADI methods have two common problems: the one is the unclear usage of hand-craft features [3]–[5].”
MethodChu, M., Gong, R., Gao, S., & Zhao, J. (2017) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2017.10.020 · Cited by 97 · cited 2×
“For example, some methods perform binary classification to find the regions of defects [9], [10] or only provide a coarse region of a defect [11], [12].”
MethodAmbiguous Surface Defect Image Classification of AMOLED Displays in Smartphones
Park, Y., & Kweon, I. S. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2522191 · Cited by 82
Convolutional networks for voting-based anomaly classification in metal surface inspection
Natarajan, V., Hung, T.-Y., Vaikundam, S., & Chia, L.-T. (2017) · 2017 IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit.2017.7915495 · Cited by 79
An evolutionary classifier for steel surface defects with small sample set
Xiao, M., Jiang, M., Li, G., Xie, L., & Yi, L. (2017) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-017-0197-y · Cited by 55 · cited 1×
“Most methods only perform defect classification [6]–[8] or an incomplete defect detection.”
MethodAdaptive surface inspection via interactive evolution
Caleb-Solly, P., & Smith, J. E. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2006.04.023 · Cited by 47
Chu, M., Zhao, J., Liu, X., & Gong, R. (2017) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2017.07.008 · Cited by 45 · cited 2×
“Most methods only perform defect classification [6]-[8] or an incomplete defect detection.”
MethodIs overfeat useful for image-based surface defect classification tasks?
Chen, P.-H., & Ho, S.-S. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532457 · Cited by 40 · cited 2×
“For example, Chen and Ho [21] demonstrate that an object detector like Overfeat [24] can be”
BackgroundMethodMarr, D. (2010) · Vision · doi:10.7551/mitpress/9780262514620.003.0001 · Cited by 1
Cited by
Fan, D.-P., Ji, G.-P., Cheng, M.-M., & Shao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3085766 · Cited by 779
“trast, artificial camouflage is usually used in art design/ gaming to hide information, occurs in products during the manufacturing process (so-called surface defects [42], defect detection [43], [44]), or appears in our daily life (e.”
BackgroundDong, H., Song, K., He, Y., Xu, J., Yan, Y., & Meng, Q. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2958826 · Cited by 559
Self-citationYang, J., Li, S., Wang, Z., Dong, H., Wang, J., & Tang, S. (2020) · Materials · doi:10.3390/ma13245755 · Cited by 488
“LeNet network structure can be used to detect defects in two situations: one is to design a complex multi-layer CNN structure, use different network structure to extra image content features, and complete end-to-end training to detect defects in images [56,83]; the other is to combine CNN with CRF model, train CNN wit…”
MethodSurface Defect Detection Methods for Industrial Products: A Review
Chen, Y., Ding, Y., Zhao, F., Zhang, E., Wu, Z., & Shao, L. (2021) · Applied Sciences · doi:10.3390/app11167657 · Cited by 457
Machine learning and deep learning based predictive quality in manufacturing: a systematic review
Tercan, H., & Meisen, T. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-01963-8 · Cited by 376
“…of image-based defect classification, such as the GRIMA X-Ray casting data (Mery et al., 2015) used by Ferguson et al. (2018), the NEU-DET data set (He et al., 2020) for surface defects in hot-rolling (Liu et al., 2021), and the Xuelang manufacturing AI challenge data set (Tianchi, 2021) used…”
BackgroundMethod
Metadata
- Authors
- He, Y., Song, K., Meng, Q., & Yan, Y.
- Affiliations
- Northeastern University (CN)
- Loughborough University (GB)
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2020-04
- Volume
- 69
- Issue
- 4
- Pages
- 1493-1504
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W2944303778
- Semantic Scholar
- 46d4a2b7ccf38b80b09574cf17544ff2297a8fbf
- Cited by
- 1,341
- References
- 53
- Citations by year
- 2026: 188 · 2025: 304 · 2024: 269 · 2023: 238 · 2022: 186 · 2021: 111 · 2020: 34
- FWCI
- 65.18
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- Locations
- IEEE Transactions on Instrumentation and Measurement (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (51805078, 51374063)
- National Basic Research Program of China (2017YFB0304200)
- Fundamental Research Funds for the Central Universities (N170304014, N150308001)
- China Scholarship Council (201806085007)
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- multi-level feature fusion, hierarchical features, region proposal network, bounding box regression, NEU-DET dataset, real-time defect detection, industrial visual inspection, object detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.