CoChat

A New Steel Defect Detection Algorithm Based on Deep Learning

Open access
Zhao, Weidong, Chen, Feng, Huang, Hancheng, Li, Dan, Cheng, Wei · 2021 · Computational Intelligence and Neuroscience

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index; 5 of the 15 sources its claims cite were checked for support.

Abstract

In recent years, more and more scholars devoted themselves to the research of the target detection algorithm due to the continuous development of deep learning. Among them, the detection and recognition of small and complex targets are still a problem to be solved. The authors of this article have understood the shortcomings of the deep learning detection algorithm in detecting small and complex defect targets and would like to share a new improved target detection algorithm in steel surface defect detection. The steel surface defects will affect the quality of steel seriously. We find that most of the current detection algorithms for NEU-DET dataset detection accuracy are low, so we choose to verify a steel surface defect detection algorithm based on machine vision on this dataset for the problem of defect detection in steel production. A series of improvement measures are carried out in the traditional Faster R-CNN algorithm, such as reconstructing the network structure of Faster R-CNN. Based on the small features of the target, we train the network with multiscale fusion. For the complex features of the target, we replace part of the conventional convolution network with a deformable convolution network. The experimental results show that the deep learning network model trained by the proposed method has good detection performance, and the mean average precision is 0.752, which is 0.128 higher than the original algorithm. Among them, the average precision of crazing, inclu…

Overview

CoChat Summary

TL;DR

The paper proposes an improved Faster R-CNN for steel surface defect detection by adding deformable convolution, deformable ROI pooling, FPN multiscale fusion, and soft NMS. On the NEU-DET dataset, it reports a mean average precision of 0.752, which is 0.128 higher than the original algorithm.

Key findings

  • On NEU-DET, the proposed method achieves mAP = 0.752, which is 0.128 higher than the original algorithm.
  • Reported per-class APs are 0.501 (crazing), 0.791 (inclusion), 0.792 (patches), 0.874 (pitted_surface), 0.649 (rolled-in_scale), and 0.905 (scratches).
  • In the ablation study, the original Faster R-CNN reaches 62.4% overall mean average accuracy; adding ResNet-50 raises it by 1.9%, adding deformable convolution raises it by 9% over the original, adding FPN raises it by 12.1%, and the full proposed scheme improves by 10.9%, 3.8%, and 0.7% compared with Schemes 2–4.
  • Compared with other detectors, the paper states the proposed algorithm’s mean average accuracy is 24.2%, 14.6%, and 12.6% higher than SSD, RetinaNet, and Cascade R-CNN, respectively.

Methods

  • The model is based on Faster R-CNN and modifies the feature extractor with ResNet-50, deformable convolution, and deformable ROI pooling; it also adds FPN and soft NMS.
  • Experiments are conducted on NEU-DET, described as an open dataset from Northeast University with 1800 pictures total and 300 pictures of six kinds of defects.
  • Performance is evaluated using AP for each defect class and mAP for the overall model; ablation experiments compare five schemes, and the model is also compared with SSD, RetinaNet, and Cascade R-CNN.

Limitations

  • The paper states that the detection time is long and says the algorithm should be further optimized to reduce detection time.
  • The paper states that the processed images “could be affected by uncertainty” and suggests using soft computing technology in future research.
  • The text makes evident that crazing/small targets remain challenging, since it notes fuzzy, small-sized crazing defects and “a small number of missed detection” — this is inferred from the results discussion, not stated as a formal limitation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1155/2021/5592878

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Steel surface defect image. (a) Crazing, (b) inclusions, (c) patches, (d) pitted surface, (e) rolled in scale, and (f) scratches.
Figure 1 Steel surface defect image. (a) Crazing, (b) inclusions, (c) patches, (d) pitted surface, (e) rolled in scale, and (f) scratches.CC BY · PubMed Central
Figure 2 The structure diagram of Faster R-CNN.
Figure 2 The structure diagram of Faster R-CNN.CC BY · PubMed Central
Figure 3 The improved method of Faster R-CNN.
Figure 3 The improved method of Faster R-CNN.CC BY · PubMed Central
Figure 4 The bottleneck structure of ResNet-50 network.
Figure 4 The bottleneck structure of ResNet-50 network.CC BY · PubMed Central
Figure 5 Reconstruction of ResNet-50 using variable convolution.
Figure 5 Reconstruction of ResNet-50 using variable convolution.CC BY · PubMed Central
Figure 6 Four sampling methods of convolution.
Figure 6 Four sampling methods of convolution.CC BY · PubMed Central
Figure 7 The calculation process of conventional and deformable convolution.
Figure 7 The calculation process of conventional and deformable convolution.CC BY · PubMed Central
Figure 8 The network structure of deformable pooling.
Figure 8 The network structure of deformable pooling.CC BY · PubMed Central
Figure 9 The network structure diagram of multiscale feature fusion.
Figure 9 The network structure diagram of multiscale feature fusion.CC BY · PubMed Central
Figure 10 The detection results of the proposed algorithm on all defects. (a) Crazing. (b) Inclusion. (c) Patches. (d) Pitted_surface. (e) Rolled-in_scale. (f) Scratches.
Figure 10 The detection results of the proposed algorithm on all defects. (a) Crazing. (b) Inclusion. (c) Patches. (d) Pitted_surface. (e) Rolled-in_scale. (f) Scratches.CC BY · PubMed Central
Figure 11 The results of different schemes.
Figure 11 The results of different schemes.CC BY · PubMed Central

Verification

Claims the paper makes

3 Valid · 6 Not valid · 2 Not checked · 37 Own results and interpretations

12 more claims

Create a free account to see all 48 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 24
  • Probably not a substantial claim. 8
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

  • Deep Residual Learning for Image Recognition

    He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×

    “At the first, the ResNet-50 [21–24] network is reconstructed by deformable convolution as the prefeature extraction network of Faster R-CNN [25–27].”
    Method
  • Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks

    Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 1×

    “At the first, the ResNet-50 [21–24] network is reconstructed by deformable convolution as the prefeature extraction network of Faster R-CNN [25–27].”
    Method
  • Untitled work

    (2016) · Cited by 31,590

  • Feature Pyramid Networks for Object Detection

    Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939 · cited 1×

    “Finally, the FPN [28–30] network is used for multifeature fusion, and the soft non-maximum suppression (soft NMS) [31] is used to reduce the confidence of the detection frame larger than the threshold, so as to alleviate the situation of the target missing detection.”
    Method
  • SSD: Single Shot MultiBox Detector

    Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128

  • Focal Loss for Dense Object Detection

    Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556 · cited 1×

    “…other mainstream target detection algorithms in order to further verify the advantages of the proposed algorithm, as shown in Table 6. comparison algorithms include single-stage target detection algorithms SSD and RetinaNet [38, 39] and double-stage target detection algorithm Cascade R-CNN [40].”
    Method
  • Deformable Convolutional Networks

    Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 5×

    “To solve the above problems, Dai et al. [36] introduced deformable convolution and deformable pooling into convolution neural network to enhance the modeling ability of the network. end-to-end training is carried out through standard backpropagation to generate a deformable convolution network.”
    BackgroundMethodInfluential
  • Soft-NMS — Improving Object Detection with One Line of Code

    Bodla, N., Singh, B., Chellappa, R., & Davis, L. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.593 · Cited by 2,274 · cited 1×

    “Finally, the FPN [28–30] network is used for multifeature fusion, and the soft non-maximum suppression (soft NMS) [31] is used to reduce the confidence of the detection frame larger than the threshold, so as to alleviate the situation of the target missing detection.”
    Method
  • An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features

    He, Y., Song, K., Meng, Q., & Yan, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2915404 · Cited by 1,341 · cited 1×

    “…of several common defects on the steel surface are shown in Figure 1, including crazing, inclusions, patches, and pitted surface, rolled in scale and scratches. traditional steel surface defect detection [2–4] is completed by manual visual inspection combined with traditional machine vision [5–7].”
    Method
  • Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network

    Lv, X., Duan, F., Jiang, J.-J., Fu, X., & Gan, L. (2020) · Sensors · doi:10.3390/s20061562 · Cited by 643 · cited 1×

    “Lv et al. [16] proposed a new end-to-end defect detection network (EDDN) to deal with different types of steel surface defects.”
    Background

Show all 38 references

Research works printed but not linked: 5

  1. Sun B., 2010, Classification and formation mechanism of typical press in scale of hot rolled steel plate, Journal of Northeastern University (Natural Science), 31, 1417
  2. Qu E., 2017, Improved Gabor filter for detection of strip surface defects, Journal of Huazhong University of Science and Technology (Natural Science Edition), 45, 12
  3. Xu S., 2017, Design of surface defect detection system for cold rolled strip, Instrument Technique and Sensor, 1, 65
  4. Wang H., 2020, Research on surface defect detection of metal sheet and strip based on multi-level feature Faster R-CNN, Mechanical Science and Technology for Aerospace Engineering, 2020
  5. Dai X., 2020, Research on surface defect detection and implementation of metal workpiece based on improved Faster R-CNN, Surface Technology, 49, 362

Cited by

Items 201–255 of 255

Metadata

Authors
Zhao, W., Chen, F., Huang, H., Li, D., & Cheng, W.
Affiliations
Anhui University of Technology (CN)
Corresponding author
Chen, Feng
Venue
Computational Intelligence and Neuroscience
Publisher
Wiley
Published
2021-01
Volume
2021
Issue
1
Pages
5592878-5592878
ISSN
  • 1687-5265 (ISSN-L)
  • 1687-5273
OpenAlex
W3137333070
Cited by
259
References
38
Citations by year
2026: 31 · 2025: 62 · 2024: 76 · 2023: 53 · 2022: 28 · 2021: 9
FWCI
21.42
Type
journal article
Language
en
Open access
Locations
  • Computational Intelligence and Neuroscience (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
Opening Project of Key Laboratory of Power Electronics and Motion Control of Anhui Higher Education Institutions (PEMC1902)
Topics
  • Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
  • Physical Sciences › Engineering › Mechanical Engineering › Non-Destructive Testing Techniques
  • Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
Keywords
steel surface defect detection, small object detection, Faster R-CNN, multi-scale feature fusion, deformable convolution, NEU-DET dataset, machine vision, inclusion detection
MeSH terms
Deep Learning, Algorithms, Rotation, Steel, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.