The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Using Deep Convolutional Neural Network Architectures for Object Classification and Detection Within X-Ray Baggage Security Imagery
Open accessAbstract
We consider the use of deep convolutional neural networks (CNNs) with transfer learning for the image classification and detection problems posed within the context of X-ray baggage security imagery. The use of the CNN approach requires large amounts of data to facilitate a complex end-to-end feature extraction and classification process. Within the context of X-ray security screening, limited availability of object of interest data examples can thus pose a problem. To overcome this issue, we employ a transfer learning paradigm such that a pre-trained CNN, primarily trained for generalized image classification tasks where sufficient training data exists, can be optimized explicitly as a later secondary process towards this application domain. To provide a consistent feature-space comparison between this approach and traditional feature space representations, we also train support vector machine (SVM) classifier on CNN features. We empirically show that fine-tuned CNN features yield superior performance to conventional hand-crafted features on object classification tasks within this context. Overall we achieve 0.994 accuracy based on AlexNet features trained with SVM classifier. In addition to classification, we also explore the applicability of multiple CNN driven detection paradigms, such as sliding window-based CNN (SW-CNN), Faster region-based CNNs (F-RCNNs), region-based fully convolutional networks (R-FCN), and YOLOv2. We train numerous networks tackling both single and multiple detections over SW-CNN/ F-RCNN/R-FCN/YOLOv2 variants. YOLOv2, Faster-RCNN, and R-FCN provide superior results to the more traditional SW-CNN approaches. With the use of YOLOv2, using input images of size$544\times 544$, we achieve 0.885 mean average precision (mAP) for a six-class object detection problem. The same approach with an input of size$416\times 416$yields 0.974 mAP for the two-class firearm detection problem and requires approximately 100 ms per image. Overall we illustrate the comparative performance of these techniques and show that object localization strategies cope well with cluttered X-ray security imagery, where classification techniques fail.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
(2008) · Journal of Machine Learning Research · Cited by 33,051
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 2×
“However, the limited applicability of such training and parameter optimization techniques to problems where such large datasets are not available gives rise to the concept of transfer learning [35].”
BackgroundMethodR-FCN: Object Detection via Region-based Fully Convolutional Networks
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 3,149
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
Visualizing and Understanding Convolutional Networks
Zeiler, M. D., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1311.2901 · Cited by 522
Akcay, S., Kundegorski, M. E., Devereux, M., & Breckon, T. P. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532519 · Cited by 299
Self-citationExplosives detection systems (EDS) for aviation security
Singh, S., & Singh, M. (2002) · Signal Processing · doi:10.1016/s0165-1684(02)00391-2 · Cited by 290
Modern Computer Vision Techniques for X-Ray Testing in Baggage Inspection
Mery, D., Svec, E., Arias, M., Riffo, V., Saavedra, J. M., & Banerjee, S. (2017) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2016.2628381 · Cited by 188
Turcsány, D., Mouton, A., & Breckon, T. P. (2013) · IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit.2013.6505833 · Cited by 152
Self-citationVisual Words on Baggage X-Ray Images
Baştan, M., Yousefi, M. R., & Breuel, T. M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23672-3_44 · Cited by 127
Flitton, G. T., Breckon, T. P., & Megherbi, N. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.02.008 · Cited by 123
Self-citationObject Detection in Multi-view X-Ray Images
Franzel, T., Schmidt, U., & Roth, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-32717-9_15 · Cited by 102
Kundegorski, M. E., Akçay, S., Devereux, M., Mouton, A., & Breckon, T. P. (2016) · International Conference on Imaging for Crime Detection and Prevention (ICDP) · doi:10.1049/ic.2016.0080 · Cited by 94
Self-citationMulti-view object detection in dual-energy X-ray images
Baştan, M. (2015) · Machine Vision and Applications · doi:10.1007/s00138-015-0706-x · Cited by 90
Automated X-ray image analysis for cargo security: Critical review and future promise
Rogers, T. W., Jaccard, N., Morton, E. J., & Griffin, L. D. (2016) · Journal of X-Ray Science and Technology · doi:10.3233/xst-160606 · Cited by 74
Object Recognition in Baggage Inspection Using Adaptive Sparse Representations of X-ray Images
Mery, D., Svec, E., & Arias, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-29451-3_56 · Cited by 68
A review of automated image understanding within 3D baggage computed tomography security screening
Mouton, A., & Breckon, T. P. (2015) · Journal of X-Ray Science and Technology · doi:10.3233/xst-150508 · Cited by 63
Self-citationObject Recognition in Multi-View Dual Energy X-ray Images
Baştan, M., Byeon, W., & Breuel, T. M. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.130 · Cited by 60
Object classification in 3D baggage security computed tomography imagery using visual codebooks
Flitton, G. T., Mouton, A., & Breckon, T. P. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.02.006 · Cited by 50
Self-citationObject separation in x-ray image sets
Heitz, G., & Chechik, G. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539887 · Cited by 49
Automated detection in complex objects using a tracking algorithm in multiple X-ray views
Mery, D. (2011) · doi:10.1109/cvprw.2011.5981715 · Cited by 46
Mouton, A., & Breckon, T. P. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.01.010 · Cited by 40
Self-citationObject recognition in X-ray testing using an efficient search algorithm in multiple views
Mery, D., Riffo, V., Zuccar, I., et al. (2017) · Insight - Non-Destructive Testing and Condition Monitoring · doi:10.1784/insi.2017.59.2.85 · Cited by 20
Cited by
The effect of deep learning methods on deepfake audio detection for digital investigation
Mcuba, M., Singh, A., Ikuesan, R. A., & Venter, H. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.01.283 · Cited by 117
Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection
Akcay, S., Atapour-Abarghouei, A., & Breckon, T. P. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851808 · Cited by 103
“In the context of X-ray baggage screening applications [33], the UBA and FFOB datasets from [13] are used to formulate an anomaly detection problem based on the concept of weapon threat items being an anomaly within the security screening process.”
MethodSelf-citationReal-Time Abnormal Object Detection for Video Surveillance in Smart Cities
Ingle, P. Y., & Kim, Y.-G. (2022) · Sensors · doi:10.3390/s22103862 · Cited by 96
“[26] proposed an X-ray baggage screening system used to classify and detect objects.”
BackgroundMethodAdoption of Machine Learning Systems for Medical Diagnostics in Clinics: Qualitative Interview Study
Pumplun, L., Fecho, M., Wahl, N., Peters, F., & Buxmann, P. (2021) · Journal of Medical Internet Research · doi:10.2196/29301 · Cited by 57
Content-Based Image Retrieval Using Deep Learning
Karur, D. J. C., Hebbal, A., & Pujari, D. J. (2022) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit228418 · Cited by 1
Metadata
- Authors
- Akcay, S., Kundegorski, M. E., Willcocks, C. G., & Breckon, T. P.
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2018-09
- Volume
- 13
- Issue
- 9
- Pages
- 2203-2215
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W2792998389
- Cited by
- 384
- References
- 47
- FWCI
- 21.18
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.