Xception: Deep Learning with Depthwise Separable Convolutions
The DOI matches its Crossref record; 20 of the 21 references it cites were found in a registry or an index.
Abstract
We present an interpretation of Inception modules in convolutional neural networks as being an intermediate step in-between regular convolution and the depthwise separable convolution operation (a depthwise convolution followed by a pointwise convolution). In this light, a depthwise separable convolution can be understood as an Inception module with a maximally large number of towers. This observation leads us to propose a novel deep convolutional neural network architecture inspired by Inception, where Inception modules have been replaced with depthwise separable convolutions. We show that this architecture, dubbed Xception, slightly outperforms Inception V3 on the ImageNet dataset (which Inception V3 was designed for), and significantly outperforms Inception V3 on a larger image classification dataset comprising 350 million images and 17,000 classes. Since the Xception architecture has the same number of parameters as Inception V3, the performance gains are not due to increased capacity but rather to a more efficient use of model parameters.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The top-5 popular baselines adopted in the evaluation are XceptionNet (Chollet 2017), Afchar et al. (2018), Nguyen et al. (2019a), ResNet (He et al. 2016), and Yang et al. (2019b).”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Chollet 2017
In the citing paper
“The main idea behind Xception is its depthwise separable convolution [125].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [125]
In the citing paper
“Depthwise separable convolution (DSC) has been found in past research to have a smaller number of parameters than traditional convolution [26].”
From Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG (2024) · cites this paper as [26]
In the citing paper
“In the research [24], a depthwise separable convolution neural network on FPGA is being reviewed due to its ability to reduce the number of model parameters and improve calculation speeds, which makes it widely used in mobile edge computing applications such as Xception [25] and MobileNet [26].”
From Embedded Intelligence on FPGA: Survey, Applications and Challenges (2021) · cites this paper as [25]
In the citing paper
“For classification (Table 10), the performance of Xception [12], LipForensics [21], Face X-Ray [36], and SBI [56] also drops compared to LAV-DF.”
From AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset (2024) · cites this paper as [12]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“in [4], which our proposed architecture uses extensively.”
BackgroundVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 2×
“In 2012, these ideas were refined into the AlexNet architecture [9], where convolution operations were being repeated multiple times in-between max-pooling operations, allowing the network to learn richer features at every spatial scale.”
BackgroundGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2×
“Since its first introduction, Inception has been one of the best performing family of models on the ImageNet dataset [14], as well as internal datasets in use at Google, in particular JFT [5].”
BackgroundMethodRethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · cited 2×
“What followed was a trend to make this style of network increasingly deeper, mostly driven by the yearly ILSVRC competition; first with Zeiler and Fergus in 2013 [25] and then with the VGG architecture in 2014 [18].”
BackgroundDistilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 2×
“Since its first introduction, Inception has been one of the best performing family of models on the ImageNet dataset [14], as well as internal datasets in use at Google, in particular JFT [5].”
Background
Research works printed but not linked: 7
- lin, 2013, Network in Network
- sifre, 2014, Rigid-motion scattering for image classification
- silberman, 2016, Tf-slim
- chollet, 2015, Keras
- abadi, 2015, Tensor-Flow Large-scale machine learning on heterogeneous systems
- tieleman, 0, Divide the gradient by a running average of its recent magnitude, COURSERA Neural Networks for Machine Learning, 4
- vanhoucke, 2014, Learning visual representations at scale, ICLRE
Cited by
Items 101–200 of 1,227
Deep semantic segmentation of natural and medical images: a review
Asgari Taghanaki, S., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 870
Orlando, J. I., Fu, H., Barbosa Breda, J., van Keer, K., Bathula, D. R., Diaz-Pinto, A., Fang, R., Heng, P.-A., Kim, J., Lee, J., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101570 · Cited by 855
“The classification networks comprised of general-purpose image classification models that were top-ranked in ImageNet Large Scale Visual Recognition Competition (Russakovsky et al., 2015), such as VGG19 (Simonyan and Zisserman, 2014), ResNets (He et al., 2016), DenseNets (Huang et al., 2017), Inception V3 (Szegedy et…”
InfluentialArdakani, A. A., Kanafi, A. R., Acharya, U. R., Khadem, N., & Mohammadi, A. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103795 · Cited by 851
“The last network, Xception, is CNN based on depthwise separable convolution layers [28].”
Benchmark analysis of representative deep neural network architectures
Bianco, S., Cadene, R., Celona, L., & Napoletano, P. (2018) · IEEE Access · doi:10.1109/access.2018.2877890 · Cited by 838
“All the pre-trained models expect input images normalized in the same way, i.e. mini-batches of RGB images with shape 3 × H × W , where H and W are expected to be: - 331 pixels for the NASNet-A-Large model; - 229 pixels for InceptionResNet-v2, Inception-v3, Inception-v4, and Xception models; - 224 pixels for all the o…”
BackgroundInfluentialPIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllers
Xu, J., Xiong, Z., & Bhattacharyya, S. P. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01871 · Cited by 817
“DFANet [27] introduced a light-weight backbone by modifying the architecture of Xception [11], which was based on depth-wise separable convolution, and reduced the input size for faster inference speed.”
MethodTwins: Revisiting the Design of Spatial Attention in Vision Transformers
Chu, X., Tian, Z., Wang, Y., Zhang, B., Ren, H., Wei, X., Xia, H., & Shen, C. (2021) · arXiv · doi:10.48550/arxiv.2104.13840 · Cited by 817
SCConv: Spatial and Channel Reconstruction Convolution for Feature Redundancy
Li, J., Wen, Y., & He, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00596 · Cited by 760
“Networks like Xception [4], MobileNet [12] and MobileNeXt [35] disentangle standard convolution into depth-wise convolution and point-wise convolution to further decrease the connection density between channels.”
BackgroundA high-resolution canopy height model of the Earth
Lang, N., Jetz, W., Schindler, K., & Wegner, J. D. (2023) · Nature Ecology & Evolution · doi:10.1038/s41559-023-02206-6 · Cited by 810
“The architecture employs a series of residual blocks with separable convolutions 55 without any downsampling within the network.”
BackgroundAxial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., & Chen, L.-C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_7 · Cited by 809
ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training
Touvron, H., Bojanowski, P., Caron, M., Cord, M., El-Nouby, A., Grave, E., Izacard, G., Joulin, A., Synnaeve, G., Verbeek, J., et al. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3206148 · Cited by 807
“For instance, the VGG model [52] uses 3 × 3 convolutions, and later, other architectures such as the ResNext [63] or the Xception [11] mix 1 × 1 and 3 × 3 convolutions.”
BackgroundResMLP: Feedforward networks for image classification with data-efficient training
Touvron, H., Bojanowski, P., Caron, M., Cord, M., El-Nouby, A., Grave, E., Izacard, G., Joulin, A., Synnaeve, G., Verbeek, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2105.03404 · Cited by 807
Review of Image Classification Algorithms Based on Convolutional Neural Networks
Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., & Miao, Y. (2021) · Remote Sensing · doi:10.3390/rs13224712 · Cited by 789
“The experiment in [126] also shows that the residual connection mechanism similar to ResNet added to Xception can significantly speed up the training times and obtain a higher accuracy rate.”
MethodDo ImageNet Classifiers Generalize to ImageNet?
Recht, B., Roelofs, R., Schmidt, L., & Shankar, V. (2019) · arXiv · doi:10.48550/arxiv.1902.10811 · Cited by 790
Elsken, T., Metzen, J. H., & Hutter, F. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_3 · Cited by 785
Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution
Chen, Y., Fan, H., Xu, B., Yan, Z., Kalantidis, Y., Rohrbach, M., Shuicheng, Y., & Feng, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00353 · Cited by 736
A review of deep learning methods for semantic segmentation of remote sensing imagery
Yuan, X., Shi, J., & Gu, L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114417 · Cited by 766
Energy and Policy Considerations for Modern Deep Learning Research
Strubell, E., Ganesh, A., & McCallum, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i09.7123 · Cited by 774
“…many application areas of artificial intelligence, such as game playing (Silver et al. 2017; OpenAI 2018), natural language processing (Devlin et al. 2019; Aharoni, Johnson, and Firat 2019), computer vision (Chollet 2017; Brock, Donahue, and Si-monyan 2019) and robotics (Agostinelli et al. 2019).”
BackgroundDFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation
Li, H., Xiong, P., Fan, H., & Sun, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00975 · Cited by 718
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764
Gu, R., Wang, G., Song, T., Huang, R., Aertsen, M., Deprest, J., Ourselin, S., Vercauteren, T., & Zhang, S. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3035253 · Cited by 720
Contextual Transformer Networks for Visual Recognition
Li, Y., Yao, T., Pan, Y., & Mei, T. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3164083 · Cited by 749
“Table 8 details the performances of Mask-RCNN with different pre-trained vision backbones for the downstream task of instance segmentation on COCO dataset.”
BackgroundInfluentialDeep learning in computer vision: A critical review of emerging techniques and application scenarios
Chai, J., Zeng, H., Li, A., & Ngai, E. W. T. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100134 · Cited by 754
Deep learning in medical imaging and radiation therapy
Sahiner, B., Pezeshk, A., Hadjiiski, L. M., Wang, X., Drukker, K., Cha, K. H., Summers, R. M., & Giger, M. L. (2019) · Medical Physics · doi:10.1002/mp.13264 · Cited by 740
Learning to Enhance Low-Light Image via Zero-Reference Deep Curve Estimation
Li, C., Guo, C., & Chen, C. L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3063604 · Cited by 719
“the more efficient depthwise separable convolutions [33] that are commonly used in computer vision tasks [34], [35], [36] for reducing network parameters without compromising the performance much; 2) the estimated curve parameters in different iteration stages (a total of eight iterations in Zero-DCE) are similar in m…”
ResultApplications for deep learning in ecology
Christin, S., Hervet, É., & Lecomte, N. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13256 · Cited by 724
“Even then, training the model can take several days to converge for very complex analyses, and fine‐tuning to improve accuracy might require several training sessions (Chollet, 2016; Knight et al., 2017).”
BackgroundBond-Taylor, S., Leach, A., Long, Y., & Willcocks, C. G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3116668 · Cited by 703
“+ DistAug [32], [110] ?????”
BackgroundInfluentialLQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks
Zhang, D., Yang, J., Ye, D., & Hua, G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_23 · Cited by 693
Rahimzadeh, M., & Attar, A. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100360 · Cited by 695
“ures to a convolutional layer that is connected to the classifier. This Neural Network has shown higher accuracy comparing to the others. As we have tested several networks in our project, the Xception[3] and ResNet50V2[8] networks works almost better than other ones in extracting deep features. By concatenating the ou…”
InfluentialCPFNet: Context Pyramid Fusion Network for Medical Image Segmentation
Feng, S., Zhao, H., Shi, F., Cheng, X., Wang, M., Ma, Y., Xiang, D., Zhu, W., & Chen, X. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2983721 · Cited by 687
Mish: A Self Regularized Non-Monotonic Activation Function
Misra, D. (2020) · Proceedings of the British Machine Vision Conference 2020 · doi:10.5244/c.34.191 · Cited by 432
“…Mish Swish ReLU ResNet-20 [15] 92.02 % 91.61% 91.71% WRN-10-2 [50] 86.83 % 86.56% 84.56% SimpleNet [12] 91.70 % 91.44% 91.16% Xception Net [5] 88.73 % 88.56% 88.38% Capsule Net [40] 83.15 % 82.48% 82.19% Inception ResNet v2 [42] 85.21 % 84.96% 82.22% DenseNet-121 [19] 91.27 % 90.92%…”
InfluentialHoyer, L., Dai, D., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00969 · Cited by 622
Frontiers in Artificial Intelligence and Applications
Yadav, J., Shukla, S., Sharma, K., Soni, N., Agarwal, S., & Pathak, P. C. (2022) · 2022 3rd International Conference on Computation, Automation and Knowledge Management (ICCAKM) · doi:10.1109/iccakm54721.2022.9990098 · Cited by 660
Tomato plant disease detection using transfer learning with C-GAN synthetic images
Abbas, A., Jain, S., Gour, M., & Vankudothu, S. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106279 · Cited by 651
A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654
“Moreover, Chollet [27] presented an analysis of depthwise separable convolutions and their relationship to convolutional inception architecture.”
BackgroundTaye, M. M. (2023) · Computation · doi:10.3390/computation11030052 · Cited by 629
Video Classification With Channel-Separated Convolutional Networks
Tran, D., Wang, H., Feiszli, M., & Torresani, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00565 · Cited by 631
Deep Learning for Plant Stress Phenotyping: Trends and Future Perspectives
Singh, A. K., Ganapathysubramanian, B., Sarkar, S., & Singh, A. (2018) · Trends in Plant Science · doi:10.1016/j.tplants.2018.07.004 · Cited by 635
Review the state-of-the-art technologies of semantic segmentation based on deep learning
Mo, Y., Wu, Y., Yang, X., Liu, F., & Liao, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.005 · Cited by 632
Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation
Cheng, B., Collins, M. D., Zhu, Y., Liu, T., Huang, T. S., Adam, H., & Chen, L.-C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01249 · Cited by 635
Local Relation Networks for Image Recognition
Hu, H., Zhang, Z., Xie, Z., & Lin, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00356 · Cited by 570
A Deep Learning Ensemble Approach for Diabetic Retinopathy Detection
Qummar, S., Khan, F. G., Shah, S., Khan, A., Shamshirband, S., Rehman, Z. U., Ahmed Khan, I., & Jadoon, W. (2019) · IEEE Access · doi:10.1109/access.2019.2947484 · Cited by 622
“Let H = {Resnet50, Inceptionv3, Xception, Dense121, Dense169} be the set of pre-trained models.”
MethodInfluentialRevisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation
Yang, L., Qi, L., Feng, L., Zhang, W., & Shi, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00699 · Cited by 580
“We adopt exactly the same setting and backbone (Xception-65 [14]) as PseudoSeg [81].”
MethodRevisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation
Yang, L., Qi, L., Feng, L., Zhang, W., & Shi, Y. (2022) · arXiv · doi:10.48550/arxiv.2208.09910 · Cited by 619
“We adopt exactly the same setting and backbone (Xception-65 [14]) as PseudoSeg [81].”
MethodEfficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better
Menghani, G. (2023) · ACM Computing Surveys · doi:10.1145/3578938 · Cited by 605
Convolutional Networks with Dense Connectivity
Huang, G., Liu, Z., Pleiss, G., Maaten, L. V. D., & Weinberger, K. Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2918284 · Cited by 591
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Pham, H., Dai, Z., Xie, Q., & Le, Q. V. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01139 · Cited by 509
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600
A Brief Survey on Semantic Segmentation with Deep Learning
Hao, S., Zhou, Y., & Guo, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.118 · Cited by 596
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599
Deep learning – Method overview and review of use for fruit detection and yield estimation
Koirala, A., Walsh, K. B., Wang, Z., & McCarthy, C. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.04.017 · Cited by 581
Wavelet Convolutions for Large Receptive Fields
Finder, S. E., Amoyal, R., Treister, E., & Freifeld, O. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72949-2_21 · Cited by 514
A review of object detection based on deep learning
Xiao, Y., Tian, Z., Yu, J., Zhang, Y., Liu, S., Du, S., & Lan, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08976-6 · Cited by 584
“Xception Xception is an improvement over the InceptionV3 that replaces the convolution in the InceptionV3 with a depthwise separable convolution [34].”
BackgroundMethodInfluentialA comprehensive review on convolutional neural network in machine fault diagnosis
Jiao, J., Zhao, M., Lin, J., & Liang, K. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.088 · Cited by 575
Large Separable Kernel Attention: Rethinking the Large Kernel Attention design in CNN
Lau, K. W., Po, L.-M., & Rehman, Y. A. U. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121352 · Cited by 569
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573
Gupta, A., Anpalagan, A., Guan, L., & Khwaja, A. S. (2021) · Array · doi:10.1016/j.array.2021.100057 · Cited by 565
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00765-8 · Cited by 570
“AlexNet [60], Xception [21], Inception [125], Visual Geometry Group (VGG) [42], ResNet [43], etc., and other advanced deep learning models based on CNN are also used in the field.”
Suppress and Balance: A Simple Gated Network for Salient Object Detection
Zhao, X., Pang, Y., Zhang, L., Lu, H., & Zhang, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_3 · Cited by 497
Survey on semantic segmentation using deep learning techniques
Lateef, F., & Ruichek, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.003 · Cited by 559
Lite-HRNet: A Lightweight High-Resolution Network
Yu, C., Xiao, B., Gao, C., Yuan, L., Zhang, L., Sang, N., & Wang, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01030 · Cited by 557
Practical Block-Wise Neural Network Architecture Generation
Zhong, Z., Yan, J., Wu, W., Shao, J., & Liu, C.-L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00257 · Cited by 522
“70 Xception(our test) [4] 224x224 36 23.”
MethodDeep learning for site safety: Real-time detection of personal protective equipment
Nath, N. D., Behzadan, A. H., & Paal, S. G. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103085 · Cited by 540
ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network
Mehta, S., Rastegari, M., Shapiro, L., & Hajishirzi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00941 · Cited by 551
“2 Xception† [7] – 305 M 70.”
Reddi, V. J., Cheng, C., Kanter, D., Mattson, P., Schmuelling, G., Wu, C.-J., Anderson, B., Breughe, M., Charlebois, M., Chou, W., et al. (2020) · 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca45697.2020.00045 · Cited by 505
DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning
Graving, J. M., Chae, D., Naik, H., Li, L., Koger, B., Costelloe, B. R., & Couzin, I. D. (2019) · eLife · doi:10.7554/elife.47994 · Cited by 547
Mish: A Self Regularized Non-Monotonic Activation Function
Misra, D. (2019) · arXiv · doi:10.48550/arxiv.1908.08681 · Cited by 541
“These benchmarks were performed using a variety of models including DenseNet [18], Inception v3 [19], Xception Net [20] amongst many others.”
MethodLoey, M., Smarandache, F., & M. Khalifa, N. E. (2020) · Symmetry · doi:10.3390/sym12040651 · Cited by 538
“Varshni et al. [46] proposed pre-trained ConvNet models (VGG-16, Xception, Res50, Dense-121, and Dense-169) as feature-extractors followed by different classifiers Symmetry 2020, 12, 651 5 of 19 (SVM, Random Forest, k-nearest neighbors, Naïve Bayes) for the detection of normal and abnormal pneumonia X-rays images.”
MethodInfluentialGraph-Based Global Reasoning Networks
Chen, Y., Rohrbach, M., Yan, Z., Shuicheng, Y., Feng, J., & Kalantidis, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00052 · Cited by 512
“Xception [11], MobileNet [17, 28], and ResNeXt [34] use grouped or depth-wise convolutions to reduce the computational cost.”
Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Haliassos, A., Vougioukas, K., Petridis, S., & Pantic, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00500 · Cited by 537
“[46] showed, however, that these are outperformed by a deep, unconstrained Xception [10] network.”
BackgroundInfluentialDiabetic retinopathy detection through deep learning techniques: A review
Alyoubi, W. L., Shalash, W. M., & Abulkhair, M. F. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100377 · Cited by 527
Mahmud, T., Rahman, M. A., & Fattah, S. A. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103869 · Cited by 525
“Moreover, traditional convolution can be divided into depthwise convolution followed by a pointwise convolution that makes the process extremely computationally efficient [17].”
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Wang, H., Zhu, Y., Adam, H., Yuille, A., & Chen, L.-C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00542 · Cited by 497
Deep learning based detection and analysis of COVID-19 on chest X-ray images
Jain, R., Gupta, M., Taneja, S., & Hemanth, D. J. (2021) · Applied Intelligence · doi:10.1007/s10489-020-01902-1 · Cited by 520
“Its parameter size is similar to the Inception net, but it performs slightly better as compared to the inception net [48].”
BackgroundSmaAt-UNet: Precipitation nowcasting using a small attention-UNet architecture
Trebing, K., Staǹczyk, T., & Mehrkanoon, S. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.01.036 · Cited by 509
Deep learning for chest X-ray analysis: A survey
Çallı, E., Sogancioglu, E., van Ginneken, B., van Leeuwen, K. G., & Murphy, K. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102125 · Cited by 506
“The Xception network architecture (Chollet, 2017) builds upon the Inception architecture but separates the convolutions performed in the 2D image space from those performed across channels.”
BackgroundA scoping review of transfer learning research on medical image analysis using ImageNet
Morid, M. A., Borjali, A., & Del Fiol, G. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104115 · Cited by 508
Deep Dual-Resolution Networks for Real-Time and Accurate Semantic Segmentation of Traffic Scenes
Pan, H., Hong, Y., Sun, W., & Jia, Y. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3228042 · Cited by 495
Detecting Deepfakes with Self-Blended Images
Shiohara, K., & Yamasaki, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01816 · Cited by 503
“We train Xception [14] with Adam [35] optimizer.”
MethodInfluentialFakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499
A transfer learning method with deep residual network for pediatric pneumonia diagnosis
Liang, G., & Zheng, L. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.06.023 · Cited by 491
Ngugi, L. C., Abelwahab, M., & Abo-Zahhad, M. (2021) · Information Processing in Agriculture · doi:10.1016/j.inpa.2020.04.004 · Cited by 492
Nagpal, K., Foote, D., Liu, Y., Chen, P.-H. C., Wulczyn, E., Tan, F., Olson, N., Smith, J. L., Mohtashamian, A., Wren, J. H., et al. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0112-2 · Cited by 495
HAWQ: Hessian AWare Quantization of Neural Networks With Mixed-Precision
Dong, Z., Yao, Z., Gholami, A., Mahoney, M., & Keutzer, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00038 · Cited by 492
HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction
Zhou, Z., Ye, L., Wang, J., Wu, K., & Lu, K. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00862 · Cited by 460
“Extensive works have used rasterized scenes as model inputs [4, 9, 12, 15, 19, 25, 43] and employed standard image models [11,24,26,44] for learning.”
MethodDCSAU-Net: A deeper and more compact split-attention U-Net for medical image segmentation
Xu, Q., Ma, Z., HE, N., & Duan, W. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106626 · Cited by 469
COVID-19 Detection Through Transfer Learning Using Multimodal Imaging Data
Horry, M. J., Chakraborty, S., Paul, M., Ulhaq, A., Pradhan, B., Saha, M., & Shukla, N. (2020) · IEEE Access · doi:10.1109/access.2020.3016780 · Cited by 472
“The Xception [25] CNN was developed by Google Inc.”
BackgroundMethodInfluentialA review on deep learning in UAV remote sensing
Osco, L. P., Marcato Junior, J., Marques Ramos, A. P., de Castro Jorge, L. A., Fatholahi, S. N., de Andrade Silva, J., Matsubara, E. T., Pistori, H., Gonçalves, W. N., & Li, J. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102456 · Cited by 458
“The first version of MobileNet is based on a depthwise convolution [Chollet, 2017] and a point-wise convolution [Szegedy et al.”
MethodTwo-Branch Recurrent Network for Isolating Deepfakes in Videos
Masi, I., Killekar, A., Mascarenhas, R. M., Gurudatt, S. P., & AbdAlmageed, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_39 · Cited by 471
Computational bioacoustics with deep learning: a review and roadmap
Stowell, D. (2022) · PeerJ · doi:10.7717/peerj.13152 · Cited by 471
“…17 DenseNet (Huang et al., 2016) 7 AlexNet (Krizhevsky et al., 2012) 5 Inception (Szegedy et al., 2014) 4 LeNet (LeCun et al., 1998) 3 MobileNet (Sandler et al., 2018) 2 EfficientNet (Tan and Le, 2019) 2 Xception (Chollet, 2017) 2 U-net (Ronneberger et al., 2015) 2 Self-designed CNN 18 Table 1.”
Modeling Point Clouds With Self-Attention and Gumbel Subset Sampling
Yang, J., Zhang, Q., Ni, B., Li, L., Liu, J., Zhou, M., & Tian, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00344 · Cited by 446
FEELVOS: Fast End-To-End Embedding Learning for Video Object Segmentation
Voigtlaender, P., Chai, Y., Schroff, F., Adam, H., Leibe, B., & Chen, L.-C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00971 · Cited by 468
SDDNet: Real-Time Crack Segmentation
Choi, W., & Cha, Y.-J. (2020) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2019.2945265 · Cited by 462
Deep Industrial Image Anomaly Detection: A Survey
Liu, J., Xie, G., Wang, J., Li, S., Wang, C., Zheng, F., & Jin, Y. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1459-z · Cited by 463
Exploiting Diffusion Prior for Real-World Image Super-Resolution
Wang, J., Yue, Z., Zhou, S., Chan, K. C. K., & Loy, C. C. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02168-7 · Cited by 439
“Fast sampling strategy and model distillation are two promising solutions to improve efficiency, and such exploration is left as our future work.”
Li, R., Zheng, S., Zhang, C., Duan, C., Wang, L., & Atkinson, P. M. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.09.005 · Cited by 443
Computing Systems for Autonomous Driving: State of the Art and Challenges
Liu, L., Lu, S., Zhong, R., Wu, B., Yao, Y., Zhang, Q., & Shi, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3043716 · Cited by 450
“algorithms [210], [211], [212] were proposed in recent years.”
BackgroundInvolution: Inverting the Inherence of Convolution for Visual Recognition
Li, D., Hu, J., Wang, C., Li, X., She, Q., Zhu, L., Zhang, T., & Chen, Q. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01214 · Cited by 416
InceptionNeXt: When Inception Meets ConvNeXt
Yu, W., Zhou, P., Yan, S., & Wang, X. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00542 · Cited by 423
NVAE: A Deep Hierarchical Variational Autoencoder
Vahdat, A., & Kautz, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03898 · Cited by 350
“The main building block of our network is depthwise convolutions [38, 39] that rapidly increase the receptive field of the network without dramatically increasing the number of parameters.”
Background
Metadata
- Authors
- Chollet, F.
- Affiliations
- Google (United States) (US)
- Corresponding author
- Chollet, Francois
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 1800-1807
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2531409750
- Cited by
- 20,380
- References
- 21
- Citations by year
- 2026: 1618 · 2025: 3098 · 2024: 3287 · 2023: 3281 · 2022: 3003 · 2021: 2735 · 2020: 1859 · 2019: 1096 · 2018: 356 · 2017: 42
- FWCI
- 268.33
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- Xception, depthwise separable convolution, Inception module, InceptionV3, convolutional neural network architecture, image classification, parameter efficiency, ImageNet, large-scale image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.