The DOI matches its DataCite record; 13 of the 14 references it cites were found in a registry or an index, and 1 are not checked yet.
Fast Convolutional Nets With fbfft: A GPU Performance Evaluation
Open accessAbstract
We examine the performance profile of Convolutional Neural Network training on the current generation of NVIDIA Graphics Processing Units. We introduce two new Fast Fourier Transform convolution implementations: one based on NVIDIA's cuFFT library, and another based on a Facebook authored FFT implementation, fbfft, that provides significant speedups over cuFFT (over 1.5x) for whole CNNs. Both of these convolution implementations are available in open source, and are faster than NVIDIA's cuDNN implementation for many common convolutional layers (up to 23.5x for some synthetic kernel configurations). We discuss different performance regimes of convolutions, comparing areas where straightforward time domain convolutions outperform Fourier frequency domain convolutions. Details on algorithmic applications of NVIDIA GPU hardware specifics in the implementation of fbfft are also provided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The above calculation can be accelerated by using the Fast Fourier Transform (FFT) and the Inverse FFT (IFFT) [160-163].”
From Object Detection in 20 Years: A Survey (2023) · cites this paper as [162]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An algorithm for the machine calculation of complex Fourier series
Cooley, J. W., & Tukey, J. W. (1965) · Mathematics of Computation · doi:10.1090/s0025-5718-1965-0178586-1 · Cited by 13,154
Natural Language Processing (almost) from ScratchPreprint
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 6,923
Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 5,299
A bridging model for parallel computation
Valiant, L. (1990) · CACM · doi:10.1145/79173.79181 · Cited by 4,318
A Bridging Model for Parallel Computation
Valiant, L. G. (1990) · ACM eBooks · doi:10.1145/3749740.3749753 · Cited by 3,697
Torch7: A Matlab-like Environment for Machine Learning
Collobert, R., Kavukcuoglu, K., & Farabet, C. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,241
Understanding digital signal processing
Lyons, R. G. (1996) · Cited by 1,017
(2013) · doi:10.1145/2491956.2462176 · Cited by 885
Irigoin, F., & Triolet, R. (1988) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/73560.73588 · Cited by 565
Parallel Computing Experiences with CUDA
Garland, M., LeGrand, S., Nickolls, J. R., Anderson, J. A., Hardwick, J., Morton, S., Phillips, E. H., Zhang, Y., & Volkov, V. M. (2008) · IEEE Micro · doi:10.1109/mm.2008.57 · Cited by 545
Flagged first, then by citations
Research works printed but not linked: 8
- Bergstra, James, Breuleux, Olivier, Bastien, Fr´ ed´ eric, Lamblin, Pascal, Pascanu, Razvan, Desjardins, Guillaume, Turian, Joseph, Warde-Farley, David, and Bengio, Yoshua. Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy) , June 2010. Oral Presentation.
- Bluestein, Leo I. A linear filtering approach to the computation of discrete Fourier transform. Audio and Electroacoustics, IEEE Transactions on , 18(4):451-455, December 1970. ISSN 0018-9278.
- Brosch, Tom and Tam, Roger C. Efficient training of convolutional deep belief networks in the frequency domain for application to high-resolution 2d and 3d images. Neural Computation , 27 (1):211-227, 2015. doi: 10.1162/NECO a 00682. URL http://dx.doi.org/10.1162/ NECO\_a\_00682 . · DOI
- Chetlur, Sharan, Woolley, Cliff, Vandermersch, Philippe, Cohen, Jonathan, Tran, John, Catanzaro, Bryan, and Shelhamer, Evan. cudnn: Efficient primitives for deep learning. CoRR , abs/1410.0759, 2014. URL http://arxiv.org/abs/1410.0759 . · arXiv
- Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (eds.), Advances in Neural Information Processing Systems 25 , pp. 1097-1105. Curran Associates, Inc., 2012. URL http://papers.nips.cc/paper/4824-imagenetclassification-with-deep-convolutional-neural-networks.pdf .
- Lavin, Andrew. maxdnn: An efficient convolution kernel for deep learning with maxwell gpus. CoRR , abs/1501.06633, 2015. URL http://arxiv.org/abs/1501.06633 . · arXiv
- Sermanet, Pierre, Eigen, David, Zhang, Xiang, Mathieu, Michael, Fergus, Rob, and LeCun, Yann. Overfeat: Integrated recognition, localization and detection using convolutional networks. In International Conference on Learning Representations (ICLR 2014) . CBLS, April 2014. URL http://openreview.net/document/d332e77d-459a-4af8-b3ed-55ba .
- Volkov, V. Better performance at lower occupancy. In GPU Technology Conference , 2010. URL http://www.cs.berkeley.edu/˜ volkov/volkov10-GTC.pdf .
Cited by
Sorted by citations
Items 101–200 of 245
Liao, S., Li, S., Liu, J., Huang, H., & Xiao, X. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.010 · Cited by 17
Don’t Learn What You Already Know
Masure, L., Cristiani, V., Lecomte, M., & Standaert, F. (2022) · IACR Transactions on Cryptographic Hardware and Embedded Systems · doi:10.46586/tches.v2023.i1.32-59 · Cited by 17
Ahmad, A., & Pasha, M. A. (2019) · Design, Automation, and Test in Europe · doi:10.23919/date.2019.8715272 · Cited by 17
Lin, J., Ma, L., & Cui, J. (2020) · IEEE Access · doi:10.1109/access.2020.2996250 · Cited by 18
Multi-dimensional Parallel Training of Winograd Layer on Memory-Centric Architecture
Hong, B., Ro, Y., & Kim, J. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00061 · Cited by 18
Classify 3D voxel based point-cloud using convolutional neural network on a neural compute stick
Xu, X., Amaro, J., Caulfield, S., Falcão, G., & Moloney, D. (2017) · International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD) · doi:10.1109/fskd.2017.8393296 · Cited by 16
Convolutional neural network for motorbike detection in dense traffic
Huynh, C.-K., Le, T.-S., & Hamamoto, K. (2016) · International Conference on Communications and Electronics (ICCE) · doi:10.1109/cce.2016.7562664 · Cited by 16
GPU Fast Convolution via the Overlap-and-Save Method in Shared Memory
Adámek, K., Dimoudi, S., Giles, M. B., & Armour, W. (2020) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3394116 · Cited by 16
Review of prominent strategies for mapping CNNs onto embedded systems
Arredondo-Velázquez, M., Díaz-Carmona, J., Gutiérrez, A. I. B., & Torres-Huitzil, C. (2020) · IEEE Latin America Transactions · doi:10.1109/tla.2020.9082927 · Cited by 16
Towards Compact ConvNets via Structure-Sparsity Regularized Filter PruningPreprint
Lin, S., Ji, R., Li, Y., Deng, C. D., & Li, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.07827 · Cited by 16
A Survey of Intelligent Chip Design Research Based on Spiking Neural Networks
Chen, L., Xiong, X., & Liu, J. (2022) · IEEE Access · doi:10.1109/access.2022.3200454 · Cited by 19
Combining FFT and Spectral-Pooling for Efficient Convolution Neural Network Model
Wang, Z., Lan, Q., Huang, D., & Wen, M. (2016) · International Conference on Artificial Intelligence and Industrial Engineering (AIIE) · doi:10.2991/aiie-16.2016.47 · Cited by 15
Hegde, G., Siddhartha, & Kapre, N. (2017) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3105925 · Cited by 17
Indirect Deconvolution Algorithm
Dukhan, M. (2020) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw50202.2020.00154 · Cited by 16
Lin, J., Ma, L., & Yao, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2936591 · Cited by 15
Optimizing Winograd-Based Convolution with Tensor Cores
Liu, J., Yang, D., & Lai, J. (2021) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3472456.3472473 · Cited by 14
Fourier Transform Layer: A proof of work in different training scenarios
Żak, J., Korzyńska, A., Pater, A., & Roszkowiak, Ł. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110607 · Cited by 14
A Fourier domain acceleration framework for convolutional neural networks
Lin, J., Ma, L., & Yao, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.080 · Cited by 15
Optimizing Memory Efficiency for Convolution Kernels on Kepler GPUs
Chen, X., Chen, J., Chen, D. Z., & Hu, X. S. (2017) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3061639.3062297 · Cited by 14
Efficient Dilated-Winograd Convolutional Neural Networks
Kim, M., Park, C., Kim, S.-J., Hong, T., & Ro, W. W. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803277 · Cited by 14
FFT Convolutions are Faster than Winograd on Modern CPUs, Here is WhyPreprint
Zlateski, A., Jia, Z., Li, K., & Durand, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.07851 · Cited by 19
Winograd Algorithm for 3D Convolution Neural Networks
Wang, Z., Lan, Q., He, H., & Zhang, C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68612-7_69 · Cited by 13
Data Infrastructure for Intelligent Transportation Systems
Luckow, A., & Kennedy, K. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809715-1.00005-5 · Cited by 13
Exploring the Design Space of Deep Convolutional Neural Networks at Large ScalePreprint
Iandola, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.06519 · Cited by 18
ZNNi: Maximizing the Inference Throughput of 3D Convolutional Networks on CPUs and GPUs
Zlateski, A., Lee, K., & Seung, H. S. (2016) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc.2016.72 · Cited by 12
Zhao, W., Yao, X., Yu, Z., Chen, G., Ma, Y., Yu, B., & Wong, M. D. F. (2022) · International Conference on Computer Aided Design · doi:10.1145/3508352.3549468 · Cited by 12
Review and testing of frontal face detectors
Kalinovskii, I., & Спицын, В. Г. (2016) · Computer Optics · doi:10.18287/2412-6179-2016-40-1-99-111 · Cited by 12
Energy efficient techniques using FFT for deep convolutional neural networks
Nguyen‐Thanh, N., Duc, H. L., Ta, D., & Nguyen, V.-T. (2016) · International Conference on Advanced Technologies for Communications · doi:10.1109/atc.2016.7764779 · Cited by 11
Heterogeneous Scheduling of Deep Neural Networks for Low-power Real-time Designs
Shea, C., & Mohsenin, T. (2019) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3358699 · Cited by 12
Convolutional neural network on neural compute stick for voxelized point-clouds classification
Xu, X., Amaro, J., Caulfield, S., Forembski, A., Falcão, G., & Moloney, D. (2017) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei.2017.8302078 · Cited by 12
A detailed comparative study of open source deep learning frameworksPreprint
Al-Bdour, G., Al-Qurran, R., Al‐Ayyoub, M., & Shatnawi, A. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.00102 · Cited by 12
Fast Convolution Operations on Many-Core Architectures
Li, S., Zhang, Y., Xiang, C., & Shi, L. (2015) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-css-icess.2015.94 · Cited by 11
Detection of pedestrians at far distance
Bunel, R., Davoine, F., & Xu, P. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487382 · Cited by 11
Zlateski, A., & Seung, H. S. (2017) · International Conference on Supercomputing · doi:10.1145/3079079.3079081 · Cited by 10
DCT-based Fast Spectral Convolution for Deep Convolutional Neural Networks
Xu, Y., & Nakayama, H. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534135 · Cited by 11
Optimizing the efficiency of deep learning through accelerator virtualization
Gschwind, M. K., Kaldewey, T., & Tam, D. K. (2017) · IBM Journal of Research and Development · doi:10.1147/jrd.2017.2716598 · Cited by 11
He, Y., Qian, J., Le, C. X., Hetang, C., Lyu, Q., Wang, W., & Yue, T. (2023) · Advances in Artificial Intelligence and Machine Learning · doi:10.54364/aaiml.2023.1197 · Cited by 16
cltorch: a Hardware-Agnostic Backend for the Torch Deep Neural Network Library, Based on OpenCLPreprint
Perkins, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04884 · Cited by 17
exploring Fine-Grained Sparsity in Convolutional Neural Networks for Efficient Inference
Wang, L., Guo, Y., Dong, X., Wang, Y., Ying, X., Lin, Z., & An, W. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3193925 · Cited by 11
Self-Convolution: A Highly-Efficient Operator for Non-Local Image Restoration
Guo, L., Zha, Z., Ravishankar, S., & Wen, B. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414124 · Cited by 9
Reducing the Training Time of Neural Networks by PartitioningPreprint
Miranda, C. S., & Zuben, F. J. V. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.02954 · Cited by 10
Trivializing The Energy Landscape Of Deep Networks.Preprint
Chaudhari, P., & Soatto, S. (2015) · arXiv (Cornell University) · Cited by 12
CBinfer: Change-Based Inference for Convolutional Neural Networks on Video DataPreprint
Cavigelli, L., Degen, P., & Benini, L. (2017) · arXiv (Cornell University) · doi:10.3929/ethz-b-000219323 · Cited by 9
Efficient and Generic 1D Dilated Convolution Layer for Deep LearningPreprint
Chaudhary, N., Misra, S., Kalamkar, D. D., Heinecke, A., Georganas, E., Ziv, B., Adelman, M., & Kaul, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08002 · Cited by 9
Han, B., & Roy, K. (2018) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2018.2865303 · Cited by 8
Jointly Sparse Convolutional Neural Networks in Dual Spatial-winograd Domains
Choi, Y., El‐Khamy, M., & Lee, J. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682922 · Cited by 8
Accelerating Compact Convolutional Neural Networks with Multi-threaded Data Streaming
Chen, W., Wang, Z., Li, S., Yu, Z., & Li, H. (2019) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2019.00099 · Cited by 8
NUMA-aware FFT-based Convolution on ARMv8 Many-core CPUs
Huang, X., Wang, Q., Lu, S., Hao, R., Mei, S., & Liu, J. (2021) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom52081.2021.00142 · Cited by 8
Malik, A. M., Lu, M., Wang, N., Lin, Y., & Yoo, S. (2018) · New York Scientific Data Summit (NYSDS) · doi:10.1109/nysds.2018.8538946 · Cited by 9
DCT Based Information-Preserving Pooling for Deep Neural Networks
Xu, Y., & Nakayama, H. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8802962 · Cited by 8
Parallel Computing for Brain Simulation
Pastur-Romay, L. A., Porto-Pazos, A. B., Cedrón, F., & Pazos, A. (2016) · Current Topics in Medicinal Chemistry · doi:10.2174/1568026617666161104105725 · Cited by 8
Sequence embeddings help to identify fraudulent cases in healthcare insurancePreprint
Fursov, I., Zaytsev, A., Khasyanov, R., Spindler, M., & Burnaev, E. V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03072 · Cited by 8
AdaOPC 2.0: Enhanced Adaptive Mask Optimization Framework for via Layers
Zhao, W., Yao, X., Yin, S., Bai, Y., Yu, Z., Ma, Y., Yu, B., & Wong, M. D. F. (2024) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2024.3378600 · Cited by 7
Performance evaluation of faster R-CNN on GPU for object detection
Adam, B., Zaman, F. H. K., Yassin, A. I. M., Abidin, H. Z., & Rizman, Z. I. (2018) · Journal of Fundamental and Applied Sciences · doi:10.4314/jfas.v9i3s.64 · Cited by 7
HyConv: Accelerating Multi-Phase CNN Computation by Fine-Grained Policy Selection
Li, X., Zhang, G., Wang, Z., & Zheng, W. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2864299 · Cited by 7
Fast Convolutional Neural Networks with Fine-Grained FFTs
Zhang, Y., & Li, X. (2020) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1145/3410463.3414642 · Cited by 7
Optimizing GPU Memory Transactions for Convolution Operations
Lu, G., Zhang, W., & Wang, Z. (2020) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster49012.2020.00050 · Cited by 7
Scalable training of 3D convolutional networks on multi- and many-cores
Zlateski, A., Lee, K., & Seung, H. S. (2017) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2017.02.006 · Cited by 7
Fu, H., Tang, S., He, B., Yu, C., & Sun, J. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-021-03746-z · Cited by 6
Towards a Flexible Hardware Implementation for Mixed-Radix Fourier Transforms
Mario, V., Yang, X., Shalf, J. M., & Popovici, D. T. (2023) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec58863.2023.10363540 · Cited by 6
Convolutional neural network simplification with progressive retraining
Osaku, D., Gomes, J. F., & Falcão, A. X. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.06.032 · Cited by 7
Introducing ToPe‐FFT: An OpenCL‐based FFT library targeting GPUs
Jan, B., Khan, F. G., Montrucchio, B., Chronopoulos, A. T., Shamshirband, S., & Khan, A. N. (2017) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.4256 · Cited by 6
Prune the Convolutional Neural Networks with Sparse Shrink
Li, X. S., & Liu, C. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.6.mobmu-306 · Cited by 5
Accelerating winograd convolutions using symbolic computation and meta-programming
Mazaheri, A., Beringer, T., Moskewicz, M. W., Wolf, F., & Jannesari, A. (2020) · European Conference on Computer Systems · doi:10.1145/3342195.3387549 · Cited by 5
HAW: Hardware-Aware Point Selection for Efficient Winograd Convolution
Li, C., Jiang, P., Zhou, H., Wang, X., & Zhao, X. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3258863 · Cited by 5
3D Body Scanning Measurement System Associated with RF Imaging, Zero-padding and Parallel Processing
Kim, H. T., Jin, K. C., Kim, S. T., Kim, J., & Choi, S. (2016) · Measurement Science Review · doi:10.1515/msr-2016-0011 · Cited by 5
Unrolled Memory Inner-Products: An Abstract GPU Operator for Efficient Vision-Related Computations
Lin, Y., Chen, W.-C., & Chien, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.490 · Cited by 5
Methods for Accelerating Machine Learning in High Performance Computing
Lim, R. (2019) · Cited by 5
Diminished-1 Fermat Number Transform for Integer Convolutional Neural Networks
Zhu, B., Ahmed, N., Peltenburg, J., Bertels, K., & Al-Ars, Z. (2019) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda.2019.8713250 · Cited by 5
Li, X., Zhang, G., & Zheng, W. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3040723 · Cited by 5
An Efficient im2row-Based Fast Convolution Algorithm for ARM Cortex-M MCUs
Wang, P., Wang, X., Luo, R., Wang, D., Luo, M., Qiao, S., & Zhou, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3110827 · Cited by 5
Learning with Scalability and Compactness
Chen, W. (2016) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7th8jz2 · Cited by 4
Compression of Deep Convolutional Neural Networks under Joint Sparsity ConstraintsPreprint
Choi, Y., El‐Khamy, M., & Lee, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08303 · Cited by 6
MobiVSR: A Visual Speech Recognition Solution for Mobile DevicesPreprint
Shrivastava, N., Saxena, A., Kumar, Y., Shah, R. R., Mahata, D., & Stent, A. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03968 · Cited by 5
Efficient Convolutional Neural Networks Utilizing Fine-Grained Fast Fourier Transforms
Zhang, Y., Li, F., Xu, H., Li, X., & Jiang, S. L. (2024) · Electronics · doi:10.3390/electronics13183765 · Cited by 4
Fu, H., Tang, S., He, B., Yu, C., & Sun, J. (2018) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3225058.3225077 · Cited by 4
FedTC: Enabling Communication-Efficient Federated Learning via Transform Coding
Guan, Y., Liu, X., Niu, J., & Ren, T. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621176 · Cited by 4
Differential Image-Based Scalable YOLOv7-Tiny Implementation for Clustered Embedded Systems
Hong, S., & Park, D. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3419095 · Cited by 4
Efficient Training of Small Kernel Convolutional Neural Networks using Fast Fourier Transform
Highlander, T. C. (2015) · Journal of Bioresource Management · Cited by 4
GPU Based fast MPEG-CDVS encoder
Sun, W., Zhang, X., Wang, S., Chen, J., & Duan, L. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296456 · Cited by 4
Mozafari, S. H., Clark, J. J., Gross, W. J., & Meyer, B. H. (2021) · IEEE Open Journal of Circuits and Systems · doi:10.1109/ojcas.2021.3123899 · Cited by 4
Rhu, M. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297377 · Cited by 4
TTC: A high-performance Compiler for Tensor TranspositionsPreprint
Springer, P., Hammond, J. R., & Bientinesi, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.02297 · Cited by 4
L3 Fusion: Fast Transformed Convolutions on CPUsPreprint
Gelashvili, R., Shavit, N., & Zlateski, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02165 · Cited by 4
Shifted Spatial-Spectral Convolution for Deep Neural Networks
Xu, Y., & Nakayama, H. (2019) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3338533.3366575 · Cited by 3
HTNN: Deep Learning in Heterogeneous Transform Domains with Sparse-Orthogonal Weights
Chen, Y., Liu, B., Abillama, P., & Kim, H.-S. (2021) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped52811.2021.9502477 · Cited by 3
Compositional deep learning in Futhark
Tran, D. M., Henriksen, T., & Elsman, M. (2019) · doi:10.1145/3331553.3342617 · Cited by 3
Real-time Pedestrian Detection using Convolutional Neural Network on Embedded Platform
Hu, J., Liu, W., Cheng, S., Tian, H., Yuan, H., & Zhao, H. (2016) · SAE International journal of passenger cars. Electronic and electrical systems · doi:10.4271/2016-01-1877 · Cited by 3
A software technique to enhance register utilization of Convolutional Neural Networks on GPGPUs
Lin, C.-H., Cheng, A.-T., & Lai, B.-C. C. (2017) · International Conference on Applied System Innovation · doi:10.1109/icasi.2017.7988499 · Cited by 3
Enhanced wavelet convolutional neural networks for visual tracking
Guo, Q., Cao, X., & Zou, Q. (2018) · Journal of Electronic Imaging · doi:10.1117/1.jei.27.5.053046 · Cited by 3
Continuous Differential Image-based Fast Convolution for Convolutional Neural Networks
Hong, S., & Park, D. (2022) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc55196.2022.9952518 · Cited by 3
Accelerating Convolutional Neural Network Using Discrete Orthogonal TransformsPreprint
REIS, E. D. J. C., & Benlamri, R. (2021) · doi:10.36227/techrxiv.14593686.v1 · Cited by 3
Going Deeper in Frequency Convolutional Neural Network: A Theoretical PerspectivePreprint
Zhu, X., Cui, Z., Zhang, T., Li, Y., & Yang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05690 · Cited by 3
Efficient frequency domain CNN algorithm
Mody, M., Ghone, C., Mathew, M., & Jones, J. (2017) · IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia) · doi:10.1109/icce-asia.2017.8307846 · Cited by 2
Alleviating Bottlenecks for DNN Execution on GPUs via Opportunistic Computing
Cheng, X., Zhao, H., Kandemir, M., Mohanty, S. P., & Jiang, B. (2020) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed48828.2020.9136967 · Cited by 2
Rizvi, S. M., Rahman, A. A.-H. A., Khalil-Hani, M., & Ayat, S. O. (2021) · Indonesian Journal of Electrical Engineering and Informatics (IJEEI) · doi:10.11591/ijeei.v9i1.2737 · Cited by 2
Analyzing the Reliability of Alternative Convolution Implementations for Deep Learning Applications
Bolchini, C., Cassano, L., Miele, A., Nazzari, A., & Passarello, D. (2023) · Proceedings · doi:10.1109/dft59622.2023.10313558 · Cited by 2
Accelerating CNNs Using Optimized Scheduling Strategy
Xu, R., Ma, S., Li, W., & Guo, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05057-3_15 · Cited by 2
Computational Models of the Brain
Porto-Pazos, A. B., Pastur-Romay, L. A., Cedrón, F., & Pazos, A. (2015) · MOL2NET International Conference on Multidisciplinary Sciences (MOL2NET) · doi:10.3390/mol2net-1-e009 · Cited by 3
Architectural support for convolutional neural networks on modern CPUs
Jain, A., Laurenzano, M. A., Pokam, G., Mars, J., & Tang, L. (2018) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1145/3243176.3243177 · Cited by 3
Metadata
- Authors
- Vasilache, N., Johnson, J., Mathieu, M., Chintala, S., Piantino, S., & LeCun, Y.
- Affiliations
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1412.7580
- OpenAlex
- W1789336918
- Cited by
- 246
- References
- 14
- Citations by year
- 2025: 2 · 2024: 9 · 2023: 14 · 2022: 13 · 2021: 33 · 2020: 22 · 2019: 34 · 2018: 35 · 2017: 40 · 2016: 32 · 2015: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Nvidia
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Signal Processing › Digital Filter Design and Implementation
- Keywords
- fast convolution, cuFFT, cuDNN, convolutional neural network training, GPU performance, NVIDIA GPUs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
