The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Abstract
Machine-Learning tasks are becoming pervasive in a broad range of domains, and in a broad range of systems (from embedded systems to data centers). At the same time, a small set of machine-learning algorithms (especially Convolutional and Deep Neural Networks, i.e., CNNs and DNNs) are proving to be state-of-the-art across many applications. As architectures evolve towards heterogeneous multi-cores composed of a mix of cores and accelerators, a machine-learning accelerator can achieve the rare combination of efficiency (due to the small number of target algorithms) and broad application scope.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
The PARSEC benchmark suite: characterization and architectural implications
Bienia, C., Kumar, S., Singh, J. P., & Li, K. (2008) · Proceedings of the 17th international conference on Parallel architectures and compilation techniques · doi:10.1145/1454115.1454128 · Cited by 3,444
Li, S., Ahn, J. H., Strong, R. D., Brockman, J. B., Tullsen, D. M., & Jouppi, N. P. (2009) · Proceedings of the 42nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/1669112.1669172 · Cited by 2,376
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695 · cited 17×
“However, recent state-of-the-art CNNs and DNNs are characterized by their large size.”
BackgroundMethodInfluentialRobust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667
Proceedings of the 29th International Conference on Machine Learning (ICML-12)
Langford, J. C., & Pineau, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4676 · Cited by 1,618
Dark silicon and the end of multicore scaling
Esmaeilzadeh, H., Blem, E., St. Amant, R., Sankaralingam, K., & Burger, D. (2011) · Proceedings of the 38th annual international symposium on Computer architecture · doi:10.1145/2000064.2000108 · Cited by 1,532
2011 International Joint Conference on Neural Networks
(2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2063350 · Cited by 1,469
Improving deep neural networks for LVCSR using rectified linear units and dropout
Dahl, G. E., Sainath, T. N., & Hinton, G. E. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639346 · Cited by 1,310
GradientBased Learning Applied to Document Recognition
(2009) · Intelligent Signal Processing · doi:10.1109/9780470544976.ch9 · Cited by 1,135
An empirical evaluation of deep architectures on problems with many factors of variation
Larochelle, H., Erhan, D., Courville, A., Bergstra, J., & Bengio, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273556 · Cited by 992
Building high-level features using large scale unsupervised learning
Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., Le, Q. V., & Ng, A. Y. (2012) · International Conference on Machine Learning · Cited by 823
Traffic sign recognition with multi-scale Convolutional Networks
Sermanet, P., & LeCun, Y. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033589 · Cited by 759
(2011) · Cited by 713
(2013) · Cited by 651
Neural Acceleration for General-Purpose Approximate Programs
Esmaeilzadeh, H., Sampson, A., Ceze, L., & Burger, D. (2012) · 2012 45th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1109/micro.2012.48 · Cited by 626
The 2007 International Joint Conference on Neural Networks
(2007) · 2007 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2007.4370894 · Cited by 575
A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm
Merolla, P., Arthur, J., Akopyan, F., Imam, N., Manohar, R., & Modha, D. S. (2011) · 2011 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2011.6055294 · Cited by 431
Learning to Label Aerial Images from Noisy Data
Mnih, V., & Hinton, G. E. (2012) · International Conference on Machine Learning · Cited by 399
Understanding sources of inefficiency in general-purpose chips
Hameed, R., Qadeer, W., Wachs, M., Azizi, O., Solomatnikov, A., Lee, B. C., Richardson, S., Kozyrakis, C., & Horowitz, M. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815968 · Cited by 391
NeuFlow: A runtime reconfigurable dataflow processor for vision
Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., & LeCun, Y. (2011) · CVPR 2011 WORKSHOPS · doi:10.1109/cvprw.2011.5981829 · Cited by 369
A dynamically configurable coprocessor for convolutional neural networks
Chakradhar, S., Sankaradas, M., Jakkula, V., & Cadambi, S. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815993 · Cited by 343
Convolutional Neural Networks Applied to House Numbers Digit Classification
Sermanet, P., Chintala, S., & LeCun, Y. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1204.3968 · Cited by 331
Wafer-scale integration of analog neural networks
Schemmel, J., Fieres, J., & Meier, K. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633828 · Cited by 275
SpiNNaker: Mapping neural networks onto a massively-parallel chip multiprocessor
Khan, M. M., Lester, D. R., Plana, L. A., Rast, A., Jin, X., Painkras, E., & Furber, S. B. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4634199 · Cited by 270
Finite precision error analysis of neural network hardware implementations
Holt, J. L., & Hwang, J.-N. (1993) · IEEE Transactions on Computers · doi:10.1109/12.210171 · Cited by 230
Dynamically Reconfigurable Silicon Array of Spiking Neurons With Conductance-Based Synapses
Vogelstein, R. J., Mallik, U., Vogelstein, J. T., & Cauwenberghs, G. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.883007 · Cited by 220
Convolution engine: balancing efficiency & flexibility in specialized computing
Qadeer, W., Hameed, R., Shacham, O., Venkatesan, P., Kozyrakis, C., & Horowitz, M. A. (2013) · Proceedings of the 40th Annual International Symposium on Computer Architecture · doi:10.1145/2485922.2485925 · Cited by 168
A defect-tolerant accelerator for emerging high-performance applications
Temam, O. (2012) · ACM SIGARCH Computer Architecture News · doi:10.1145/2366231.2337200 · Cited by 143
Self-citationKim, J.-Y., Kim, M., Lee, S., et al. (2010) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2009.2031768 · Cited by 120
Du, Z., Lingamneni, A., Chen, Y., Palem, K. V., Temam, O., & Wu, C. (2014) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2014.6742890 · Cited by 116
Self-citation1993 International conference on acoustics, speech and signal processing
(1992) · Signal Processing · doi:10.1016/0165-1684(92)90105-6 · Cited by 109
BenchNN: On the broad potential application scope of hardware neural network accelerators
Chen, T., Chen, Y., Duranton, M., Guo, Q., Hashmi, A. G., Lipasti, M. H., Nere, A., Qiu, S., Sébag, M., & Temam, O. (2012) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2012.6402898 · Cited by 106
Self-citationOn the capabilities of neural networks using limited precision weights
Drăghici, S. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00032-1 · Cited by 93
Accelerating neuromorphic vision algorithms for recognition
Maashri, A. A., DeBole, M., Cotter, M. J., Chandramoorthy, N., Yang, X., Narayanan, V., & Chakrabarti, C. (2012) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/2228360.2228465 · Cited by 51
Hashmi, A. G., Nere, A., Thomas, J. J., & Lipasti, M. H. (2011) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/1950365.1950385 · Cited by 40
Cited by
Han (2023) · doi:10.1109/tpami.2022.3152247 · Cited by 4,682
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
“DNN Timeline • 1940s - Neural networks were proposed • 1960s - Deep neural networks were proposed • 1989 - Neural networks for recognizing digits (LeNet) • 1990s - Hardware for shallow neural nets (Intel ETANN) • 2011 - Breakthrough DNN-based speech recognition (Microsoft) • 2012 - DNNs for vision start supplanting ha…”
InfluentialSelf-citationEyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Self-citationBinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158
Metadata
- Authors
- Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O.
- Venue
- Proceedings of the 19th international conference on Architectural support for programming languages and operating systems
- Publisher
- ACM
- Published
- 2014-02-24
- Pages
- 269-284
- OpenAlex
- W2152839228
- Cited by
- 1,297
- References
- 39
- FWCI
- 73.02
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.