TETRIS: Scalable and Efficient Neural Network Acceleration with 3D Memory
The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
The high accuracy of deep neural networks (NNs) has led to the development of NN accelerators that improve performance by two orders of magnitude. However, scaling these accelerators for higher performance with increasingly larger NNs exacerbates the cost and energy overheads of their memory systems, including the on-chip SRAM buffers and the off-chip DRAM channels.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · cited 1×
“AlexNet ZFNet VGG16 VGG19 ResNet [26] [46] [41] [41] [19]”
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158 · cited 3×
“Early designs [5, 6, 47] used parallel inner-product engines which could be easily programmed for different layer types.”
BackgroundMethodEIE: efficient inference engine on compressed deep neural network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001163 · Cited by 1,937
Self-citationISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
DaDianNao: A Machine-Learning Supercomputer
Chen, Y., Luo, T., Liu, S., Zhang, S., He, L., Wang, J., Li, L., Chen, T., Xu, Z., Sun, N., et al. (2014) · 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1109/micro.2014.58 · Cited by 1,492
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
Chi, P., Li, S., Xu, C., Zhang, T., Zhao, J., Liu, Y., Wang, Y., & Xie, Y. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001140 · Cited by 1,231
Eyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001177 · Cited by 1,182 · cited 10×
“The PEs are organized in a 2D array, with a custom onchip interconnect between the PEs and the memory hierarchy [5, 7, 12].”
BackgroundMethodInfluentialShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750389 · Cited by 933
Singh, H., Lee, M.-H., Lu, G., Kurdahi, F. J., Bagherzadeh, N., & Chaves Filho, E. M. (2000) · IEEE Transactions on Computers · doi:10.1109/12.859540 · Cited by 858
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
A scalable processing-in-memory accelerator for parallel graph processing
Ahn, J., Hong, S., Yoo, S., Mutlu, O., & Choi, K. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750386 · Cited by 767
14.5 Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks
Chen, Y.-H., Krishna, T., Emer, J., & Sze, V. (2016) · 2016 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2016.7418007 · Cited by 713
ORION 2.0: A fast and accurate NoC power and area model for early-stage design space exploration
Kahng, A. B., Li, B., Peh, L.-S., & Samadi, K. (2009) · Design, Automation, and Test in Europe · doi:10.1109/date.2009.5090700 · Cited by 690
ORION 2.0: A Fast and Accurate NoC Power and Area Model for Early-Stage Design Space Exploration
Kahng, A. B., Li, B., Peh, L.-S., & Samadi, K. (2008) · Cited by 670
Cnvlutin: ineffectual-neuron-free deep neural network computing
Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N. E., & Moshovos, A. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001138 · Cited by 614
ADRES: An Architecture with Tightly Coupled VLIW Processor and Coarse-Grained Reconfigurable Matrix
Mei, B., Vernalde, S., Verkest, D., De Man, H., & Lauwereins, R. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45234-8_7 · Cited by 558
ZSim: fast and accurate microarchitectural simulation of thousand-core systems
Sanchez, D., & Kozyrakis, C. (2013) · Proceedings of the 40th Annual International Symposium on Computer Architecture · doi:10.1145/2485922.2485963 · Cited by 460
Self-citationMinerva: enabling low-power, highly-accurate deep neural network accelerators
Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernández-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001165 · Cited by 446
Hybrid memory cube new DRAM architecture increases density and performance
Jeddeloh, J., & Keeth, B. (2012) · 2012 Symposium on VLSI Technology (VLSIT) · doi:10.1109/vlsit.2012.6242474 · Cited by 444
NeuFlow: A runtime reconfigurable dataflow processor for vision
Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., & LeCun, Y. (2011) · CVPR 2011 WORKSHOPS · doi:10.1109/cvprw.2011.5981829 · Cited by 369
Neurocube: a programmable digital neuromorphic architecture with high-density 3D memory
Kim, D., Kung, J., Chai, S., Yalamanchili, S., & Mukhopadhyay, S. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001178 · Cited by 342
RowClone: fast and energy-efficient in-DRAM bulk data copy and initialization
Seshadri, V., Kim, Y., Fallin, C., Lee, D., Ausavarungnirun, R., Pekhimenko, G., Luo, Y., Mutlu, O., Gibbons, P. B., Kozuch, M. A., et al. (2013) · Proceedings of the 46th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/2540708.2540725 · Cited by 337
Memory-centric accelerator design for Convolutional Neural Networks
Peemen, M., Setio, A. A. A., Mesman, B., & Corporaal, H. (2013) · 2013 IEEE 31st International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2013.6657019 · Cited by 332
NDC: Analyzing the impact of 3D-stacked memory+logic devices on MapReduce workloads
Pugsley, S. H., Jestes, J., Zhang, H., Balasubramonian, R., Srinivasan, V., Buyuktosunoglu, A., Davis, A., & Li, F. (2014) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2014.6844483 · Cited by 299
Practical Near-Data Processing for In-Memory Analytics Frameworks
Gao, M., Ayers, G., & Kozyrakis, C. (2015) · 2015 International Conference on Parallel Architecture and Compilation (PACT) · doi:10.1109/pact.2015.22 · Cited by 266
Self-citationUnderstanding the Energy Consumption of Dynamic Random Access Memories
Vogelsang, T. (2010) · 2010 43rd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1109/micro.2010.42 · Cited by 257
HRL: Efficient and flexible reconfigurable logic for near-data processing
Gao, M., & Kozyrakis, C. (2016) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2016.7446059 · Cited by 255
Self-citationLee, D. U., Kim, K. W., Kim, K. W., Kim, H., Kim, J. Y., Park, Y. J., Kim, J. H., Kim, D. S., Park, H. B., Shin, J. W., et al. (2014) · 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC) · doi:10.1109/isscc.2014.6757501 · Cited by 253
Near-Data Processing: Insights from a MICRO-46 Workshop
Balasubramonian, R., Chang, J., Manning, T., Moreno, J. H., Murphy, R., Nair, R., & Swanson, S. (2014) · IEEE Micro · doi:10.1109/mm.2014.55 · Cited by 235
Li, S., Chen, K., Ahn, J. H., Brockman, J. B., & Jouppi, N. P. (2011) · 2011 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2011.6105405 · Cited by 212
Fast Bulk Bitwise AND and OR in DRAM
Seshadri, V., Hsieh, K., Boroumand, A., Lee, D., Kozuch, M. A., Mutlu, O., Gibbons, P. B., & Mowry, T. C. (2015) · IEEE Computer Architecture Letters · doi:10.1109/lca.2015.2434872 · Cited by 203
Li, S., Chen, K., Ahn, J. H., Brockman, J. B., & Jouppi, N. P. (2011) · International Conference on Computer Aided Design · doi:10.5555/2132325.2132479 · Cited by 147
Park, S., Bong, K., Shin, D., Lee, J., Choi, S., & Yoo, H.-J. (2015) · 2015 IEEE International Solid-State Circuits Conference - (ISSCC) Digest of Technical Papers · doi:10.1109/isscc.2015.7062935 · Cited by 108
Thermal Feasibility of Die-Stacked Processing in Memory
Eckert, Y., Jayasena, N., & Loh, G. H. (n.d.) · Cited by 86
A Systematic Approach to Blocking Convolutional Neural NetworksPreprint
Yang, X., Pu, J., Rister, B., Bhagdikar, N., Richardson, S., Kvatinsky, S., Ragan‐Kelley, J., Pedram, A., & Horowitz, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04209 · Cited by 70
Self-citationDesign space exploration for 3D-stacked DRAMs
Weis, C., Wehn, N., Loi, I., & Benini, L. (2011) · Design, Automation, and Test in Europe · doi:10.1109/date.2011.5763068 · Cited by 69
Coarse-Grained Reconfigurable Array: Architecture and Application Mapping
Choi, K. (2011) · IPSJ Transactions on System and LSI Design Methodology · doi:10.2197/ipsjtsldm.4.31 · Cited by 55
Memory access optimized routing scheme for deep networks on a mobile coprocessor
Dündar, A., Jin, J., Gokhale, V., Martini, B., & Culurciello, E. (2014) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec.2014.7040963 · Cited by 30
Research works printed but not linked: 1
- Park S., 2015, Scalable Deep Learning/Inference Processor with Tetra-Parallel MIMD Architecture for Big-Data Applications. In IEEE International Solid-State Circuits Conference (ISSCC), 1
Cited by
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks
Parashar, A., Rhu, M., Mukkara, A., Puglielli, A., Venkatesan, R., Khailany, B., Emer, J., Keckler, S. W., & Dally, W. J. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080254 · Cited by 896
Timeloop: A Systematic Approach to DNN Accelerator Evaluation
Parashar, A., Raina, P., Shao, Y. S., Chen, Y.-H., Ying, V. A., Mukkara, A., Venkatesan, R., Khailany, B., Keckler, S. W., & Emer, J. (2019) · 2019 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2019.00042 · Cited by 571
Bit Fusion: Bit-Level Dynamically Composable Architecture for Accelerating Deep Neural Network
Sharma, H., Park, J., Suda, N., Lai, L., Chau, B., Kim, J. K., Chandra, V., & Esmaeilzadeh, H. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00069 · Cited by 543
Scaling for edge inference of deep neural networks
Xu, X., Ding, Y., Hu, S. X., Niemier, M., Cong, J., Hu, Y., & Shi, Y. (2018) · Nature Electronics · doi:10.1038/s41928-018-0059-3 · Cited by 462
Metadata
- Authors
- Gao, M., Pu, J., Yang, X., Horowitz, M., & Kozyrakis, C.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems
- Publisher
- ACM
- Published
- 2017-04-04
- Pages
- 751-764
- OpenAlex
- W2605347906
- Cited by
- 507
- References
- 45
- Citations by year
- 2026: 26 · 2025: 36 · 2024: 53 · 2023: 51 · 2022: 59 · 2021: 82 · 2020: 73 · 2019: 55 · 2018: 64 · 2017: 7
- FWCI
- 28.95
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (publishedVersion)
- Funders
- National Science Foundation (SHF-1408911)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- neural network accelerators, 3D memory, energy efficiency, deep neural network, on-chip memory, off-chip memory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.