PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
The DOI matches its Crossref record; 118 of the 121 references it cites were found in a registry or an index.
Abstract
Memristor crossbars are circuits capable of performing analog matrix-vector multiplications, overcoming the fundamental energy efficiency limitations of digital logic. They have been shown to be effective in special-purpose accelerators for a limited set of neural network applications. We present the Programmable Ultra-efficient Memristor-based Accelerator (PUMA) which enhances memristor crossbars with general purpose execution units to enable the acceleration of a wide variety of Machine Learning (ML) inference workloads. PUMA's microarchitecture techniques exposed through a specialized Instruction Set Architecture (ISA) retain the efficiency of in-memory computing and analog circuitry, without compromising programmability. We also present the PUMA compiler which translates high-level code to PUMA ISA. The compiler partitions the computational graph and optimizes instruction scheduling and register allocation to generate code for large and complex workloads to run on thousands of spatial cores. We have developed a detailed architecture simulator that incorporates the functionality, timing, and power models of PUMA's components to evaluate performance and energy consumption. A PUMA accelerator running at 1 GHz can reach area and power efficiency of 577 GOPS/s/mm 2 and 837~GOPS/s/W, respectively. Our evaluation of diverse ML applications from image recognition, machine translation, and language modelling (5M-800M synapses) shows that PUMA achieves up to 2,446× energy and 66× latency improvement for inference compared to state-of-the-art GPUs. Compared to an application-specific memristor-based accelerator, PUMA incurs small energy overheads at similar inference latency and added programmability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“ADC can consume up to 70–90% of the on-chip area of the crossbar-based computation unit, including memristive crossbar and peripheral circuits, and up to 80-88% of energy55,154,155. In summary, ADCs are commonly the largest and most power-hungry circuit block in a memristive neural network55,156.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [154]
In the citing paper
“ADC can consume up to 70–90% of the on-chip area of the crossbar-based computation unit, including memristive crossbar and peripheral circuits, and up to 80-88% of energy55,154,155.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [154]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
Applied Linear Statistical Models.
Lorenz, F., Neter, J., Wasserman, W., & Kutner, M. H. (1986) · Journal of the American Statistical Association · doi:10.2307/2289108 · Cited by 5,565
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“Recurrent Neural Networks (RNNs) [75] used for sequence processing compute weighted-sums on input and previous state.”
MethodRedox‐Based Resistive Switching Memories – Nanoionic Mechanisms, Prospects, and Challenges
Waser, R., Dittmann, R., Staikov, G., & Szot, K. (2009) · Advanced Materials · doi:10.1002/adma.200900375 · Cited by 5,080 · cited 1×
“Each crosspoint in the crossbar stores a multi-bit value in one memristor device, which enables high storage density [112].”
BackgroundIn-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“[103] provide a thorough survey of deep learning accelerators.”
BackgroundResnick, P., & Varian, H. R. (1997) · Communications of the ACM · doi:10.1145/245108.245121 · Cited by 3,772
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Hilbe, J. M. (2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420075779 · Cited by 2,588
Furey, T. S., Cristianini, N., Duffy, N., Bednarski, D. W., Schummer, M., & Haussler, D. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.10.906 · Cited by 2,443
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158 · cited 2×
“In the digital realm, accelerators can be classified as weight stationary spatial architectures [15, 17, 36, 43, 85, 93], output stationary spatial architectures [33, 47, 86], spatial architectures with no local reuse [19, 20, 117], and row stationary spatial architectures [21].”
BackgroundISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Self-citationDaDianNao: A Machine-Learning Supercomputer
Chen, Y., Luo, T., Liu, S., Zhang, S., He, L., Wang, J., Li, L., Chen, T., Xu, Z., Sun, N., et al. (2014) · 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1109/micro.2014.58 · Cited by 1,492
Learning both Weights and Connections for Efficient Neural Networks
Han, S., Pool, J., Tran, J., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1506.02626 · Cited by 1,481
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · arXiv · doi:10.48550/arxiv.1502.02551 · Cited by 1,364
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
Torch7: A Matlab-like Environment for Machine Learning
Collobert, R., Kavukcuoglu, K., & Farabet, C. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,186
Eyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001177 · Cited by 1,182
Deep, Big, Simple Neural Nets for Handwritten Digit Recognition
Cireşan, D. C., Meier, U., Gambardella, L. M., & Schmidhuber, J. (2010) · Neural Computation · doi:10.1162/neco_a_00052 · Cited by 1,078
EIE: Efficient Inference Engine on Compressed Deep Neural Network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.30 · Cited by 1,077
Burr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936 · cited 1×
“To overcome this limitation, memristor crossbars can store a matrix with high storage density and perform MVM operations with very low energy and latency [5, 13, 52, 87, 98, 116].”
BackgroundShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750389 · Cited by 933
SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks
Parashar, A., Rhu, M., Mukkara, A., Puglielli, A., Venkatesan, R., Khailany, B., Emer, J., Keckler, S. W., & Dally, W. J. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080254 · Cited by 896
CACTI 6.0: A Tool to Model Large Caches
Muralimanohar, N., Balasubramonian, R., & Jouppi, N. P. (2009) · Cited by 836
PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning
Song, L., Qian, X., Li, H., & Chen, Y. (2017) · 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2017.55 · Cited by 833
Better I/O through byte-addressable, persistent memory
Condit, J., Nightingale, E. B., Frost, C., Ipek, E., Lee, B., Burger, D., & Coetzee, D. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629589 · Cited by 824
ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.12 · Cited by 775
Self-citationMemristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine
Hu, M., Graves, C. E., Li, C., Li, Y., Ge, N., Montgomery, E., Davila, N., Jiang, H., Williams, R. S., Yang, J. J., et al. (2018) · Advanced Materials · doi:10.1002/adma.201705914 · Cited by 751 · cited 3×
“result. They are integrated (converted to voltage) then converted to digital values with ADCs. 3.2.1 Precision Considerations Practically realizable crossbars provide 2-6 bits of precision per device [52]. We conservatively use 2 bits per device, and realize 16-bit MVM operations by combining 8 crossbars via bit-slici…”
BackgroundMethodInfluentialSelf-citationMnemosyne: lightweight persistent memory
Volos, H., Tack, A. J., & Swift, M. M. (2011) · Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems · doi:10.1145/1950365.1950379 · Cited by 711
Hu, M., Strachan, J. P., Li, Z., Grafals, E. M., Davila, N., Graves, C., Lam, S., Ge, N., Yang, J. J., & Williams, R. S. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898010 · Cited by 686
Self-citationAlwani, M., Chen, H., Ferdman, M., & Milder, P. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783725 · Cited by 662
NV-Heaps: making persistent objects fast and safe with next-generation, non-volatile memories
Coburn, J., Caulfield, A. M., Akel, A., Grupp, L. M., Gupta, R. K., Jhala, R., & Swanson, S. (2011) · Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems · doi:10.1145/1950365.1950380 · Cited by 646
Pattern classification by memristive crossbar circuits using ex situ and in situ training
Alibart, F., Zamanidoost, E., & Strukov, D. B. (2013) · Nature Communications · doi:10.1038/ncomms3072 · Cited by 642
Cnvlutin: ineffectual-neuron-free deep neural network computing
Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N. E., & Moshovos, A. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001138 · Cited by 614
Chi, P., Li, S., Xu, C., Zhang, T., Zhao, J., Liu, Y., Wang, Y., & Xie, Y. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.13 · Cited by 573
Eyeriss: A Spatial Architecture for Energy-Efficient Dataflow for Convolutional Neural Networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.40 · Cited by 534
The Recurrent Temporal Restricted Boltzmann Machine
Sutskever, I., Hinton, G. E., & Taylor, G. W. (2008) · neural information processing systems · Cited by 465
Minerva: enabling low-power, highly-accurate deep neural network accelerators
Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernández-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001165 · Cited by 446
TETRIS: Scalable and Efficient Neural Network Acceleration with 3D Memory
Gao, M., Pu, J., Yang, X., Horowitz, M., & Kozyrakis, C. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037702 · Cited by 421
Proceedings Of The 2003 IEEE International Symposium On Circuits And systems
(2003) · ISCAS 2003 International Symposium on Circuits and Systems · doi:10.1109/iscas.2003.1206140 · Cited by 404
CNP: An FPGA-based processor for Convolutional Networks
Farabet, C., Poulet, C., Han, J. Y., & LeCun, Y. (2009) · 2009 International Conference on Field Programmable Logic and Applications · doi:10.1109/fpl.2009.5272559 · Cited by 367 · cited 1×
“rs specialized for a particular field [14, 79, 101, 114], to accelerators that are fully programmable via an ISA [61, 71, 72, 105, 119]. FPGAs have also been popular targets for building accelerators [37, 45, 74, 86, 96, 97, 110, 117]. All these works remain in the digital domain, while PUMA leverages hybrid digital-a…”
BackgroundFrom high-level deep neural models to FPGAs
Sharma, H., Park, J., Mahajan, D., Amaro, E., Kim, J. K., Shao, C., Mishra, A., & Esmaeilzadeh, H. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783720 · Cited by 365
A dynamically configurable coprocessor for convolutional neural networks
Chakradhar, S., Sankaradas, M., Jakkula, V., & Cadambi, S. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815993 · Cited by 343
Neurocube: a programmable digital neuromorphic architecture with high-density 3D memory
Kim, D., Kung, J., Chai, S., Yalamanchili, S., & Mukhopadhyay, S. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001178 · Cited by 342
Memory-centric accelerator design for Convolutional Neural Networks
Peemen, M., Setio, A. A. A., Mesman, B., & Corporaal, H. (2013) · 2013 IEEE 31st International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2013.6657019 · Cited by 332
Serving DNNs in Real Time at Datacenter Scale with Project Brainwave
Chung, E., Fowers, J., Ovtcharov, K., Papamichael, M., Caulfield, A., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., et al. (2018) · IEEE Micro · doi:10.1109/mm.2018.022071131 · Cited by 328
DRISA: a DRAM-based Reconfigurable In-Situ Accelerator
Li, S., Niu, D., Malladi, K. T., Zheng, H., Brennan, B., & Xie, Y. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3123977 · Cited by 326
A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks
Gokhale, V., Jin, J., Dundar, A., Martini, B., & Culurciello, E. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.106 · Cited by 300
Maximizing CNN Accelerator Efficiency Through Resource Partitioning
Shen, Y., Ferdman, M., & Milder, P. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080221 · Cited by 284
MAERI: Enabling Flexible Dataflow Mapping over DNN Accelerators via Reconfigurable Interconnects
Kwon, H., Samajdar, A., & Krishna, T. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173176 · Cited by 270
YodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Andri, R., Cavigelli, L., Rossi, D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2682138 · Cited by 247
Minerva: Enabling Low-Power, Highly-Accurate Deep Neural Network Accelerators
Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernandez-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.32 · Cited by 246
NV-Tree: reducing consistency cost for NVM-based single level systems
Yang, J., Wei, Q., Chen, C., Wang, C., Yong, K. L., & He, B. (2015) · File and Storage Technologies · doi:10.5555/2750482.2750495 · Cited by 244
Cambricon: an instruction set architecture for neural networks
Liu, S., Du, Z., Tao, J., Han, D., Luo, T., Xie, Y., Chen, Y., & Chen, T. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001179 · Cited by 243
PuDianNao: A Polyvalent Machine Learning Accelerator
Liu, D., Chen, T., Liu, S., Zhou, J., Zhou, S., Teman, O., Feng, X., Zhou, X., & Chen, Y. (2015) · Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/2694344.2694358 · Cited by 240
Hardware accelerated convolutional neural networks for synthetic vision systems
Farabet, C., Martini, B., Akselrod, P., Talay, S., LeCun, Y., & Culurciello, E. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537908 · Cited by 231
Linearizability of Persistent Memory Objects Under a Full-System-Crash Failure Model
Izraelevitz, J., Mendes, H., & Scott, M. L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-662-53426-7_23 · Cited by 228
Cnvlutin: Ineffectual-Neuron-Free Deep Neural Network Computing
Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N. E., & Moshovos, A. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.11 · Cited by 226
A Massively Parallel Coprocessor for Convolutional Neural Networks
Sankaradas, M., Jakkula, V., Cadambi, S., Chakradhar, S., Durdanovic, I., Cosatto, E., & Graf, H. P. (2009) · 2009 20th IEEE International Conference on Application-specific Systems, Architectures and Processors · doi:10.1109/asap.2009.25 · Cited by 224
Binary neural network with 16 Mb RRAM macro chip for classification and online training
Yu, S., Li, Z., Chen, P.-Y., Wu, H., Gao, B., Wang, D., Wu, W., & Qian, H. (2016) · 2016 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2016.7838429 · Cited by 219
Atlas: leveraging locks for non-volatile memory consistency
Chakrabarti, D. R., Boehm, H.-J., & Bhandari, K. (2014) · Proceedings of the 2014 ACM International Conference on Object Oriented Programming Systems Languages & Applications · doi:10.1145/2660193.2660224 · Cited by 218
Bit-pragmatic deep neural network computing
Albericio, J., Delmás, A., Judd, P., Sharify, S., O'Leary, G., Genov, R., & Moshovos, A. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3123982 · Cited by 216
Cambricon: An Instruction Set Architecture for Neural Networks
Liu, S., Du, Z., Tao, J., Han, D. S., Luo, T., Xie, Y., Chen, Y., & Chen, T. (2016) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2016.42 · Cited by 207
DeepBurning: automatic generation of FPGA-based learning accelerators for the neural network family
Wang, Y., Xu, J., Han, Y., Li, H., & Li, X. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898003 · Cited by 205
Bojnordi, M. N., & Ipek, E. (2016) · 2016 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2016.7446049 · Cited by 205
Sengupta, A., Shim, Y., & Roy, K. (2016) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2016.2525823 · Cited by 198
Self-citationGuo, X., Bayat, F. M., Bavandpour, M., Klachko, M., Mahmoodi, M. R., Prezioso, M., Likharev, K. K., & Strukov, D. B. (2017) · 2017 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2017.8268341 · Cited by 192
ScaleDeep: A Scalable Compute Architecture for Learning and Evaluating Deep Networks
Venkataramani, S., Ranjan, A., Banerjee, S., Das, D., Avancha, S., Jagannathan, A., Durg, A., Nagaraj, D., Kaul, B., Dubey, P., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080244 · Cited by 188
Dynamic energy-accuracy trade-off using stochastic computing in deep neural networks
Kim, K., Kim, J., Yu, J., Seo, J., Lee, J., & Choi, K. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898011 · Cited by 188
Hardware realization of BSB recall function using memristor crossbar arrays
Hu, M., Li, H., Wu, Q., & Rose, G. S. (2012) · Proceedings of the 49th Annual Design Automation Conference · doi:10.1145/2228360.2228448 · Cited by 187
RENO: a high-efficient reconfigurable neuromorphic computing accelerator design
Liu, X., Mao, M., Liu, B., Li, H. H., Chen, Y., Li, B., Wang, Y., Jiang, H., Barnell, M. D., Wu, Q., et al. (2015) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/2744769.2744900 · Cited by 181
Origami: A Convolutional Network Accelerator
Cavigelli, L., Gschwend, D., Mayer, C., Willi, S., Muheim, B., & Benini, L. (2015) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/2742060.2743766 · Cited by 180
C ir CNN: accelerating and compressing deep neural networks using block-circulant weight matrices
Ding, C., Liao, S., Wang, Y., Li, Z., Liu, N., Zhuo, Y., Wang, C., Qian, X., Bai, Y., Yuan, G., et al. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3124552 · Cited by 176
Neurocube: A Programmable Digital Neuromorphic Architecture with High-Density 3D Memory
Kim, D., Kung, J., Chai, S., Yalamanchili, S., & Mukhopadhyay, S. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.41 · Cited by 171
The Race for the Extra Decibel: A Brief Review of Current ADC Performance Trajectories
Murmann, B. (2015) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2015.2442393 · Cited by 168
An Analysis of Persistent Memory Use with WHISPER
Nalli, S., Haria, S., Hill, M. D., Swift, M. M., Volos, H., & Keeton, K. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037730 · Cited by 158
TABLA: A unified template-based framework for accelerating statistical machine learning
Mahajan, D., Park, J., Amaro, E., Sharma, H., Yazdanbakhsh, A., Kim, J. K., & Esmaeilzadeh, H. (2016) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2016.7446050 · Cited by 157
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing
Ren, A., Li, Z., Ding, C., Qiu, Q., Wang, Y., Li, J., Qian, X., & Yuan, B. (2017) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3037697.3037746 · Cited by 156
Mean-field theory of Boltzmann machine learning
Tanaka, T. (1998) · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · doi:10.1103/physreve.58.2302 · Cited by 150
A machine-learning classifier implemented in a standard 6T SRAM array
Zhang, J., Wang, Z., & Verma, N. (2016) · Symposium on VLSI Circuits · doi:10.1109/vlsic.2016.7573556 · Cited by 149
TIME: A Training-in-memory Architecture for Memristor-based Deep Neural Networks
Cheng, M., Xia, L., Zhu, Z., Cai, Y., Xie, Y., Wang, Y., & Yang, H. (2017) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3061639.3062326 · Cited by 136
Making Memristive Neural Network Accelerators Reliable
Feinberg, B., Wang, S., & İpek, E. (2018) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00015 · Cited by 135
Park, S., Bong, K., Shin, D., Lee, J., Choi, S., & Yoo, H. (2015) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2015.7062935 · Cited by 127
Makalu: fast recoverable allocation of non-volatile memory
Bhandari, K., Chakrabarti, D. R., & Boehm, H. (2016) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2983990.2984019 · Cited by 120
Ankit, A., Sengupta, A., Panda, P., & Roy, K. (2017) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3061639.3062311 · Cited by 118
Self-citationProteus: a flexible and fast software supported hardware logging approach for NVM
Shin, S., Tirukkovalluri, S. K., Tuck, J. M., & Solihin, Y. (2017) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3123939.3124539 · Cited by 118
ATOM: Atomic Durability in Non-volatile Memory through Hardware Logging
Joshi, A., Nagarajan, V., Viglas, S. D., & Cintra, M. S. (2017) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2017.50 · Cited by 115
In-Memory Data Parallel Processor
Fujiki, D., Mahlke, S., & Das, R. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173171 · Cited by 109 · cited 1×
“[40] propose an ISA-programmable memristorbased accelerator.”
Highly reliable TaOx ReRAM with centralized filament for 28-nm embedded application
Hayakawa, Y., Himeno, A., Yasuhara, R., Boullart, W., Vecchio, E., Vandeweyer, T., Witters, T., Crotti, D., Jurczak, M., Fujii, S., et al. (2015) · Symposium on VLSI Technology · doi:10.1109/vlsit.2015.7223684 · Cited by 91
Steal but No Force: Efficient Hardware Undo+Redo Logging for Persistent Memory Systems
Ogleari, M., Miller, E. L., & Zhao, J. (2018) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00037 · Cited by 89
Kim, Y., Zhang, Y., & Li, P. (2015) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/2700234 · Cited by 88
Ramasubramanian, S. G., Venkatesan, R., Sharad, M., Roy, K., & Raghunathan, A. (2014) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/2627369.2627625 · Cited by 86
Self-citationVIBNN: Hardware Acceleration of Bayesian Neural Networks
Cai, R., Ren, A., Liu, N., Ding, C., Wang, L., Qian, X., Pedram, M., & Wang, Y. (2018) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3173162.3173212 · Cited by 83
Memory management techniques for large-scale persistent-main-memory systems
Oukid, I., Booss, D., Lespinasse, A., Lehner, W., Willhalm, T., & Gomes, G. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137628.3137629 · Cited by 80
The microarchitecture of a real-time robot motion planning accelerator
Murray, S. N., Floyd-Jones, W., Ying, Q., Konidaris, G., & Sorin, D. J. (2016) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783748 · Cited by 79
Bridge the Gap between Neural Networks and Neuromorphic Hardware with a Neural Network Compiler
Ji, Y., Zhang, Y., Chen, W., & Xie, Y. (2018) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3173162.3173205 · Cited by 65
Towards Efficient Microarchitectural Design for Accelerating Unsupervised GAN-Based Deep Learning
Song, M., Zhang, J., Chen, H., & Li, T. (2018) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00016 · Cited by 62
NEUTRAMS: neural network transformation and co-design under neuromorphic hardware constraints
Ji, Y., Zhang, Y., Li, S., Chi, P., Jiang, C., Qu, P., Xie, Y., & Chen, W. (2016) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.5555/3195638.3195663 · Cited by 57
Revisiting Hash Table Design for Phase Change Memory
Debnath, B. K., Haghdoost, A. A., Kadav, A., Khatib, M. G., & Ungureanu, C. (2016) · ACM SIGOPS Operating Systems Review · doi:10.1145/2883591.2883597 · Cited by 53
An ultra low-power hardware accelerator for automatic speech recognition
Yazdani, R., Segura, A., Arnau, J.-M., & González, A. M. (2016) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783750 · Cited by 49
Hardware-Software Co-Design for an Analog-Digital Accelerator for Machine Learning
Ambrosi, J., Ankit, A., Antunes, R., Chalamalasetti, S. R., Chatterjee, S., Hajj, I. E., Fachini, G. J. D. A., Faraboschi, P., Foltín, M., Huang, S., et al. (2018) · IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2018.8638612 · Cited by 47
Self-citationTraNNsformer: Neural network transformation for memristive crossbar based neuromorphic system design
Ankit, A., Sengupta, A., & Roy, K. (2017) · International Conference on Computer Aided Design · doi:10.1109/iccad.2017.8203823 · Cited by 41
Self-citationObject-oriented recovery for non-volatile memory
Cohen, N., Aksun, D. T., & Larus, J. R. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276523 · Cited by 39
Group Scissor: Scaling Neuromorphic Computing Design to Large Neural Networks
Wang, Y., Wen, W., Liu, B., Chiarulli, D. M., & Li, H. H. (2017) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3061639.3062256 · Cited by 37
Fault- Tolerant Dot-Product Engines
Roth, R. M. (2018) · IEEE Transactions on Information Theory · doi:10.1109/isit.2018.8437919 · Cited by 37
Wang, Y., Li, H., & Li, X. (2017) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3061639.3062307 · Cited by 36
Simplifying deep neural networks for neuromorphic architectures
Chung, J., & Shin, T. (2016) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/2897937.2898092 · Cited by 34
SpaceJMP: Programming with Multiple Virtual Address Spaces
Hajj, I. E., Merritt, A. M., Zellweger, G., Milojicic, D. S., Achermann, R., Faraboschi, P., Hwu, W., Roscoe, T., & Schwan, K. (2016) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2872362.2872366 · Cited by 33
Self-citationEfficient support of position independence on non-volatile memory
Chen, G., Zhang, L., Budhiraja, R., Shen, X., & Wu, Y. (2017) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3123939.3124543 · Cited by 32
TraNNsformer: Neural Network Transformation for memristive crossbar based neuromorphic system designPreprint
Ankit, A., Sengupta, A., & Roy, K. (2017) · arXiv (Cornell University) · doi:10.5555/3199700.3199771 · Cited by 27
Self-citationNeuromorphic Processors with Memristive Synapses
Wang, Q., Kim, Y., & Li, P. (2016) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/2894756 · Cited by 27
Area Efficient ROM-Embedded SRAM Cache
Lee, D., & Roy, K. (2012) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2012.2217514 · Cited by 24
Self-citationWang, Z., Schapire, R. E., & Verma, N. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854329 · Cited by 20
SAVI objects: sharing and virtuality incorporated
Hajj, I. E., Jablin, T. B., Milojicic, D. S., & Hwu, W. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133869 · Cited by 13
Self-citation
Research works printed but not linked: 16
- Alan Agresti. 2002. Logistic regression .Wiley Online Library.
- 10.5555/3195638.3195664 · doi:10.5555/3195638.3195664
- B. Feinberg, S. Wang, and E. Ipek. 2018b. Making Memristive Neural Network Accelerators Reliable. In 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) .
- Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680. · doi:10.5555/2969033.2969125
- Kaiyuan Guo, Shulin Zeng, Jincheng Yu, Yu Wang, and Huazhong Yang. 2017b. A Survey of FPGA Based Neural Network Accelerator. arXiv preprint arXiv:1712.08934 (2017). · arXiv
- 10.5555/3045118.3045303 · doi:10.5555/3045118.3045303
- 10.1145/3173162.3173205 · DOI
- Nan Jiang, George Michelogiannakis, Daniel Becker, Brian Towles, and William J. Dally. 2013. BookSim 2.0 User's Guide .
- 10.5555/3195638.3195661 · doi:10.5555/3195638.3195661
- 10.5555/3195638.3195693 · doi:10.5555/3195638.3195693
- redo logging for persistent memory systems. In High Performance Computer Architecture (HPCA), 2018 IEEE International Symposium on. IEEE, 336--349.
- 10.5555/3195638.3195659 · doi:10.5555/3195638.3195659
- Patrick M Sheridan, Fuxi Cai, Chao Du, Wen Ma, Zhengya Zhang, and Wei D Lu. 2017. Sparse coding with memristor networks. Nature nanotechnology (2017).
- 10.5555/3195638.3195696 · doi:10.5555/3195638.3195696
- Richard Yu. 2017. Panasonic and UMC Partner for 40nm ReRAM Process Platform. UMC Press Release (Feb 2017).
- 10.5555/3195638.3195662 · doi:10.5555/3195638.3195662
Cited by
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
“Besides the MVM operation, some other operations such as scalar and vector operations should be additionally supported by PEs since they are necessary for some neural network models such as RNNs but cannot be handled by the memristor array efficiently [258].”
MethodInfluentialA compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Neuro-inspired computing chips
Zhang, W., Gao, B., Tang, J., Yao, P., Yu, S., Chang, M.-F., Yoo, H.-J., Qian, H., & Wu, H. (2020) · Nature Electronics · doi:10.1038/s41928-020-0435-7 · Cited by 892
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“Moreover, ADC can consume up to 70 – 90% of the on-chip area of the crossbar-based computation unit, including memristive crossbar and peripheral circuits, and up to 80-88% of energy 55,154,155 .”
Metadata
- Authors
- Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., & Milojicic, D. S.
- Affiliations
- Purdue University West Lafayette (US)
- University of Illinois Urbana-Champaign (US)
- Hewlett Packard Enterprise (United States) (US)
- Hewlett-Packard (United Kingdom) (GB)
- Hewlett Packard Enterprise, Fort Collins, CO, USA
- ORCID
- Venue
- Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems
- Publisher
- ACM
- Published
- 2019-04-04
- Pages
- 715-731
- OpenAlex
- W2913104037
- Cited by
- 424
- References
- 121
- Citations by year
- 2026: 32 · 2025: 67 · 2024: 49 · 2023: 64 · 2022: 68 · 2021: 65 · 2020: 60 · 2019: 16
- FWCI
- 83.15
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (publishedVersion)
- Funders
- U.S. Department of Energy (DE-SC0012199)
- Intelligence Advanced Research Projects Activity (2017-1701300000)
- Center for Brain-inspired Computing (C-BRIC), one of six centers in JUMP, a DARPA sponsored Semiconductor Research Corporation (SRC) program
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- memristor crossbar, in-memory computing, instruction set architecture, instruction scheduling, register allocation, energy efficiency, image recognition, machine translation, language modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.