A 64-Tile 2.4-Mb In-Memory-Computing CNN Accelerator Employing Charge-Domain Compute
The DOI matches its Crossref record; 54 of the 61 references it cites were found in a registry or an index.
Abstract
Large-scale matrix-vector multiplications, which dominate in deep neural networks (DNNs), are limited by data movement in modern VLSI technologies. This paper addresses data movement via an in-memory-computing accelerator that employs charged-domain mixed-signal operation for enhancing compute SNR and, thus, scalability. The architecture supports analog/binary input activation (IA)/weight first layer (FL) and binary/binary IA/weight hidden layers (HLs), with batch normalization and input-output (IO) (buffering) circuitry to enable cascading, if desired, for realizing different DNN layers. The architecture is arranged as 8 × 8 = 64 in-memory-computing neuron tiles, supporting up to 512, 3 × 3 × 512-input HL neurons and 64, 3 × 3 × 3-input FL neurons, configurable via tile-level clock gating. In-memory computing is achieved using an 8T bit cell with overlaying metal-oxide-metal (MOM) capacitor, yielding a structure having 1.8 × the area of a standard 6T bit cell. Implemented in 65-nm CMOS, the design achieves HLs/FL energy efficiency of 866/1.25 TOPS/W and throughput of 18876/43.2 GOPS (1498/3.43 GOPS/mm2), when implementing convolution layers; and 658/0.95 TOPS/W, 9438/10.47 GOPS (749/0.83 GOPS/mm2), when implementing convolution followed by batch normalization layers. Several large-scale neural networks are demonstrated, showing performance on standard benchmarks (MNIST, CIFAR-10, and SVHN) equivalent to ideal digital computing.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Among charge-based memories, SRAM cells (a bi-stable transistor structure typically made of two CMOS inverters connected back-to-back which retains a charge concentration, see Fig. 3a for an example of the structure of a crossbar array of 6T SRAM) have been widely used for VMM75–77.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [77]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 1×
“17), where, for each [57], Bankman et al. [18], and Moons et al. [54] that are fabricated in 28-nm CMOS, and Bang et al. [55] implemented in 40-nm CMOS.”
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“See http://www.ieee.org/publications_standards/publications/rights/index.html for more information. proposed [12], [15]–[17], [21]–[41].”
BackgroundISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning
Song, L., Qian, X., Li, H., & Chen, Y. (2017) · 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2017.55 · Cited by 833
Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning
Yang, T.-J., Chen, Y.-H., & Sze, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.643 · Cited by 732
All-MOS charge-redistribution analog-to-digital conversion techniques. II
Suarez, R. E., Gray, P. R., & Hodges, D. A. (1975) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.1975.1050630 · Cited by 655
Mixed-precision in-memory computing
Le Gallo, M., Sebastian, A., Mathis, R., Manica, M., Giefers, H., Tuma, T., Bekas, C., Curioni, A., & Eleftheriou, E. (2018) · Nature Electronics · doi:10.1038/s41928-018-0054-8 · Cited by 485 · cited 2×
“Rather than accessing raw data row by row in each column, as done in conventional memory, the objective is to access a computational result in each column over many rows of data , thereby amortizing the bit-line discharge energy and delay [16], [17], [22], [25]–[27], [31], [42].”
BackgroundMethodMoons, B., Uytterhoeven, R., Dehaene, W., & Verhelst, M. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870353 · Cited by 479
Ambit: in-memory accelerator for bulk bitwise operations using commodity DRAM technology
Seshadri, V., Lee, D., Mullins, T., Hassan, H., Boroumand, A., Kim, J., Kozuch, M. A., Mutlu, O., Gibbons, P. B., & Mowry, T. C. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3124544 · Cited by 434
Kobayashi, T., Nogami, K., Shirotori, T., & Fujimoto, Y. (1993) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.210039 · Cited by 348
Biswas, A., & Chandrakasan, A. P. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310397 · Cited by 337
Chen, W.-H., Li, K.-X., Lin, W.-Y., Hsu, K.-H., Li, P.-Y., Yang, C.-H., Xue, C.-X., Yang, E.-Y., Chen, Y.-K., Chang, Y.-S., et al. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310400 · Cited by 333
Memory-centric accelerator design for Convolutional Neural Networks
Peemen, M., Setio, A. A. A., Mesman, B., & Corporaal, H. (2013) · 2013 IEEE 31st International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2013.6657019 · Cited by 332
Lee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310262 · Cited by 303
ShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · ACM SIGARCH Computer Architecture News · doi:10.1145/2872887.2750389 · Cited by 290
Khwa, W.-S., Chen, J.-J., Li, J.-F., Si, X., Yang, E.-Y., Sun, X., Liu, R., Chen, P.-Y., Li, Q., Yu, S., et al. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310401 · Cited by 260 · cited 2×
“lines [16], [17], [22], [25]–[27], [31], [42].”
BackgroundA Multi-Functional In-Memory Inference Processor Using a Standard 6T SRAM Array
Kang, M., Gonugondla, S. K., Patil, A., & Shanbhag, N. R. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2782087 · Cited by 224
Neuromorphic speech systems using advanced ReRAM-based synapse
Park, S., Sheri, A., Kim, J., Noh, J., Jang, J., Jeon, M., Lee, B., Lee, B. R., Lee, B. H., & Hwang, H. (2013) · 2013 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2013.6724692 · Cited by 201
A method to estimate the energy consumption of deep neural networks
Yang, T.-J., Chen, Y.-H., Emer, J., & Sze, V. (2017) · 2017 51st Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.2017.8335698 · Cited by 196
A 42pJ/decision 3.12TOPS/W robust in-memory machine learning classifier with on-chip training
Gonugondla, S. K., Kang, M., & Shanbhag, N. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310398 · Cited by 195
Using Dataflow to Optimize Energy Efficiency of Deep Neural Network Accelerators
Chen, Y., Emer, J., & Sze, V. (2017) · IEEE Micro · doi:10.1109/mm.2017.54 · Cited by 171
Ando, K., Ueyoshi, K., Orimo, K., Yonekawa, H., Sato, S., Nakahara, H., Takamaeda-Yamazaki, S., Ikebe, M., Asai, T., Kuroda, T., et al. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2778702 · Cited by 160
Bong, K., Choi, S., Kim, C., Kang, S., Kim, Y., & Yoo, H. (2017) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2017.7870354 · Cited by 150
Valavi, H., Ramadge, P. J., Nestler, E., & Verma, N. (2018) · 2018 IEEE Symposium on VLSI Circuits · doi:10.1109/vlsic.2018.8502421 · Cited by 150
Self-citationA machine-learning classifier implemented in a standard 6T SRAM array
Zhang, J., Wang, Z., & Verma, N. (2016) · Symposium on VLSI Circuits · doi:10.1109/vlsic.2016.7573556 · Cited by 149
Self-citationWu, T. F., Li, H., Huang, P.-C., Rahimi, A., Rabaey, J. M., Wong, H. ‐. P., Shulaker, M. M., & Mitra, S. (2018) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2018.8310399 · Cited by 135
XNOR-SRAM: In-Memory Computing SRAM Macro for Binary/Ternary Deep Neural Networks
Jiang, Z., Yin, S., Seok, M., & Seo, J.-S. (2018) · 2018 IEEE Symposium on VLSI Technology · doi:10.1109/vlsit.2018.8510687 · Cited by 133
Zhang, Y., Xu, L., Dong, Q., Wang, J., Blaauw, D. T., & Sylvester, D. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2776302 · Cited by 125
GFlink: An In-Memory Computing Architecture on Heterogeneous CPU-GPU Clusters for Big Data
Chen, C., Li, K., Ouyang, A., Zeng, Z., & Li, K. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2794343 · Cited by 111
ZeNA: Zero-Aware Neural Network Accelerator
Kim, D., Ahn, J., & Yoo, S. (2017) · IEEE Design and Test · doi:10.1109/mdat.2017.2741463 · Cited by 110
Hardware for machine learning: Challenges and opportunities
Sze, V., Chen, Y., Emer, J., Suleiman, A., & Zhang, Z. (2018) · Custom Integrated Circuits Conference · doi:10.1109/cicc.2018.8357072 · Cited by 105
Wang, Z., Li, Y., Su, Y., Zhou, Y., Cheng, L., Chang, T., Xue, K., Sze, S. M., & Miao, X. (2018) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2018.2866048 · Cited by 88
A 0.3V VDDmin 4+2T SRAM for searching and in-memory computing using 55nm DDC technology
Dong, Q., Jeloka, S., Saligane, M., Kim, Y., Kawaminami, M., Harada, A., Miyoshi, S., Blaauw, D. T., & Sylvester, D. (2017) · Symposium on VLSI Circuits · doi:10.23919/vlsic.2017.8008465 · Cited by 79
An Energy-Efficient Digital ReRAM-Crossbar-Based CNN With Bitwise Parallelism
Ni, L., Liu, Z., Yu, H., & Joshi, R. V. (2017) · IEEE Journal on Exploratory Solid-State Computational Devices and Circuits · doi:10.1109/jxcdc.2017.2697910 · Cited by 74
Mismatch Characterization of Small Metal Fringe Capacitors
Tripathi, V., & Murmann, B. (2014) · IEEE Transactions on Circuits and Systems I: Regular Papers · doi:10.1109/tcsi.2014.2332264 · Cited by 71
Designing Hardware for Machine Learning: The Important Role Played by Circuit Designers
Sze, V. (2017) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2017.2745798 · Cited by 64
Eyeriss v2: A Flexible and High-Performance Accelerator for Emerging Deep Neural NetworksPreprint
Chen, Y., Emer, J., & Sze, V. (2018) · arXiv (Cornell University) · Cited by 63
Matching Properties of Femtofarad and Sub-Femtofarad MOM Capacitors
Omran, H. A., Alahmadi, H., & Salama, K. N. (2016) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2016.2537824 · Cited by 61
A 9.02mW CNN-stereo-based real-time 3D hand-gesture recognition processor for smart mobile devices
Choi, S., Lee, J., Lee, K. J., & Yoo, H. (2018) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2018.8310263 · Cited by 58
Distributed In-Memory Computing on Binary RRAM Crossbar
Ni, L., Huang, H., Liu, Z., Joshi, R., & Yu, H. (2017) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/2996192 · Cited by 48
Su, F., Chen, W.-H., Xia, L., Lo, C.-P., Tang, T., Wang, Z., Hsu, K.-H., Cheng, M., Li, J., Xie, Y., et al. (2017) · Symposium on VLSI Circuits · doi:10.23919/vlsic.2017.8008585 · Cited by 45
Recryptor: A reconfigurable in-memory cryptographic Cortex-M0 processor for IoT
Zhang, Y., Xu, L., Yang, K., Dong, Q., Jeloka, S., Blaauw, D. T., & Sylvester, D. (2017) · Symposium on VLSI Circuits · doi:10.23919/vlsic.2017.8008501 · Cited by 31
Low power in-memory computing based on dual-mode SOT-MRAM
Parveen, F., Angizi, S., He, Z., & Fan, D. (2017) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2017.8009200 · Cited by 28
Enabling in-memory computation of binary BLAS using ReRAM crossbar arrays
Bhattacharjee, D., Merchant, F., & Chattopadhyay, A. (2016) · IFIP/IEEE International Conference on Very Large Scale Integration · doi:10.1109/vlsi-soc.2016.7753568 · Cited by 15
In-memory area-efficient signal streaming processor design for binary neural networks
Yonekawa, H., Sato, S., Nakahara, H., Ando, K., Ueyoshi, K., Hirose, K., Orimo, K., Takamaeda-Yamazaki, S., Ikebe, M., Asai, T., et al. (2017) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2017.8052874 · Cited by 6
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
Hubara, I., Courbariaux, M., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1609.07061
Research works printed but not linked: 4
- jia, 2018, A microprocessor implemented in 65nm CMOS with configurable and bit-scalable accelerator for programmable in-memory computing
- bang, 2017, A $288\mu\text{W}$ programmable deep-learning processor with 270kB on-chip weight storage using non-uniform memory hierarchy for mobile intelligence, IEEE ISSCC Dig Tech Papers, 250
- bankman, 2018, An always-on $3.8~\mu\text{J}$ /86% CIFAR-10 mixed-signal binary CNN processor with all memory on chip in 28-nm CMOS, IEEE ISSCC Dig Tech Papers, 222
- horowitz, 2014, Computing’s energy problem (and what we can do about it), IEEE ISSCC Dig Tech Papers, 10
Cited by
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“The proposed circuit comprises 4 kb synapses fabricated in a 65 nm CMOS processand reported anenergy ef fi ciencyof 55.8 TOPS per W. Incases where x is non-binary, one approach is to employ capacitors in addition to the SRAM cells 76,77,79 , involving a three-step process.”
InfluentialIn-Memory Computing: Advances and Prospects
Verma, N., Jia, H., Valavi, H., Tang, Y., Ozatay, M., Chen, L.-Y., Zhang, B., & Deaville, P. (2019) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2019.2922889 · Cited by 473
Self-citationC3SRAM: An In-Memory-Computing SRAM Macro Based on Robust Capacitive Coupling Computing Mechanism
Jiang, Z., Yin, S., Seo, J.-S., & Seok, M. (2020) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2020.2992886 · Cited by 324
Breaking the von Neumann bottleneck: architecture-level processing-in-memory technology
Zou, X., Xu, S., Chen, X., Yan, L., & Han, Y. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3227-1 · Cited by 311
Metadata
- Authors
- Valavi, H., Ramadge, P. J., Nestler, E., & Verma, N.
- Affiliations
- Princeton University (US)
- Analog Devices (United States) (US)
- Venue
- IEEE Journal of Solid-State Circuits
- Published
- 2019-06
- Volume
- 54
- Issue
- 6
- Pages
- 1789-1799
- ISSN
- 0018-9200 (ISSN-L)
- 1558-173X
- OpenAlex
- W2920326572
- Cited by
- 328
- References
- 61
- Citations by year
- 2026: 29 · 2025: 49 · 2024: 47 · 2023: 58 · 2022: 52 · 2021: 51 · 2020: 32 · 2019: 9
- FWCI
- 12.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Journal of Solid-State Circuits (publishedVersion)
- Funders
- Analog Devices
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Analog and Mixed-Signal Circuit Design
- Keywords
- in-memory computing, CNN accelerator, matrix-vector multiplication, data movement reduction, metal-oxide-metal capacitors, binary neural networks, batch normalization, energy efficiency, 65 nm CMOS, convolutional layers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.