Fully On-Chip MAC at 14 nm Enabled by Accurate Row-Wise Programming of PCM-Based Weights and Parallel Vector-Transport in Duration-Format
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Hardware acceleration of deep learning using analog non-volatile memory (NVM) requires large arrays with high device yield, high accuracy Multiply-ACcumulate (MAC) operations, and routing frameworks for implementing arbitrary deep neural network (DNN) topologies. In this article, we present a 14-nm test-chip for Analog AI inference—it contains multiple arrays of phase change memory (PCM)-devices, each array capable of storing 512$\times $512 unique DNN weights and executing massively parallel MAC operations at the location of the data. DNN excitations are transported across the chip using a duration representation on a parallel and reconfigurable 2-D mesh. To accurately transfer inference models to the chip, we describe a closed-loop tuning (CLT) algorithm that programs the four PCM conductances in each weight, achieving <3% average weight-error. A row-wise programming scheme and associated circuitry allow us to execute CLT on up to 512 weights concurrently. We show that the test chip can achieve near-software-equivalent accuracy on two different DNNs. We demonstrate tile-to-tile transport with a fully-on-chip two-layer network for MNIST (accuracy degradation ~0.6%) and show resilience to error propagation across long sequences (up to 10 000 characters) with a recurrent long short-term memory (LSTM) network, implementing off-chip activation and vector-vector operations to generate recurrent inputs used in the next on- chip MAC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The most advanced studies in this field have reported fully integrated memristor-based compute-in-memory systems48,53–55,58,59,61,71–73, but a systematic description of essential details on the device structure or circuit architecture are generally lacking in these reports.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [72]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These techniques can be more generally applied to other non-volatile resistive memory technologies such as phase-change memory8,17,21,23,24, magnetoresistive RAM48 and ferroelectric field-effect transistors49.”
From A compute-in-memory chip based on resistive random-access memory (2022) · cites this paper as [17]
The cited source says what the claim attributes to it.
In the citing paper
“Analog in-memory computing (analog-AI)3–7 can provide better energy efficiency by performing matrix–vector multiplications in parallel on ‘memory tiles’.”
From An analog-AI chip for energy-efficient speech recognition and transcription (2023) · cites this paper as [4]
The cited source says what the claim attributes to it.
In the citing paper
“Analog-AI HW avoids these inefficiencies by leveraging arrays of non-volatile memory (NVM) to perform the ‘multiply and accumulate computation’ (MAC) operations which dominate these workloads directly in the memory3–7.”
From An analog-AI chip for energy-efficient speech recognition and transcription (2023) · cites this paper as [4]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“the NeuRRAM chip achieves 1.6-times to 2.3-times lower EDP and 7-times to 13-times higher computational density (measured by throughput per million of RRAMs) at various MVM input and output bit-precisions than previous state-of-the-art RRAM-based CIM chips, despite being fabricated at an older technology node17–27,36.”
From A compute-in-memory chip based on resistive random-access memory (2022) · cites this paper as [17]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319 · cited 1×
“D EEP learning algorithms have revolutionized several machine learning disciplines over the last decade, notably in the areas of image recognition [1], speech recognition [2], language translation [3], etc.”
BackgroundIn-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 2×
“As an example, several ASICs and FPGA solutions based on existing digital scaled CMOS technologies have been proposed and/or manufactured in the last few years [5]–[9].”
MethodFully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Hitting the memory wall: implications of the obvious
Wulf, W. A., & McKee, S. A. (1995) · ACM SIGARCH Computer Architecture News · doi:10.1145/216585.216588 · Cited by 1,624
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
Eyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001177 · Cited by 1,182
Equivalent-accuracy accelerated neural-network training using analogue memory
Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R. M., Boybat, I., di Nolfo, C., Sidler, S., Giordano, M., Bodini, M., Farinha, N. C. P., et al. (2018) · Nature · doi:10.1038/s41586-018-0180-5 · Cited by 1,151
Self-citationNeuromorphic computing with multi-memristive synapses
Boybat, I., Le Gallo, M., Nandakumar, S. R., Moraitis, T., Parnell, T., Tuma, T., Rajendran, B., Leblebici, Y., Sebastian, A., & Eleftheriou, E. (2018) · Nature Communications · doi:10.1038/s41467-018-04933-y · Cited by 899
A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations
Cai, F., Correll, J. M., Lee, S. H., Lim, Y., Bothra, V., Zhang, Z., Flynn, M. P., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0270-x · Cited by 728
A Configurable Cloud-Scale DNN Processor for Real-Time AI
Fowers, J., Ovtcharov, K., Papamichael, M., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., Adams, L., Ghandi, M., et al. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00012 · Cited by 520
Accurate deep neural network inference using computational phase-change memory
Joshi, V., Le Gallo, M., Haefeli, S., Boybat, I., Nandakumar, S. R., Piveteau, C., Dazzi, M., Rajendran, B., Sebastian, A., & Eleftheriou, E. (2020) · Nature Communications · doi:10.1038/s41467-020-16108-9 · Cited by 490 · cited 1×
“Drift mitigation will need a multi-pronged approach across device engineering [22], programming procedure, circuit slope correction [23] as well as algorithms, including drift-aware training approaches– [17], [24], [25].”
BackgroundDeep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developments
Zhang, Z., Geiger, J., Pohjalainen, J., Mousa, A. E.-D., Jin, W., & Schuller, B. (2018) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3178115 · Cited by 313
Recent progress in analog memory-based accelerators for deep learning
Tsai, H., Ambrogio, S., Narayanan, P., Shelby, R. M., & Burr, G. W. (2018) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aac8a5 · Cited by 225
Self-citation15.1 A Programmable Neural-Network Inference Accelerator Based on Scalable In-Memory Computing
Jia, H., Ozatay, M., Tang, Y., Valavi, H., Pathak, R., Lee, J., & Verma, N. (2021) · 2021 IEEE International Solid- State Circuits Conference (ISSCC) · doi:10.1109/isscc42613.2021.9365788 · Cited by 168
Design of Reliable DNN Accelerator with Un-reliable ReRAM
Long, Y., She, X., & Mukhopadhyay, S. (2019) · 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2019.8715178 · Cited by 136
A Scalable Multi- TeraOPS Deep Learning Processor Core for AI Trainina and Inference
Fleischer, B., Shukla, S., Ziegler, M., Silberman, J., Oh, J., Srinivasan, V., Choi, J., Mueller, S., Agrawal, A., Babinsky, T., et al. (2018) · 2018 IEEE Symposium on VLSI Circuits · doi:10.1109/vlsic.2018.8502276 · Cited by 100
Yan, B., Yang, Q., Chen, W.-H., Chang, K.-T., Su, J.-W., Hsu, C.-H., Li, S.-H., Lee, H.-Y., Sheu, S.-S., Ho, M.-S., et al. (2019) · 2019 Symposium on VLSI Technology · doi:10.23919/vlsit.2019.8776485 · Cited by 84
Ambrogio, S., Gallot, M., Spoon, K., Tsai, H., Mackin, C., Wesson, M., Kariyappa, S., Narayanan, P., Liu, C.-C., Kumar, A., et al. (2019) · 2019 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm19573.2019.8993482 · Cited by 76 · cited 1×
“Drift mitigation will need a multi-pronged approach across device engineering [22], programming procedure, circuit slope correction [23] as well as algorithms, including drift-aware training approaches– [17], [24], [25].”
BackgroundSelf-citationLavizzari, S., Ielmini, D., Sharma, D., & Lacaita, A. L. (2009) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2009.2016398 · Cited by 74
Resistance drift in phase change memory
Li, J., Luan, B., & Lam, C. H. (2012) · IEEE International Reliability Physics Symposium proceedings · doi:10.1109/irps.2012.6241871 · Cited by 60
Noise-Resilient DNN: Tolerating Noise in PCM-Based AI Accelerators via Noise-Aware Training
Kariyappa, S., Tsai, H., Spoon, K., Ambrogio, S., Narayanan, P., Mackin, C., Chen, A., Qureshi, M., & Burr, G. W. (2021) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2021.3089987 · Cited by 45 · cited 1×
“Drift mitigation will need a multi-pronged approach across device engineering [22], programming procedure, circuit slope correction [23] as well as algorithms, including drift-aware training approaches– [17], [24], [25].”
BackgroundSelf-citationSpoon, K., Tsai, H., Chen, A., Rasch, M. J., Ambrogio, S., Mackin, C., Fasoli, A., Friz, A. M., Narayanan, P., Stanisavljevic, M., et al. (2021) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2021.675741 · Cited by 26
Self-citationBruce, R. L., Sarwat, S. G., Boybat, I., Cheng, C.-W., Kim, W., Nandakumar, S. R., Mackin, C., Philip, T., Liu, Z., Brew, K., et al. (2021) · 2021 IEEE International Reliability Physics Symposium (IRPS) · doi:10.1109/irps46558.2021.9405191 · Cited by 23 · cited 1×
“Drift mitigation will need a multi-pronged approach across device engineering [22], programming procedure, circuit slope correction [23] as well as algorithms, including drift-aware training approaches– [17], [24], [25].”
BackgroundSelf-citation
Cited by
A compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Deep physical neural networks trained with backpropagation
Wright, L. G., Onodera, T., Stein, M. M., Wang, T., Schachter, D. T., Hu, Z., & McMahon, P. L. (2022) · Nature · doi:10.1038/s41586-021-04223-6 · Cited by 727
Memristive technologies for data storage, computation, encryption, and radio-frequency communication
Lanza, M., Sebastian, A., Lu, W. D., Le Gallo, M., Chang, M.-F., Akinwande, D., Puglisi, F. M., Alshareef, H. N., Liu, M., & Roldan, J. B. (2022) · Science · doi:10.1126/science.abj9979 · Cited by 708
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
Le Gallo, M., Khaddam-Aljameh, R., Stanisavljevic, M., Vasilopoulos, A., Kersting, B., Dazzi, M., Karunaratne, G., Brändli, M., Singh, A., Müller, S. M., et al. (2023) · Nature Electronics · doi:10.1038/s41928-023-01010-1 · Cited by 310
Self-citation
Metadata
- Authors
- Narayanan, P., Ambrogio, S., Okazaki, A., Hosokawa, K., Tsai, H., Nomura, A., Yasuda, T., Mackin, C., Lewis, S. C., Friz, A., Ishii, M., Kohda, Y., Mori, H., Spoon, K., Khaddam-Aljameh, R., Saulnier, N., Bergendahl, M., Demarest, J., Brew, K. W., Chan, V., Choi, S., Ok, I., Ahsan, I., Lie, F. L., Haensch, W., Narayanan, V., & Burr, G. W.
- Affiliations
- IBM Research - Almaden (US)
- IBM Research - Tokyo (JP)
- IBM (United States) (US)
- IBM Research - Zurich (CH)
- IBM Albany NanoTech, Albany, NY, USA
- IBM Thomas J. Watson Research Center, Yorktown Heights, NY, USA
- ORCID
- Venue
- IEEE Transactions on Electron Devices
- Published
- 2021-12
- Volume
- 68
- Issue
- 12
- Pages
- 6629-6636
- ISSN
- 0018-9383 (ISSN-L)
- 1557-9646
- OpenAlex
- W3195245399
- Cited by
- 85
- References
- 23
- Citations by year
- 2026: 9 · 2025: 21 · 2024: 16 · 2023: 24 · 2022: 14 · 2021: 1
- FWCI
- 4.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- IEEE Transactions on Electron Devices (publishedVersion, cc-by-nc-nd)
- Funders
- IBM Research AI Hardware Center
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Analog and Mixed-Signal Circuit Design
- Keywords
- phase-change memory, multiply-accumulate operations, deep learning hardware acceleration, closed-loop tuning, recurrent neural networks, LSTM, MNIST, error propagation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.