CoChat

In‐Memory Vector‐Matrix Multiplication in Monolithic Complementary Metal–Oxide–Semiconductor‐Memristor Integrated Circuits: Design Choices, Challenges, and Perspectives

Open access

The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.

Abstract

The low communication bandwidth between memory and processing units in conventional von Neumann machines does not support the requirements of emerging applications that rely extensively on large sets of data. More recent computing paradigms, such as high parallelization and near‐memory computing, help alleviate the data communication bottleneck to some extent, but paradigm‐shifting concepts are required. In‐memory computing has emerged as a prime candidate to eliminate this bottleneck by colocating memory and processing. In this context, resistive switching (RS) memory devices is a key promising choice, due to their unique intrinsic device‐level properties, enabling both storing and computing with a small, massively‐parallel footprint at low power. Theoretically, this directly translates to a major boost in energy efficiency and computational throughput, but various practical challenges remain. A qualitative and quantitative analysis of several key existing challenges in implementing high‐capacity, high‐volume RS memories for accelerating the most computationally demanding computation in machine learning (ML) inference, that of vector‐matrix multiplication (VMM), is presented. The monolithic integration of RS memories with complementary metal–oxide–semiconductor (CMOS) integrated circuits is presented as the core underlying technology. The key existing design choices in terms of device‐level physical implementation, circuit‐level design, and system‐level considerations is reviewed and an outlook for future directions is provided.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/aisy.202000115

Cites

92 of 92 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 43

  1. M.Horowitz in2014IEEEInt. Solid-State Circuits Conf. Digest of Technical Papers (ISSCC) IEEE Piscataway NJ2014 pp.10–14.
  2. H.Esmaeilzadeh E.Blem R. S.Amant K.Sankaralingam D.Burger in2011 38th Annual Int. Symp. on Computer Architecture (ISCA) IEEE Piscataway NJ2011 pp.365–376. · DOI · Paper page
  3. V.Sze Y.-H.Chen J.Emer A.Suleiman Z.Zhang in2017 IEEE Custom Integrated Circuits Conference (CICC) IEEE Piscataway NJ2017 pp.1–8. · DOI · Paper page
  4. M. N.Bojnordi E.Ipek in2016 IEEE Int. Symp. on High Performance Computer Architecture (HPCA) IEEE Piscataway NJ2016 pp.1–13. · DOI · Paper page
  5. F.Cai S.Kumar T.Van Vaerenbergh R.Liu C.Li S.Yu Q.Xia J. J.Yang R.Beausoleil W.Lu J. P.Strachan arXiv preprint arXiv:1903.111942019.
  6. J. H.Shin Y. J.Jeong M. A.Zidan Q.Wang W. D.Lu in2018 IEEE Int. Electron Devices Meeting (IEDM) IEEE Piscataway NJ2018 pp.3. · DOI · Paper page
  7. T. F.Wu H.Li P.-C.Huang A.Rahimi J. M.Rabaey H.-S. P.Wong M. M.Shulaker S.Mitra in2018 IEEE Int. Solid-State Circuits Conf.-(ISSCC) IEEE Piscataway NJ2018 pp.492–494.
  8. L.Song X.Qian H.Li Y.Chen in2017 IEEE Int. Symp. on High Performance Computer Architecture (HPCA) IEEE Piscataway NJ2017 pp.541–552. · DOI · Paper page
  9. A.Sebastian I.Boybat M.Dazzi I.Giannopoulos V.Jonnalagadda V.Joshi G.Karunaratne B.Kersting R.Khaddam-Aljameh S.Nandakumar A.Petropoulos C.Piveteau T.Antonakopoulos B.Rajendran M. L.Gallo E.Eleftheriou in2019 Symp. on VLSI Technology IEEE Piscataway NJ2019 pp.T168–T169. · DOI
  10. M.Mahmoodi H.Nili Z.Fahimi S.Larimian H.Kim D.Strukov in2019 IEEE Int. Electron Devices Meeting (IEDM) IEEE Piscataway NJ2019 pp.30. · doi:10.1109/iedm19573.2019.8993618
  11. B.Yan Q.Yang W.-H.Chen K.-T.Chang J.-W.Su C.-H.Hsu S.-H.Li H.-Y.Lee S.-S.Sheu M.-S.Ho Q.Wu M. F.Chang Y.Chen H.Li in2019 Symp. on VLSI Technology IEEE Piscataway NJ2019 pp.T86–T87. · DOI · Paper page
  12. Gupta I., 2016, Nat. Commun., 7, 1
  13. T. F.Wu B. Q.Le R.Radway A.Bartolo W.Hwang S.Jeong H.Li P.Tandon E.Vianello P.Vivet E.Nowak M.Wootters H.-S. P.Wong M.Aly E.Beigne S.Mitra in2019 IEEE Int. Solid-State Circuits Conf.-(ISSCC) IEEE Piscataway NJ2019 pp.226–228.
  14. H.Kim H.Nili M.Mahmoodi D.Strukov arXiv preprint arXiv:1906.120452019.
  15. B.Govoreanu G.Kar Y.Chen V.Paraschiv S.Kubicek A.Fantini I.Radu L.Goux S.Clima R.Degraeve N.Jossart O.Richard T.Vandeweyer K.Seo P.Hendrickx G.Pourtois H.Bender L.Altimime D. J.Wouters J. A.Kittl M.Jurczak in2011 Int. Electron Devices Meeting IEEE Piscataway NJ2011 pp.31–36. · DOI · Paper page
  16. A.Fantini L.Goux R.Degraeve D.Wouters N.Raghavan G.Kar A.Belmonte Y.-Y.Chen B.Govoreanu M.Jurczak in2013 5th IEEE Int. Memory Workshop IEEE Piscataway NJ2013 pp.30–33. · DOI · Paper page
  17. P.-Y.Chen B.Lin I.-T.Wang T.-H.Hou J.Ye S.Vrudhula J.-S.Seo Y.Cao S.Yu in2015 IEEE/ACM Int. Conf. on Computer-Aided Design (ICCAD) IEEE Piscataway NJ2015 pp.194–199.
  18. A.Fantini G.Gorine R.Degraeve L.Goux C. Y.Chen A.Redolfi S.Clima A.Cabrini G.Torelli M.Jurczak in2015 IEEE Int. Electron Devices Meeting (IEDM) IEEE Piscataway NJ2015 pp.7.5.1–7.5.4. · DOI
  19. H.Lee Y.Chen P.Chen P.Gu Y.Hsu S.Wang W.Liu C.Tsai S.Sheu P.Chiang W. P.Lin C. H.Lin W. S.Chen F. T.Chen C. H.Lien M.-J.Tsai in2010 Int. Electron Devices Meeting IEEE Piscataway NJ2010 pp.19–27. · DOI · Paper page
  20. Murmann B., 2020, ADC Performance Survey 1997–2020
  21. S.Hashemi N.Anthony H.Tann R. I.Bahar S.Reda inDesign Automation and Test in Europe Conf. and Exhibition (DATE) IEEE Piscataway NJ2017 pp.1474–1479.
  22. F.Su W.-H.Chen L.Xia C.-P.Lo T.Tang Z.Wang K.-H.Hsu M.Cheng J.-Y.Li Y.Xie Y.Wang M. F.Chang H.Yang Y.Liu in2017 Symp. on VLSI Technology IEEE Piscataway NJ2017 pp.T260–T261.
  23. M.Bocquet T.Hirztlin J.-O.Klein E.Nowak E.Vianello J.-M.Portal D.Querlioz in2018 IEEE Int. Electron Devices Meeting (IEDM) IEEE Piscataway NJ2018 pp.20–26. · DOI · Paper page
  24. I.Hubara M.Courbariaux D.Soudry R.El-Yaniv Y.Bengio inAdvances in Neural Information Processing Systems 2016 pp.4107–4115.
  25. Q.Liu B.Gao P.Yao D.Wu J.Chen Y.Pang W.Zhang Y.Liao C.-X.Xue W.-H.Chen J.Tang Y.Wang M.-F.Chang H.Qian H.Wu in2020 IEEE Int. Solid-State Circuits Conf.-(ISSCC) IEEE Piscataway NJ2020 pp.500–502.
  26. Karatsuba A. A., 1962, Doklady Akademii Nauk, 293
  27. S.Huss-Lederman E. M.Jacobson J. R.Johnson A.Tsao T.Turnbull inProc. of Supercomputing Bd. 96 Citeseer Princeton NJ1996 pp.9.
  28. M.Bavandpour S.Sahay M. R.Mahmoodi D. B.Strukov arXiv preprint arXiv:1908.024722019.
  29. Bavandpour M., 2020, IEEE J. Expl. Solid-State Comput. Devices Circuits
  30. Bavandpour M., 2019, IEEE Trans. Very Large Scale Integr. (VLSI) Syst.
  31. B.Moons R.Uytterhoeven W.Dehaene M.Verhelst in2017 IEEE Int. Solid-State Circuits Conf. (ISSCC) IEEE Piscataway NJ2017 pp.246–247.
  32. Merritt R., 2019, Startup Accelerates AI at the Sensor
  33. D.Shin J.Lee J.Lee H.-J.Yoo in2017 IEEE Int. Solid-State Circuits Conf. (ISSCC) IEEE Piscataway NJ2017 pp.240–241.
  34. Google, 2019, Edge TPU: Google's Purpose-Built ASIC Designed to Run Inference at the Edge
  35. Cutress I., 2018, Cambricon, Maker of Hauwei's Kirin NPU IP, Build a Big AI Chip and PCIe Card
  36. Armasu L., 2018, Move Over GPUs: Startup's Chip Claims to Do Deep Learning Inference Better
  37. K.Ueyoshi K.Ando K.Hirose S.Takamaeda-Yamazaki J.Kadomoto T.Miyata M.Hamada T.Kuroda M.Motomura in2018 IEEE Int. Solid-State Circuits Conf. (ISSCC) IEEE Piscataway NJ2018 pp.216–218.
  38. Hruska J., 2017, New Movidius Myriad X VPU Packs a Custom Neural Compute Engine
  39. Z.Du R.Fasthuber T.Chen P.Ienne L.Li T.Luo X.Feng Y.Chen O.Temam inProc. of the 42nd Annual Int. Symp. on Computer Architecture 2015 pp.92–104. · DOI · Paper page
  40. Y.Chen T.Luo S.Liu S.Zhang L.He J.Wang L.Li T.Chen Z.Xu N.Sun O.Temam in2014 47th Annual IEEE/ACM Int. Symp. on Microarchitecture IEEE Piscataway NJ2014 pp.609–622. · DOI · Paper page
  41. Rockchip, 2018, Rockchip Released Its First AI Processor RK3399Pro NPU Performance up to 2.4TOPs
  42. R.Mochida K.Kouno Y.Hayata M.Nakayama T.Ono H.Suwa R.Yasuhara K.Katayama T.Mikawa Y.Gohou in2018 IEEE Symp. on VLSI Technology IEEE Piscataway NJ2018 pp.175–176. · DOI · Paper page
  43. C.-X.Xue W.-H.Chen J.-S.Liu J.-F.Li W.-Y.Lin W.-E.Lin J.-H.Wang W.-C.Wei T.-W.Chang T.-C.Chang T.-Y.Huang H.-Y.Kao S.-Y.Wei Y.-C.Chiu C.-Y.Lee C.-C.Lo Y.-C.King C.-J.Lin R.-S.Liu C.-C.Hsieh K.-T.Tang M.-F.Chang in2019 IEEE Int. Solid-State Circuits Conf.-(ISSCC) IEEE Piscataway NJ2019 pp.388–390.

Cited by

See all 216

Metadata

Authors
Amirsoleimani, A., Alibart, F., Yon, V., Xu, J., Pazhouhandeh, M. R., Ecoffey, S., Beilliard, Y., Genov, R., & Drouin, D.
Affiliations
  • University of Toronto (CA)
  • Centre National de la Recherche Scientifique (FR)
Corresponding author
  • Amirsoleimani, Amirali
  • Alibart, Fabien
Venue
Advanced Intelligent Systems
Publisher
Wiley
Published
2020-08-23
Volume
2
Issue
11
Pages
2000115
ISSN
2640-4567 (ISSN-L)
OpenAlex
W3081302630
Cited by
216
References
88
Citations by year
2026: 21 · 2025: 52 · 2024: 44 · 2023: 41 · 2022: 38 · 2021: 19 · 2020: 1
FWCI
8.49
Type
journal article
Language
en
Open access
Locations
  • Advanced Intelligent Systems (publishedVersion, cc-by)
  • HAL (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • LillOA (Université de Lille (University Of Lille)) (submittedVersion, other-oa)
Funders
  • European Research Council (773228)
  • Canadian Network for Research and Innovation in Machining Technology, Natural Sciences and Engineering Research Council of Canada (HIDATA)
Topics
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
Keywords
in-memory computing, matrix-vector multiplication, resistive random access memory, memristors, monolithic integration, near-memory computing, energy efficiency, circuit design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.