Integration and Co-design of Memristive Devices and Algorithms for Artificial Intelligence
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Memristive devices share remarkable similarities to biological synapses, dendrites, and neurons at both the physical mechanism level and unit functionality level, making the memristive approach to neuromorphic computing a promising technology for future artificial intelligence. However, these similarities do not directly transfer to the success of efficient computation without device and algorithm co-designs and optimizations. Contemporary deep learning algorithms demand the memristive artificial synapses to ideally possess analog weighting and linear weight-update behavior, requiring substantial device-level and circuit-level optimization. Such co-design and optimization have been the main focus of memristive neuromorphic engineering, which often abandons the "non-ideal" behaviors of memristive devices, although many of them resemble what have been observed in biological components. Novel brain-inspired algorithms are being proposed to utilize such behaviors as unique features to further enhance the efficiency and intelligence of neuromorphic computing, which calls for collaborations among electrical engineers, computing scientists, and neuroscientists.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“SNN is considered as the third generation of neural networks (Maass 1997), following the first generation based onMcCulloch-Pitts neurons (McCulloch and Pitts 1943) with digital input and output, and the second generation composed of multiple perceptron layers with gradient descent learning algorithm, which applies ac…”
BackgroundLearning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Hopfield, J. J. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.10.3088 · Cited by 6,918
The Organization of Behavior; A Neuropsychological Theory.
Attneave, F., B., M., & Hebb, D. O. (1950) · The American Journal of Psychology · doi:10.2307/1418888 · Cited by 5,146
Bi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744
Memristive devices for computing
Yang, J. J., Strukov, D. B., & Stewart, D. R. (2013) · Nature Nanotechnology · doi:10.1038/nnano.2012.240 · Cited by 3,885
Self-citationTraining and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 3×
“…to the rows of a memristive array and sensing the current output at the end of each column as the result of Ohm’s law and Kirchhoff’s current law, as shown in Figure 2D. Note that the case shown in Figure 2D illustrates the ideal case of using a passive memristive array (Prezioso et al., 2015).”
BackgroundMethodMemristors with diffusive dynamics as synaptic emulators for neuromorphic computing
Wang, Z., Joshi, S., Savel’ev, S. E., Jiang, H., Midya, R., Lin, P., Hu, M., Ge, N., Strachan, J. P., Li, Z., et al. (2017) · Nature Materials · doi:10.1038/nmat4756 · Cited by 2,358
Self-citationIn-memory computing with resistive switching devices
Ielmini, D., & Wong, H.-S. P. (2018) · Nature Electronics · doi:10.1038/s41928-018-0092-2 · Cited by 2,298
Self-citationFully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179 · cited 6×
“Furthermore, a recently proposed hybrid training scheme takes the advantages of both in situ and ex situ training methods to efficiently realize a memristor-based neuromorphic system (Yao et al., 2020).”
BackgroundMethodInfluentialSelf-citationShort-term plasticity and long-term potentiation mimicked in single inorganic synapses
Ohno, T., Hasegawa, T., Tsuruoka, T., Terabe, K., Gimzewski, J. K., & Aono, M. (2011) · Nature Materials · doi:10.1038/nmat3054 · Cited by 1,793 · cited 2×
“An increase in the frequency of applied pulses (Ohno et al., 2011) or using a higher compliance current (Wang et al.”
BackgroundResistive switching materials for information processing
Wang, Z., Wu, H., Burr, G. W., Hwang, C. S., Wang, K. L., Xia, Q., & Yang, J. J. (2020) · Nature Reviews Materials · doi:10.1038/s41578-019-0159-3 · Cited by 1,214
Self-citationEquivalent-accuracy accelerated neural-network training using analogue memory
Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R. M., Boybat, I., di Nolfo, C., Sidler, S., Giordano, M., Bodini, M., Farinha, N. C. P., et al. (2018) · Nature · doi:10.1038/s41586-018-0180-5 · Cited by 1,151
Fully memristive neural networks for pattern classification with unsupervised learning
Wang, Z., Joshi, S., Savel’ev, S., Song, W., Midya, R., Li, Y., Rao, M., Yan, P., Asapu, S., Zhuo, Y., et al. (2018) · Nature Electronics · doi:10.1038/s41928-018-0023-2 · Cited by 1,106
Self-citationBurr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936
Efficient and self-adaptive in-situ learning in multilayer memristor neural networks
Li, C., Belkin, D., Li, Y., Yan, P., Hu, M., Ge, N., Jiang, H., Montgomery, E., Lin, P., Wang, Z., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04484-2 · Cited by 931 · cited 5×
“With the output error calculation performed in situ in the memristive network, the weight learning partially adapts to the nonidealities of memristive devices (write noise and device failure), thus mitigating the impact of the memristive nonidealities (Li et al., 2018).”
BackgroundMethodInfluentialSelf-citationFace classification using electronic synapses
Yao, P., Wu, H., Gao, B., Eryilmaz, S. B., Huang, X., Zhang, W., Zhang, Q., Deng, N., Shi, L., Wong, H.-S. P., et al. (2017) · Nature Communications · doi:10.1038/ncomms15199 · Cited by 909 · cited 1×
“, 2019) or digitalized into the number of identical pulses, namely, pulse number modulation (Yao et al., 2017; Cai et al., 2019).”
BackgroundSelf-citationISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.12 · Cited by 775
Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine
Hu, M., Graves, C. E., Li, C., Li, Y., Ge, N., Montgomery, E., Davila, N., Jiang, H., Williams, R. S., Yang, J. J., et al. (2018) · Advanced Materials · doi:10.1002/adma.201705914 · Cited by 751
Self-citationA fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations
Cai, F., Correll, J. M., Lee, S. H., Lim, Y., Bothra, V., Zhang, Z., Flynn, M. P., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0270-x · Cited by 728 · cited 1×
“If a larger array size for VMMA operation is needed, material-level optimizations to decrease the resistance of the connection wires or to increase the resistance of the memristive devices are needed (Zhang et al., 2019).”
BackgroundChoi, S., Tan, S. H., Li, Z., Kim, Y., Choi, C., Chen, P.-Y., Yeon, H., Yu, S., & Kim, J. (2018) · Nature Materials · doi:10.1038/s41563-017-0001-5 · Cited by 690
Temporal data classification and forecasting using a memristor-based reservoir computing system
Moon, J., Ma, W., Shin, J. H., Cai, F., Du, C., Lee, S. H., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0313-3 · Cited by 645 · cited 3×
“RCs based on the second-order effect (Du et al., 2017; Moon et al., 2019) and the accumulation of ions in diffusive memristors (Midya et al., 2019) have been explored.”
BackgroundPattern classification by memristive crossbar circuits using ex situ and in situ training
Alibart, F., Zamanidoost, E., & Strukov, D. B. (2013) · Nature Communications · doi:10.1038/ncomms3072 · Cited by 642
Kim, S., Du, C., Sheridan, P., Ma, W., Choi, S., & Lu, W. D. (2015) · Nano Letters · doi:10.1021/acs.nanolett.5b00697 · Cited by 603
Woo, J., Moon, K., Song, J., Lee, S., Kwak, M., Park, J., & Hwang, H. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2582859 · Cited by 512 · cited 1×
“potentiation (or depression) behavior of conductance under identical pulses (Woo et al., 2016).”
BackgroundGokmen, T., & Vlasov, Y. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00333 · Cited by 491
Accurate deep neural network inference using computational phase-change memory
Joshi, V., Le Gallo, M., Haefeli, S., Boybat, I., Nandakumar, S. R., Piveteau, C., Dazzi, M., Rajendran, B., Sebastian, A., & Eleftheriou, E. (2020) · Nature Communications · doi:10.1038/s41467-020-16108-9 · Cited by 490
Long short-term memory networks in memristor crossbar arrays
Li, C., Wang, Z., Rao, M., Belkin, D., Song, W., Jiang, H., Yan, P., Li, Y., Lin, P., Hu, M., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0001-4 · Cited by 429
Self-citationThree-dimensional memristor circuits as complex neural networks
Lin, P., Li, C., Wang, Z., Li, Y., Jiang, H., Song, W., Rao, M., Zhuo, Y., Upadhyay, N. K., Barnell, M., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0397-9 · Cited by 375
Self-citationSurface diffusion-limited lifetime of silver and copper nanofilaments in resistive switching devices
Wang, W., Wang, M., Ambrosi, E., Bricalli, A., Laudato, M., Sun, Z., Chen, X., & Ielmini, D. (2019) · Nature Communications · doi:10.1038/s41467-018-07979-0 · Cited by 328
Self-citationSuri, M., Bichler, O., Querlioz, D., Cueto, O., Perniola, L., Sousa, V., Vuillaume, D., Gamrat, C., & DeSalvo, B. (2011) · 2011 International Electron Devices Meeting · doi:10.1109/iedm.2011.6131488 · Cited by 314
Liu, Q., Gao, B., Yao, P., Wu, D., Chen, J., Pang, Y., Zhang, W., Liao, Y., Xue, C.-X., Chen, W.-H., et al. (2020) · 2020 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc19947.2020.9062953 · Cited by 308 · cited 3×
“Recently, a memristive dendrite component has been demonstrated using a Pt/TaO x /AlO d /Al-based dynamic mem-ristor (Li et al., 2020), exploiting the non-linearity provided by the Schottky-like barrier in the Pt/TaO x interface.”
BackgroundMethodSelf-citationIn situ training of feed-forward and recurrent convolutional memristor networks
Wang, Z., Li, C., Lin, P., Rao, M., Nie, Y., Song, W., Qiu, Q., Li, Y., Yan, P., Strachan, J. P., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0089-1 · Cited by 307
Self-citationReservoir Computing Using Diffusive Memristors
Midya, R., Wang, Z., Asapu, S., Zhang, X., Rao, M., Song, W., Zhuo, Y., Upadhyay, N., Xia, Q., & Yang, J. J. (2019) · Advanced Intelligent Systems · doi:10.1002/aisy.201900084 · Cited by 279
Self-citationCMOS-integrated memristive non-volatile computing-in-memory for AI edge processors
Chen, W.-H., Dou, C., Li, K.-X., Lin, W.-Y., Li, P.-Y., Huang, J.-H., Wang, J.-H., Wei, W.-C., Xue, C.-X., Chiu, Y.-C., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0288-0 · Cited by 276 · cited 2×
“In terms of the chip-level demonstration, a fully integrated memristive in-memory computing macro, named as non-volatile computing-inmemory (nvCIM), has been demonstrated (Chen et al., 2019).”
BackgroundSelf-citationTemporal correlation detection using computational phase-change memory
Sebastian, A., Tuma, T., Papandreou, N., Le Gallo, M., Kull, L., Parnell, T., & Eleftheriou, E. (2017) · Nature Communications · doi:10.1038/s41467-017-01481-9 · Cited by 241 · cited 2×
“Based on a similar methodology, the detection of the coincidence of simultaneous spikes representing an image among noise was developed (Sebastian et al., 2017; Prezioso et al., 2018) (Figure 5A).”
MethodPrezioso, M., Mahmoodi, M. R., Bayat, F. M., Nili, H., Kim, H., Vincent, A., & Strukov, D. B. (2018) · Nature Communications · doi:10.1038/s41467-018-07757-y · Cited by 215 · cited 1×
“Based on a similar methodology, the detection of the coincidence of simultaneous spikes representing an image among noise was developed (Sebastian et al., 2017; Prezioso et al., 2018) (Figure 5A).”
MethodTraining Deep Convolutional Neural Networks with Resistive Cross-Point Devices
Gokmen, T., Onen, M., & Haensch, W. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00538 · Cited by 162
Hirtzlin, T., Bocquet, M., Penkovsky, B., Klein, J.-O., Nowak, E., Vianello, E., Portal, J.-M., & Querlioz, D. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01383 · Cited by 93
The marriage of training and inference for scaled deep learning analog hardware
Gokmen, T., Rasch, M. J., & Haensch, W. (2019) · 2019 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm19573.2019.8993573 · Cited by 37 · cited 1×
“into consideration, namely, hardware aware training (Gokmen et al. 2019; Joshi et al., 2020).”
Training a Probabilistic Graphical Model With Resistive Switching Electronic Synapses
Eryilmaz, S. B., Neftci, E., Joshi, S., Kim, S., BrightSky, M., Lung, H.-L., Lam, C., Cauwenberghs, G., & Wong, H.-S. P. (2016) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2016.2616483 · Cited by 34
Cited by
Embedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 652
Synaptic devices based neuromorphic computing applications in artificial intelligence
Sun, B., Guo, T., Zhou, G., Ranjan, S., Jiao, Y., Wei, L., Zhou, Y. N., & Wu, Y. A. (2021) · Materials Today Physics · doi:10.1016/j.mtphys.2021.100393 · Cited by 275
A memristive deep belief neural network based on silicon synapses
Wang, W., Danial, L., Li, Y., Herbelin, E., Pikhay, E., Roizin, Y., Hoffer, B., Wang, Z., & Kvatinsky, S. (2022) · Nature Electronics · doi:10.1038/s41928-022-00878-9 · Cited by 66
Self-citationAguirre, F. L., Gomez, N. M., Pazos, S. M., Palumbo, F., Suñé, J., & Miranda, E. (2021) · Journal of Low Power Electronics and Applications · doi:10.3390/jlpea11010009 · Cited by 14
2022 roadmap on neuromorphic computing and engineering
Christensen, D. V., Dittmann, R., Linares-Barranco, B., Sebastian, A., Le Gallo, M., Redaelli, A., Slesazeck, S., Mikolajick, T., Spiga, S., Menzel, S., et al. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac4a83
Self-citation
Metadata
- Authors
- Wang, W., Song, W., Yao, P., Li, Y., Van Nostrand, J., Qiu, Q., Ielmini, D., & Yang, J. J.
- Venue
- iScience
- Publisher
- Elsevier BV
- Published
- 2020-12
- Volume
- 23
- Issue
- 12
- Pages
- 101809
- ISSN
- 2589-0042 (ISSN-L)
- OpenAlex
- W3102325434
- Cited by
- 84
- References
- 45
- FWCI
- 4.39
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.