Study of Quantized Hardware Deep Neural Networks Based on Resistive Switching Devices, Conventional versus Convolutional Approaches
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
A comprehensive analysis of two types of artificial neural networks (ANN) is performed to assess the influence of quantization on the synaptic weights. Conventional multilayer-perceptron (MLP) and convolutional neural networks (CNN) have been considered by changing their features in the training and inference contexts, such as number of levels in the quantization process, the number of hidden layers on the network topology, the number of neurons per hidden layer, the image databases, the number of convolutional layers, etc. A reference technology based on 1T1R structures with bipolar memristors including HfO2 dielectrics was employed, accounting for different multilevel schemes and the corresponding conductance quantization algorithms. The accuracy of the image recognition processes was studied in depth. This type of studies are essential prior to hardware implementation of neural networks. The obtained results support the use of CNNs for image domains. This is linked to the role played by convolutional layers at extracting image features and reducing the data complexity. In this case, the number of synaptic weights can be reduced in comparison to MLPs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Figure 2 Cumulative distribution functions (CDFs) of the read-out currents measured for each set of conductive levels, namely, 2 levels ( a ), 3 levels ( b ), 4 levels ( c ), and 5 levels ( d ). The conductance levels were obtained by means of the Multilevel Incremental Step Pulse with Verify Algorithm (M-ISPVA) algorithm [35]. LRS stands for low resistance state, this means that the memristors have a low internal resistance value, and HRS stands for high resistance state. These current levels, and therefore, the device conductance, are obtained by means of different sets of algorithm parameters. In this respect, the corresponding neural network weight quantization strategies can be linked to the algorithms chosen to electrically operate the devices.](https://figures.cochat.ai/paper-figures/9348f964353440e582684b50aa40b87e/study-of-quantized-hardware-deep-neural-networks-based-on-resistive-switching-figure-2.png)
![Figure 3 CDFs of the read-out currents measured for eight levels. The conductance levels were obtained by means of the Incremental Gate Voltage and Verify Algorithm (IGVVA) algorithm [36]. LRS stands for low resistance state, this means that the memristors has a low internal resistance value, and HRS stands for high resistance state.](https://figures.cochat.ai/paper-figures/b39bd7e0cb074f0db3fe4fb8fcded060/study-of-quantized-hardware-deep-neural-networks-based-on-resistive-switching-figure-3.png)











Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, it has been widely reported109–111, that the more states one memristor has, the more difficult to identify them, due to the inherent variability.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [109]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 8×
“In order to shed light on some of the issues raised above, we have analyzed the role of quantization on different types of hardware ANNs.”
BackgroundInfluentialSpeech Recognition Using Deep Neural Networks: A Systematic Review
Nassif, A. B., Shahin, I., Attili, I., Azzeh, M., & Shaalan, K. (2019) · IEEE Access · doi:10.1109/access.2019.2896880 · Cited by 1,152
Convolutional neural network: a review of models, methodologies and applications to object detection
Dhillon, A., & Verma, G. K. (2020) · Progress in Artificial Intelligence · doi:10.1007/s13748-019-00203-0 · Cited by 1,119
Two-dimensional materials for next-generation computing technologies
Liu, C., Chen, H., Wang, S., Liu, Q., Jiang, Y.-G., Zhang, D. W., Liu, M., & Zhou, P. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0724-3 · Cited by 1,045
Tang, J., Yuan, F., Shen, X., Wang, Z., Rao, M., He, Y., Sun, Y., Li, X., Zhang, W., Li, Y., et al. (2019) · Advanced Materials · doi:10.1002/adma.201902761 · Cited by 834
Recommended Methods to Study Resistive Switching Devices
Lanza, M., Wong, H. ‐. P., Pop, E., Ielmini, D., Strukov, D., Regan, B. C., Larcher, L., Villena, M. A., Yang, J. J., Goux, L., et al. (2019) · Advanced Electronic Materials · doi:10.1002/aelm.201800143 · Cited by 674
Self-citationNeural Networks and Deep Learning: A Textbook
Aggarwal, C. C. (2018) · doi:10.1007/978-3-319-94463-0 · Cited by 417
Webb, S. (2018) · Nature · doi:10.1038/d41586-018-02174-z · Cited by 353
A survey on deep learning in medicine: Why, how and when?
Piccialli, F., Somma, V. D., Giampaolo, F., Cuomo, S., & Fortino, G. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.09.006 · Cited by 348
SURVEY ON EVOLVING DEEP LEARNING NEURAL NETWORK ARCHITECTURES
Bashar, D. A. (2019) · Journal of Artificial Intelligence and Capsule Networks · doi:10.36548/jaicn.2019.2.003 · Cited by 342
Neuromemristive Circuits for Edge Computing: A Review
Krestinskaya, O., James, A. P., & Chua, L. O. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2899262 · Cited by 319
Kattenborn, T., Eichel, J., & Fassnacht, F. E. (2019) · Scientific Reports · doi:10.1038/s41598-019-53797-9 · Cited by 260
Recent advances of deep learning in bioinformatics and computational biology
Tang, B., Pan, Z., Yin, K., & Khateeb, A. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00214 · Cited by 233
Multilevel HfO2-based RRAM devices for low-power neuromorphic networks
Milo, V., Zambelli, C., Olivo, P., Pérez, E., K. Mahadevaiah, M., G. Ossorio, O., Wenger, C., & Ielmini, D. (2019) · APL Materials · doi:10.1063/1.5108650 · Cited by 200
Self-citationRoadmap on emerging hardware and technology for machine learning
Berggren, K., Xia, Q., Likharev, K. K., Strukov, D. B., Jiang, H., Mikolajick, T., Querlioz, D., Salinga, M., Erickson, J. R., Pi, S., et al. (2021) · Nanotechnology · doi:10.1088/1361-6528/aba70f · Cited by 190
Memristor devices for neural networks
Jeong, H., & Shi, L. (2019) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aae223 · Cited by 147
A Technical Review of Convolutional Neural Network-Based Mammographic Breast Cancer Diagnosis
Zou, L., Yu, S., Meng, T., Zhang, Z., Liang, X., & Xie, Y. (2019) · Computational and Mathematical Methods in Medicine · doi:10.1155/2019/6509357 · Cited by 146
A review on deep learning for future smart cities
Bhattacharya, S., Somayaji, S. R. K., Gadekallu, T. R., Alazab, M., & Maddikunta, P. K. R. (2022) · Internet Technology Letters · doi:10.1002/itl2.187 · Cited by 138
Woo, J., Moon, K., Song, J., Kwak, M., Park, J., & Hwang, H. (2016) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2016.2615648 · Cited by 96 · cited 1×
“, a row-by-row parallel program-verify scheme on a fabricated 160-Kb RRAM array employing an incremental gate voltage programming methodology [17], a binary synaptic learning scheme that benefits from the set and reset voltage variability of CMOS integrated 1T1R structures [18], a multilevel cell scheme in H f O2-base…”
MethodModeling affections with memristor-based associative memory neural networks
Hu, X., Duan, S., Chen, G., & Chen, L. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.10.028 · Cited by 95
Yan, B., Li, B., Qiao, X., Xue, C.-X., Chang, M., Chen, Y., & Li, H. (. (2019) · Advanced Intelligent Systems · doi:10.1002/aisy.201900068 · Cited by 95
Pérez, E., Zambelli, C., Mahadevaiah, M. K., Olivo, P., & Wenger, C. (2019) · IEEE Journal of the Electron Devices Society · doi:10.1109/jeds.2019.2931769 · Cited by 89
Self-citationAldana, S., García‐Fernández, P., Romero‐Zaliz, R., González, M. B., Jiménez-Molinos, F., Gómez‐Campos, F. M., Campabadal, F., & Roldán, J. B. (2020) · Journal of Physics D Applied Physics · doi:10.1088/1361-6463/ab7bb6 · Cited by 87
Self-citationPérez, E., Maldonado, D., Acal, C., Ruiz-Castro, J. E., Alonso, F. J., Aguilera, A. M., Jiménez-Molinos, F., Wenger, C., & Roldán, J. B. (2019) · Microelectronic Engineering · doi:10.1016/j.mee.2019.05.004 · Cited by 86
Self-citationMemristors for the Curious Outsiders
Carbajal, J. P., & Caravelli, F. (2018) · Technologies · doi:10.3390/technologies6040118 · Cited by 82
City-Wide Traffic Flow Forecasting Using a Deep Convolutional Neural Network
Sun, S., Wu, H., & Xiang, L. (2020) · Sensors · doi:10.3390/s20020421 · Cited by 81
Geng, Z., & Wang, Y. (2020) · Nature Communications · doi:10.1038/s41467-020-17123-6 · Cited by 72
Convolutional neural network for efficient estimation of regional brain strains
Wu, S., Zhao, W., Ghazi, K., & Ji, S. (2019) · Scientific Reports · doi:10.1038/s41598-019-53551-1 · Cited by 66
Accelerating deep learning with memcomputing
Manukian, H., Traversa, F. L., & Ventra, M. D. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.10.012 · Cited by 60
A Parallel Multibit Programing Scheme With High Precision for RRAM-Based Neuromorphic Systems
Chen, J.-R., Wu, H., Gao, B., Tang, J., Hu, X. S., & Qian, H. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2020.2979606 · Cited by 55
Memristor Models for Machine Learning
Carbajal, J. P., Dambre, J., Hermans, M., & Schrauwen, B. (2015) · Neural Computation · doi:10.1162/neco_a_00694 · Cited by 54
Roldán, J. B., Alonso, F., Aguilera, A. M., Maldonado, D., & Lanza, M. (2019) · Journal of Applied Physics · doi:10.1063/1.5079409 · Cited by 54
Self-citation$${ SIM}^2{ RRAM}$$ S I M 2 R R A M : a physical model for RRAM devices simulation
Villena, M. A., Roldán, J. B., Jiménez-Molinos, F., Miranda, E. A., Suñé, J., & Lanza, M. (2017) · Journal of Computational Electronics · doi:10.1007/s10825-017-1074-8 · Cited by 53
Self-citationMemristive Quantized Neural Networks: A Novel Approach to Accelerate Deep Learning On-Chip
Zhang, Y., Cui, M., Shen, L., & Zeng, Z. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2912205 · Cited by 50
Learning in Energy‐Efficient Neuromorphic Computing: Algorithm and Architecture Co‐Design
Zheng, N., & Mazumder, P. (2019) · Wiley eBooks · doi:10.1002/9781119507369 · Cited by 50
Grossi, A., Pérez, E., Zambelli, C., Olivo, P., Miranda, E. A., Roelofs, R., Woodruff, J. H., Räisänen, P. I., Li, W., Givens, M. E., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-29548-7 · Cited by 45
Self-citationOptimized programming algorithms for multilevel RRAM in hardware neural networks
Milo, V., Anzalone, F., Zambelli, C., Pérez, E., Mahadevaiah, M. K., Ossorio, Ó. G., Olivo, P., Wenger, C., & Ielmini, D. (2021) · IEEE International Reliability Physics Symposium proceedings · doi:10.1109/irps46558.2021.9405119 · Cited by 45
Self-citationIn-depth study of the physics behind resistive switching in TiN/Ti/HfO2/W structures
González-Cordero, G., Jiménez-Molinos, F., Roldán, J. B., González, M. B., & Campabadal, F. (2016) · Journal of Vacuum Science & Technology B Nanotechnology and Microelectronics Materials Processing Measurement and Phenomena · doi:10.1116/1.4973372 · Cited by 43
Self-citationPérez, E., Ossorio, Ó. G., Dueñas, S., Castán, H., García, H., & Wenger, C. (2020) · Electronics · doi:10.3390/electronics9050864 · Cited by 41
Self-citationStatistical analysis of resistive switching characteristics in ReRAM test arrays
Zambelli, C., Grossi, A., Olivo, P., Walczyk, D., Bertaud, T., Tillack, B., Schroeder, T. A., Stikanov, V., & Walczyk, C. (2014) · IEEE International Conference on Microelectronic Test Structures (ICMTS) · doi:10.1109/icmts.2014.6841463 · Cited by 34
Inherent Stochastic Learning in CMOS-Integrated HfO2 Arrays for Neuromorphic Computing
Wenger, C., Zahari, F., Mahadevaiah, M. K., Pérez, E., Beckers, I., Kohlstedt, H., & Ziegler, M. (2019) · IEEE Electron Device Letters · doi:10.1109/led.2019.2900867 · Cited by 33
Self-citationKinetic Monte Carlo analysis of data retention in Al:HfO 2 -based resistive random access memories
Aldana, S., Pérez, E., Jiménez-Molinos, F., Wenger, C., & Roldán, J. B. (2020) · Semiconductor Science and Technology · doi:10.1088/1361-6641/abb072 · Cited by 31
Self-citationPhase-type distributions for studying variability in resistive memories
Acal, C., Ruiz‐Castro, J. E., Aguilera, A. M., Jiménez-Molinos, F., & Roldán, J. B. (2018) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2018.06.010 · Cited by 30
Self-citationMemristor models for machine learning
Carbajal, J. P., Dambre, J., Hermans, M., et al. (2014) · Cited by 27
Classification with Stochastic Learning Methods and Convolutional Neural Networks
Astudillo, N., Bolman, R., & Sirakov, N. (2020) · SN Computer Science · doi:10.1007/s42979-020-00126-x · Cited by 5
Cited by
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“However, it has been widely reported 109 – 111 , that the more states one memristor has, the more dif fi cult to identify them, due to the inherent variability.”
Self-citationVariability in Resistive Memories
Roldán, J. B., Miranda, E., Maldonado, D., Mikhaylov, A. N., Agudov, N. V., Dubkov, A. A., Koryazhkina, M. N., González, M. B., Villena, M. A., Poblador, S., et al. (2023) · Advanced Intelligent Systems · doi:10.1002/aisy.202200338 · Cited by 197
Self-citationOn the Thermal Models for Resistive Random Access Memory Circuit Simulation
Roldán, J. B., González-Cordero, G., Picos, R., Miranda, E. A., Palumbo, F., Jiménez-Molinos, F., Moreno, E., Maldonado, D., Boyeras, S., Chawa, M. M. A., et al. (2021) · Nanomaterials · doi:10.3390/nano11051261 · Cited by 71
Self-citationDongale, T. D., Kamble, G. U., Kang, D. Y., Kundale, S. S., An, H.-M., & Kim, T. G. (2021) · physica status solidi (RRL) - Rapid Research Letters · doi:10.1002/pssr.202100199 · Cited by 65
Parameter extraction techniques for the analysis and modeling of resistive memories
Maldonado, D., Aldana, S., González, M. B., Jiménez-Molinos, F., Campabadal, F., & Roldán, J. B. (2022) · Microelectronic Engineering · doi:10.1016/j.mee.2022.111876 · Cited by 32
Self-citation
Metadata
- Authors
- Romero-Zaliz, R., Pérez, E., Jiménez-Molinos, F., Wenger, C., & Roldán, J. B.
- Affiliations
- Andalusian Research Institute on Data Science and Computational Intelligence (DaSCI), University of Granada, 18071 Granada, Spain
- Leibniz Institute for High Performance Microelectronics (DE)
- Universidad de Granada (ES)
- Brandenburg University of Technology Cottbus-Senftenberg (DE)
- Corresponding author
- Roldán, Juan B.
- Venue
- Electronics
- Publisher
- MDPI AG
- Published
- 2021-02-01
- Volume
- 10
- Issue
- 3
- Pages
- 346
- ISSN
- 2079-9292 (ISSN-L)
- OpenAlex
- W3126884064
- Cited by
- 28
- References
- 47
- Citations by year
- 2025: 3 · 2024: 4 · 2023: 5 · 2022: 6 · 2021: 10
- FWCI
- 1.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Electronics (publishedVersion, cc-by)
- Institutional Repository of the University of Granada (University of Granada) (submittedVersion, cc-by)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministerio de Ciencia e Innovación (TEC2017-84321-C4-3-R, RTI2018-098983-B-I00)
- Consejería de Conocimiento, Investigación y Universidad, Junta de Andalucía (A-TIC-117-UGR18)
- German Research Foundation (FOR2093)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- neural network hardware, resistive switching devices, memristors, multilevel quantization, convolutional neural networks, multilayer perceptron, HfO2 dielectric, image recognition, energy efficiency, hardware implementation of neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.