The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Energy-Efficient Brain Floating Point Convolutional Neural Network Using Memristors
Abstract
In this article, a memristor-based convolutional neural network (CNN) is implemented to achieve both brain floating point (BF16) processing accuracy and high energy efficiency for cloud artificial intelligence (AI) acceleration for the first time. A low-cost in-memory floating-point (FP) computing arithmetic is developed with an approximate computing technique, which sufficiently considers the requirement of both efficiency and accuracy in FP-CNN applications. For further optimization, we investigate the impact of nonideal effects at the device and array level (including the device variation, line resistance, array parasitic capacitance, etc.) on analog computing. Based on these, a bit-weight slicing technique is employed for highly efficient and accurate FP computing within the memristor crossbar array. Meanwhile, an in-memory convolutional operating method is proposed to further reduce the hardware overhead in deploying large-scale CNNs for complex datasets. By combining the above strategies, we evaluate the performance of memristor-implemented BF16-CNNs using the VGG-16 network on the CIFAR-10 dataset. An 85.47% classification accuracy with 1.987 TFLOPS/W energy efficiency and 20.9895 GFLOPS/mm2 area efficiency is obtained.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
In-memory computing with resistive switching devices
Ielmini, D., & Wong, H.-S. P. (2018) · Nature Electronics · doi:10.1038/s41928-018-0092-2 · Cited by 2,298 · cited 1×
“In recent years, memristor-based in-memory computing (IMC) has demonstrated the potential to address the above issues [4], [5], [6], [7].”
BackgroundMemory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179 · cited 3×
“By executing the high parallel matrix-vector multiplication (MVM) using the analog computing mechanism inside the memristor crossbar array [8], [9], IMC can substantially eliminate data movement and perform CNNs with high efficiency [10], [11].”
MethodMemristive crossbar arrays for brain-inspired computing
Xia, Q., & Yang, J. J. (2019) · Nature Materials · doi:10.1038/s41563-019-0291-x · Cited by 1,800
ISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Resistive switching materials for information processing
Wang, Z., Wu, H., Burr, G. W., Hwang, C. S., Wang, K. L., Xia, Q., & Yang, J. J. (2020) · Nature Reviews Materials · doi:10.1038/s41578-019-0159-3 · Cited by 1,214 · cited 1×
“In recent years, memristor-based in-memory computing (IMC) has demonstrated the potential to address the above issues [4], [5], [6], [7].”
BackgroundEquivalent-accuracy accelerated neural-network training using analogue memory
Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R. M., Boybat, I., di Nolfo, C., Sidler, S., Giordano, M., Bodini, M., Farinha, N. C. P., et al. (2018) · Nature · doi:10.1038/s41586-018-0180-5 · Cited by 1,151
Towards artificial general intelligence with hybrid Tianjic chip architecture
Pei, J., Deng, L., Song, S., Zhao, M., Zhang, Y., Wu, S., Wang, G., Zou, Z., Wu, Z., He, W., et al. (2019) · Nature · doi:10.1038/s41586-019-1424-8 · Cited by 1,082
A compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Burr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936 · cited 1×
“Designing and deploying larger-scale networks has become an important topic in the field of deep learning [35], [36].”
BackgroundFace classification using electronic synapses
Yao, P., Wu, H., Gao, B., Eryilmaz, S. B., Huang, X., Zhang, W., Zhang, Q., Deng, N., Shi, L., Wong, H.-S. P., et al. (2017) · Nature Communications · doi:10.1038/ncomms15199 · Cited by 909
PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning
Song, L., Qian, X., Li, H., & Chen, Y. (2017) · 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2017.55 · Cited by 833
Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine
Hu, M., Graves, C. E., Li, C., Li, Y., Ge, N., Montgomery, E., Davila, N., Jiang, H., Williams, R. S., Yang, J. J., et al. (2018) · Advanced Materials · doi:10.1002/adma.201705914 · Cited by 751 · cited 2×
“By executing the high parallel matrix-vector multiplication (MVM) using the analog computing mechanism inside the memristor crossbar array [8], [9], IMC can substantially eliminate data movement and perform CNNs with high efficiency [10], [11].”
MethodSelf-citationA fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations
Cai, F., Correll, J. M., Lee, S. H., Lim, Y., Bothra, V., Zhang, Z., Flynn, M. P., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0270-x · Cited by 728
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Accurate deep neural network inference using computational phase-change memory
Joshi, V., Le Gallo, M., Haefeli, S., Boybat, I., Nandakumar, S. R., Piveteau, C., Dazzi, M., Rajendran, B., Sebastian, A., & Eleftheriou, E. (2020) · Nature Communications · doi:10.1038/s41467-020-16108-9 · Cited by 490
Accurate deep neural network inference using computational phase-change memory
Joshi, V., Gallo, M. L., Haefeli, S., Boybat, I., Nandakumar, S. R., Piveteau, C., Dazzi, M., Rajendran, B., Sebastian, A., & Eleftheriou, E. S. (2020) · RePEc: Research Papers in Economics · doi:10.3929/ethz-b-000416797 · Cited by 379
Le Gallo, M., Khaddam-Aljameh, R., Stanisavljevic, M., Vasilopoulos, A., Kersting, B., Dazzi, M., Karunaratne, G., Brändli, M., Singh, A., Müller, S. M., et al. (2023) · Nature Electronics · doi:10.1038/s41928-023-01010-1 · Cited by 310 · cited 1×
“Table II presents a performance comparison among state-of-the-art AI processors, including SRAM and memristors for FP computing, as well as PCM for fixed-point computing [43], [44], [45], [46], [47], [48].”
BackgroundA general memristor-based partial differential equation solver
Zidan, M. A., Jeong, Y., Lee, J., Chen, B., Huang, S., Kushner, M. J., & Lu, W. D. (2018) · Nature Electronics · doi:10.1038/s41928-018-0100-6 · Cited by 261
Accelerator-friendly neural-network training: Learning variations and defects in RRAM crossbar
Chen, L., Li, J., Chen, Y., Deng, Q., Shen, J., Liang, X., & Jiang, L. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7926952 · Cited by 245 · cited 1×
“The nonideal effects on the memristor array can result in reduced MVM accuracy, decreased network performance, and even sacrificed energy efficiency [27].”
BackgroundSelf-citationLow-power linear computation using nonlinear ferroelectric tunnel junction memristors
Berdan, R., Marukame, T., Ota, K., Yamaguchi, M., Saitoh, M., Fujii, S., Deguchi, J., & Nishi, Y. (2020) · Nature Electronics · doi:10.1038/s41928-020-0405-0 · Cited by 238
Xue, C.-X., Huang, T.-Y., Liu, J.-S., Chang, T.-W., Kao, H.-Y., Wang, J.-H., Liu, T.-W., Wei, S.-Y., Huang, S.-P., Wei, W.-C., et al. (2020) · 2020 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc19947.2020.9063078 · Cited by 230 · cited 1×
“For instance, Xue et al. [14] implemented multibit computing using a fabricated 22 nm 2 Mb binary memristor-based macro for artificial intelligence (AI) edge computing.”
MethodIn-memory Learning with Analog Resistive Switching Memory: A Review and Perspective
Xi, Y., Gao, B., Tang, J., Chen, A., Chang, M.-F., Hu, X. S., Spiegel, J. V. D., Qian, H., & Wu, H. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004543 · Cited by 196
Solving parametric PDE problems with artificial neural networks
KHOO, Y., LU, J., & YING, L. (2021) · European Journal of Applied Mathematics · doi:10.1017/s0956792520000182 · Cited by 194
Xue, C.-X., Chiu, Y.-C., Liu, T.-W., Huang, T.-Y., Liu, J.-S., Chang, T.-W., Kao, H.-Y., Wang, J.-H., Wei, S.-Y., Lee, C.-Y., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-00505-5 · Cited by 181 · cited 1×
“In many previous works, device precision is rarely discussed, but it plays a crucial role in determining the signal margin of the output current [30].”
BackgroundTu, F., Wang, Y., Wu, Z., et al. (2022) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc42614.2022.9731762 · Cited by 146
Khaddam-Aljameh, R., Stanisavljevic, M., Fornt Mas, J., Karunaratne, G., Brändli, M., Liu, F., Singh, A., Müller, S. M., Egger, U., Petropoulos, A., et al. (2022) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2022.3140414 · Cited by 144
Enabling Scientific Computing on Memristive Accelerators
Feinberg, B., Vengalam, U. K. R., Whitehair, N., Wang, S., & İpek, E. (2018) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2018.00039 · Cited by 135
Khwa, W.-S., Chiu, Y.-C., Jhang, C.-J., Huang, S.-P., Lee, C.-Y., Wen, T.-H., Chang, F.-C., Yu, S.-M., Lee, T.-Y., & Chang, M.-F. (2022) · 2022 IEEE International Solid- State Circuits Conference (ISSCC) · doi:10.1109/isscc42614.2022.9731670 · Cited by 125
A fully hardware-based memristive multilayer neural network
Kiani, F., Yin, J., Wang, Z., Yang, J. J., & Xia, Q. (2021) · Science Advances · doi:10.1126/sciadv.abj4801 · Cited by 97 · cited 1×
“Designing and deploying larger-scale networks has become an important topic in the field of deep learning [35], [36].”
BackgroundChiu, Y.-C., Yang, C.-S., Teng, S.-H., Huang, H. Y., Chang, F.-C., Wu, Y., Chien, Y.-A., Hsieh, F.-L., Li, C.-Y., Lin, G.-Y., et al. (2022) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc42614.2022.9731621 · Cited by 96
Investigation of statistical retention of filamentary analog RRAM for neuromophic computing
Zhao, M., Wu, H., Gao, B., Zhang, Q., Wu, W., Wang, S., Xi, Y., Wu, D., Deng, N., Yu, S., et al. (2017) · 2017 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2017.8268522 · Cited by 95
8-bit Precision In-Memory Multiplication with Projected Phase-Change Memory
Giannopoulos, I., Sebastian, A., Gallo, M. L., Jonnalagadda, V. P., Sousa, M., Boon, M. N., & Eleftheriou, E. S. (2018) · Technical digest - International Electron Devices Meeting/Technical digest · doi:10.1109/iedm.2018.8614558 · Cited by 81
Challenges and Trends of Nonvolatile In-Memory-Computation Circuits for AI Edge Devices
Hung, J.-M., Jhang, C.-J., Wu, P.-C., Chiu, Y.-C., & Chang, M. (2021) · IEEE Open Journal of the Solid-State Circuits Society · doi:10.1109/ojsscs.2021.3123287 · Cited by 65
Precision of bit slicing with in-memory computing based on analog phase-change memory crossbars
Gallo, M. L., Nandakumar, S. R., Ciric, L., Boybat, I., Khaddam-Aljameh, R., Mackin, C., & Sebastian, A. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac4fb7 · Cited by 57
Lee, J., Kim, J.-H., Jo, W., et al. (2021) · Symposium on VLSI Circuits · doi:10.23919/vlsicircuits52068.2021.9492476 · Cited by 54
Woo, J., & Yu, S. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2917764 · Cited by 50
ReHy: A ReRAM-based Digital/Analog Hybrid PIM Architecture for Accelerating CNN Training
Jin, H., Liu, C., Liu, H., Luo, R., Xu, J., Mao, F., & Liao, X. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3138087 · Cited by 38
Xiang, Y., Huang, P. C., Zhou, Z., Han, R., Jiang, Y. N., Shu, Q. M., Su, Z., Liu, Y. B., Liu, X., & Kang, J. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702401 · Cited by 33
Jeong, S., Park, J., & Jeon, D. (2022) · European Solid-State Circuits Conference (ESSCIRC) · doi:10.1109/esscirc55480.2022.9911450 · Cited by 32
ReFloat: Low-Cost Floating-Point Processing in ReRAM for Accelerating Iterative Linear Solvers
Song, L., Chen, F., Li, H. H., & Chen, Y. (2023) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3581784.3607077 · Cited by 18
Unbalanced Bit-slicing Scheme for Accurate Memristor-based Neural Network Architecture
Diware, S., Gebregiorgis, A., Joshi, R., Hamdioui, S., & Bishnoi, R. (2021) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas51828.2021.9458443 · Cited by 17
Hu, X., Wang, Y., Ma, Z., Wen, G., Wang, Z., Lu, Z., Liu, Y., Li, Y., Liang, X., Zeng, X., et al. (2023) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2023.3283418 · Cited by 15
Self-citationDesign Principles of 22-nm SOI LDD-FinFETs for Ultra-Low-Power Analog Circuits
Dixit, A., Kori, P. K., Rajan, C., et al. (2022) · Journal of Electronic Materials · doi:10.1007/s11664-021-09337-1 · Cited by 12
First Fire-free, Low-voltage (~1.2 V), and Low Off-current (~3 nA) SiOxTey Selectors
Vaziri, S., Datye, I. M., Ambrosi, E., et al. (2022) · IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits) · doi:10.1109/vlsitechnologyandcir46769.2022.9830395 · Cited by 11
Memristor-CMOS Analog Coprocessor for Acceleration of High-Performance Computing Applications
Athreyas, N., Song, W., Perot, B., Xia, Q., Mathew, A., Gupta, J., Gupta, D. V., & Yang, J. J. (2018) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3269985 · Cited by 9
16-Bit Fixed-Point Number Multiplication With CNT Transistor Dot-Product Engine
Kim, S., Lee, Y., Kim, H., & Choi, S. (2020) · IEEE Access · doi:10.1109/access.2020.3009637 · Cited by 4
ReFloat: Low-Cost Floating-Point Processing in ReRAM for Accelerating Iterative Linear SolversPreprint
Song, L., Chen, F., Qian, X., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03190 · Cited by 1
Research works printed but not linked: 1
- 10.1109/isscc42614.2022.9731670 · DOI · Paper page
Cited by
A SCG-YOLOv8n potato counting framework with efficient mobile deployment
Du, L., Li, J., Yang, J., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-18754-9 · Cited by 2
“This compresses the model weights from 32-bit to 16-bit floating-point representations, significantly reducing usage and latency while incurring minimal performance degradation, as validated by prior studies 70–72 .”
Self-citationWu, Z.-Y., Ramesh, A. K., Bhukya, V. N., Wei, J., Sheu, S.-S., Hsin, Y.-C., & Tseng, Y. (2026) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2026.3692177
“This leads to significant energy overheads due to frequent data transfers, especially as model sizes scale [1].”
Sri Hari, A. S., & Arunachalam, V. (2026) · Integration · doi:10.1016/j.vlsi.2026.102898
Metadata
- Authors
- Tong, S.-Q., Bao, H., Li, J.-C., Yang, L., Zhou, H.-J., Li, Y., & Miao, X.-S.
- Affiliations
- Huazhong University of Science and Technology (CN)
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
- Venue
- IEEE Transactions on Electron Devices
- Published
- 2024-05
- Volume
- 71
- Issue
- 5
- Pages
- 3293-3300
- ISSN
- 0018-9383 (ISSN-L)
- 1557-9646
- OpenAlex
- W4393405604
- Cited by
- 3
- References
- 49
- Citations by year
- 2026: 2 · 2025: 1
- FWCI
- 0.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Electron Devices (publishedVersion)
- Funders
- National Key Research and Development Program of China (2022YFB4500100)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- memristor crossbar, bfloat16, in-memory computing, approximate computing, energy efficiency, device variability, line resistance, parasitic capacitance, VGG16, CIFAR-10
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.