Energy-Efficient Brain Floating Point Convolutional Neural Network Using Memristors
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
In this article, a memristor-based convolutional neural network (CNN) is implemented to achieve both brain floating point (BF16) processing accuracy and high energy efficiency for cloud artificial intelligence (AI) acceleration for the first time. A low-cost in-memory floating-point (FP) computing arithmetic is developed with an approximate computing technique, which sufficiently considers the requirement of both efficiency and accuracy in FP-CNN applications. For further optimization, we investigate the impact of nonideal effects at the device and array level (including the device variation, line resistance, array parasitic capacitance, etc.) on analog computing. Based on these, a bit-weight slicing technique is employed for highly efficient and accurate FP computing within the memristor crossbar array. Meanwhile, an in-memory convolutional operating method is proposed to further reduce the hardware overhead in deploying large-scale CNNs for complex datasets. By combining the above strategies, we evaluate the performance of memristor-implemented BF16-CNNs using the VGG-16 network on the CIFAR-10 dataset. An 85.47% classification accuracy with 1.987 TFLOPS/W energy efficiency and 20.9895 GFLOPS/mm2 area efficiency is obtained.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
In-memory computing with resistive switching devices
Ielmini, D., & Wong, H.-S. P. (2018) · Nature Electronics · doi:10.1038/s41928-018-0092-2 · Cited by 2,298 · cited 1×
“In recent years, memristor-based in-memory computing (IMC) has demonstrated the potential to address the above issues [4], [5], [6], [7].”
BackgroundMemory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179 · cited 3×
“By executing the high parallel matrix-vector multiplication (MVM) using the analog computing mechanism inside the memristor crossbar array [8], [9], IMC can substantially eliminate data movement and perform CNNs with high efficiency [10], [11].”
MethodMemristive crossbar arrays for brain-inspired computing
Xia, Q., & Yang, J. J. (2019) · Nature Materials · doi:10.1038/s41563-019-0291-x · Cited by 1,800 · cited 1×
“However, memristor-enabled IMC suffered from limited computing accuracy due to the inner trade-off of the analog computing mechanism such as the conductance variation [12] and various array parasitic effects [6], [13].”
BackgroundISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Resistive switching materials for information processing
Wang, Z., Wu, H., Burr, G. W., Hwang, C. S., Wang, K. L., Xia, Q., & Yang, J. J. (2020) · Nature Reviews Materials · doi:10.1038/s41578-019-0159-3 · Cited by 1,214 · cited 1×
“In recent years, memristor-based in-memory computing (IMC) has demonstrated the potential to address the above issues [4], [5], [6], [7].”
BackgroundEquivalent-accuracy accelerated neural-network training using analogue memory
Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R. M., Boybat, I., di Nolfo, C., Sidler, S., Giordano, M., Bodini, M., Farinha, N. C. P., et al. (2018) · Nature · doi:10.1038/s41586-018-0180-5 · Cited by 1,151
Towards artificial general intelligence with hybrid Tianjic chip architecture
Pei, J., Deng, L., Song, S., Zhao, M., Zhang, Y., Wu, S., Wang, G., Zou, Z., Wu, Z., He, W., et al. (2019) · Nature · doi:10.1038/s41586-019-1424-8 · Cited by 1,082 · cited 1×
“Here, we mainly discuss the mapping method of convolutional layers [41].”
MethodA compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Research works printed but not linked: 1
- 10.1109/isscc42614.2022.9731670 · DOI · Paper page
Cited by
A SCG-YOLOv8n potato counting framework with efficient mobile deployment
Du, L., Li, J., Yang, J., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-18754-9 · Cited by 2
“This compresses the model weights from 32-bit to 16-bit floating-point representations, significantly reducing usage and latency while incurring minimal performance degradation, as validated by prior studies 70–72 .”
Self-citationWu, Z.-Y., Ramesh, A. K., Bhukya, V. N., Wei, J., Sheu, S.-S., Hsin, Y.-C., & Tseng, Y. (2026) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2026.3692177
“This leads to significant energy overheads due to frequent data transfers, especially as model sizes scale [1].”
Sri Hari, A. S., & Arunachalam, V. (2026) · Integration · doi:10.1016/j.vlsi.2026.102898
Metadata
- Authors
- Tong, S.-Q., Bao, H., Li, J.-C., Yang, L., Zhou, H.-J., Li, Y., & Miao, X.-S.
- Affiliations
- Huazhong University of Science and Technology (CN)
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
- Venue
- IEEE Transactions on Electron Devices
- Published
- 2024-05
- Volume
- 71
- Issue
- 5
- Pages
- 3293-3300
- ISSN
- 0018-9383 (ISSN-L)
- 1557-9646
- OpenAlex
- W4393405604
- Cited by
- 3
- References
- 49
- Citations by year
- 2026: 2 · 2025: 1
- FWCI
- 0.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Electron Devices (publishedVersion)
- Funders
- National Key Research and Development Program of China (2022YFB4500100)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- memristor crossbar, bfloat16, in-memory computing, approximate computing, energy efficiency, device variability, line resistance, parasitic capacitance, VGG16, CIFAR-10
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.