Neural inference at the frontier of energy, space, and time
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Computing, since its inception, has been processor-centric, with memory separated from compute. Inspired by the organic brain and optimized for inorganic silicon, NorthPole is a neural inference architecture that blurs this boundary by eliminating off-chip memory, intertwining compute with memory on-chip, and appearing externally as an active memory chip. NorthPole is a low-precision, massively parallel, densely interconnected, energy-efficient, and spatial computing architecture with a co-optimized, high-utilization programming model. On the ResNet50 benchmark image classification network, relative to a graphics processing unit (GPU) that uses a comparable 12-nanometer technology process, NorthPole achieves a 25 times higher energy metric of frames per second (FPS) per watt, a 5 times higher space metric of FPS per transistor, and a 22 times lower time metric of latency. Similar results are reported for the Yolo-v4 detection network. NorthPole outperforms all prevalent architectures, even those that use more-advanced technology processes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“NorthPole is a custom architecture developed by IBM and supports up to 1,048,576 neurons per chip.”
From HiAER-spike software-hardware reconfigurable platform for event-driven neuromorphic computing at scale (2026) · cites this paper as [6]
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Deep High-Resolution Representation Learning for Visual Recognition
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2983686 · Cited by 4,894
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
A million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Self-citationBackus, J. (1978) · Communications of the ACM · doi:10.1145/359576.359579 · Cited by 2,609
The columnar organization of the neocortex
Mountcastle, V. (1997) · Brain · doi:10.1093/brain/120.4.701 · Cited by 2,247
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
1.1 Computing's energy problem (and what we can do about it)
Horowitz, M. (2014) · 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC) · doi:10.1109/isscc.2014.6757323 · Cited by 2,069
Analog VLSI Implementation of Neural Systems
(1989) · The Kluwer International Series in Engineering and Computer Science · doi:10.1007/978-1-4613-1639-8 · Cited by 1,680
A survey of research and practices of Network-on-chip
Bjerregaard, T., & Mahadevan, S. (2006) · ACM Computing Surveys · doi:10.1145/1132952.1132953 · Cited by 1,648
Hitting the memory wall: implications of the obvious
Wulf, W. A., & McKee, S. A. (1995) · ACM SIGARCH Computer Architecture News · doi:10.1145/216585.216588 · Cited by 1,624
First draft of a report on the EDVAC
von Neumann, J. (1993) · IEEE Annals of the History of Computing · doi:10.1109/85.238389 · Cited by 1,112
A compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Convolutional networks for fast, energy-efficient neuromorphic computing
Esser, S. K., Merolla, P. A., Arthur, J. V., Cassidy, A. S., Appuswamy, R., Andreopoulos, A., Berg, D. J., McKinstry, J. L., Melano, T., Barch, D. R., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1604850113 · Cited by 781
Self-citationMagnetic control of tokamak plasmas through deep reinforcement learning
Degrave, J., Felici, F., Buchli, J., Neunert, M., Tracey, B., Carpanese, F., Ewalds, T., Hafner, R., Abdolmaleki, A., de las Casas, D., et al. (2022) · Nature · doi:10.1038/s41586-021-04301-9 · Cited by 751
There’s plenty of room at the Top: What will drive computer performance after Moore’s law?
Leiserson, C. E., Thompson, N. C., Emer, J. S., Kuszmaul, B. C., Lampson, B. W., Sanchez, D., & Schardl, T. B. (2020) · Science · doi:10.1126/science.aam9744 · Cited by 469
Sejnowski, T. J. (2018) · doi:10.7551/mitpress/11474.001.0001 · Cited by 438
Ten Lessons From Three Generations Shaped Google’s TPUv4i : Industrial Product
Jouppi, N. P., Hyun Yoon, D., Ashcraft, M., Gottscho, M., Jablin, T. B., Kurian, G., Laudon, J., Li, S., Ma, P., Ma, X., et al. (2021) · 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca52012.2021.00010 · Cited by 360
Nanoconnectomic upper bound on the variability of synaptic plasticity
Bartol, T. M., Bromer, C., Kinney, J., Chirillo, M. A., Bourne, J. N., Harris, K. M., & Sejnowski, T. J. (2015) · eLife · doi:10.7554/elife.10778 · Cited by 319
Network architecture of the long-distance pathways in the macaque brain
Modha, D. S., & Singh, R. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1008054107 · Cited by 283
Self-citationBackpropagation for energy-efficient neuromorphic computing
Esser, S. K., Appuswamy, R., Merolla, P. A., Arthur, J. V., & Modha, D. S. (2015) · neural information processing systems · Cited by 281
Self-citationGPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Frantar, E., Ashkboos, S., Hoefler, T., & Alistarh, D. (2022) · arXiv · doi:10.48550/arxiv.2210.17323 · Cited by 197
A Modern Primer on Processing in Memory
Mutlu, O., Ghose, S., Gómez-Luna, J., & Ausavarungnirun, R. (2023) · Computer Architecture and Design Methodologies · doi:10.1007/978-981-16-7487-7_7 · Cited by 168
Think Fast: A Tensor Streaming Processor (TSP) for Accelerating Deep Learning Workloads
Abts, D., Ross, J., Sparling, J., Wong-VanHaren, M., Baker, M., Hawkins, T., Bell, A., Thompson, J., Kahsai, T., Kimmell, G., et al. (2020) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca45697.2020.00023 · Cited by 160
Knowles, S. (2021) · IEEE Hot Chips Symposium · doi:10.1109/hcs52781.2021.9567075 · Cited by 120
Toward attojoule switching energy in logic transistors
Datta, S., Chakraborty, W., & Radosavljević, M. (2022) · Science · doi:10.1126/science.ade7656 · Cited by 106
Training Quantized Neural Networks With a Full-Precision Auxiliary Module
Zhuang, B., Liu, L., Tan, M., Shen, C., & Reid, I. D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00156 · Cited by 87
Embedded DRAM: Technology platform for the Blue Gene/L chip
Iyer, S. S., Barth, J., Parries, P., Norum, J. P., Rice, J., Logan, L. R., & Hoyniak, D. (2005) · IBM Journal of Research and Development · doi:10.1147/rd.492.0333 · Cited by 75
Three-dimensional integration: An industry perspective
Iyer, S. S. (2015) · MRS Bulletin · doi:10.1557/mrs.2015.32 · Cited by 69
Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning
Lie, S. (2023) · IEEE Micro · doi:10.1109/mm.2023.3256384 · Cited by 66
3.2 The A100 Datacenter GPU and Ampere Architecture
Choquette, J., Lee, E. A., Krashinsky, R., Balan, V., & Khailany, B. (2021) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc42613.2021.9365803 · Cited by 60
Khan, F., Cartier, E., Woo, J. C. S., & Iyer, S. S. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2633490 · Cited by 55
A Comprehensive Evaluation of Novel AI Accelerators for Deep Learning Workloads
Emani, M. K., Xie, Z., Raskar, S., Sastry, V. K., Arnold, W., Wilson, B., Thakur, R., Vishwanath, V., Liu, Z., Papka, M. E., et al. (2022) · IEEE/ACM International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS) · doi:10.1109/pmbs56514.2022.00007 · Cited by 50
Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Inference
McKinstry, J. L., Esser, S. K., Appuswamy, R., Bablani, D., Arthur, J. V., Yildiz, I. B., & Modha, D. S. (2019) · Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2) · doi:10.1109/emc2-nips53020.2019.00009 · Cited by 48
Self-citationMedina, E., & Dagan, E. (2020) · IEEE Micro · doi:10.1109/mm.2020.2975185 · Cited by 47
Topological Maps and Brain Computations From Low to High
Sereno, M. I., Sood, M. R., & Huang, R. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.787737 · Cited by 35
The AMD Next-Generation “Zen 3” Core
Evers, M., Barnes, L., & Clark, M. (2022) · IEEE Micro · doi:10.1109/mm.2022.3152788 · Cited by 25
Ditty, M. J. T. (2022) · IEEE Hot Chips Symposium · doi:10.1109/hcs55958.2022.9895609 · Cited by 23
3.3 Kunlun: A 14nm High-Performance AI Processor for Diversified Workloads
Ouyang, J., Du, X., Ma, Y., & Liu, J. (2021) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc42613.2021.9366056 · Cited by 22
SambaNova SN10 RDU:Accelerating Software 2.0 with Dataflow
Prabhakar, R., & Jairath, S. (2021) · IEEE Hot Chips Symposium · doi:10.1109/hcs52781.2021.9567250 · Cited by 20
Answer Fast: Accelerating BERT on the Tensor Streaming Processor
Ahmed, I., Parmar, S., Boyd, M., Beidler, M., Kang, K., Liu, B., Roach, K., Kim, J., & Abts, D. (2022) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap54787.2022.00022 · Cited by 16
Chatha, K. S. (2021) · IEEE Hot Chips Symposium · doi:10.1109/hcs52781.2021.9567417 · Cited by 14
The evolution of mathematical software
Dongarra, J. J. (2022) · Communications of the ACM · doi:10.1145/3554977 · Cited by 13
Exploring the Performance of Deep Neural Networks on Embedded Many-Core Processors
Yabe, T., & Azumi, T. (2022) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1109/iccps54341.2022.00024 · Cited by 10
Consolidating High-Integrity, High-Performance, and Cyber-Security Functions on a Manycore Processor
de Dinechin, B. D. (2019) · Proceedings - ACM IEEE Design Automation Conference · doi:10.1145/3316781.3323473 · Cited by 9
Research works printed but not linked: 8
- T. J. Sejnowski P. S. Churchland The Computational Brain (MIT Press 1994).
- N. C. Thompson K. Greenewald K. Lee G. F. Manso The computational limits of deep learning. arXiv:2007.05558 [cs.LG] (2020). · arXiv
- S. K. Esser J. L. McKinstry D. Bablani R. Appuswamy D. S. Modha “Learned step size quantization” in Eighth International Conference on Learning Representations (ICLR) (ICLR 2020).
- D. Bablani J. L. McKinstry S. K. Esser R. Appuswamy D. S. Modha Efficient and effective methods for mixed precision neural network quantization for faster energy-efficient inference. arXiv:2301.13330 [cs.LG] (2023). · arXiv
- G. Hinton O. Vinyals J. Dean Distilling the knowledge in a neural network. arXiv:1503.02531 [stat.ML] (2015). · arXiv
- A. Bochkovskiy C. Y. Wang H. Y. Liao YOLOv4: Optimal speed and accuracy of object detection. arXiv:2004.13934 [cs.CV] (2020). · arXiv
- R. Zhan X. Fan “NeuralScale: A RISC-V based neural processor boosting AI inference in clouds” in Fifth Workshop on Computer Architecture Research with RISC-V (CARRV 2021) (2021).
- M. Ditty A. Karandikar D. Reed “Nvidia’s Xavier SOC” in 2018 Hot Chips 30 Symposium (HCS) (2018).
Cited by
Neuromorphic computing at scale
Kudithipudi, D., Schuman, C., Vineyard, C. M., Pandit, T., Merkel, C., Kubendran, R., Aimone, J. B., Orchard, G., Mayr, C., Benosman, R., et al. (2025) · Nature · doi:10.1038/s41586-024-08253-8 · Cited by 357
Memristor-based hardware accelerators for artificial intelligence
Huang, Y., Ando, T., Sebastian, A., Chang, M., Yang, J. J., & Xia, Q. (2024) · Nature Reviews Electrical Engineering · doi:10.1038/s44287-024-00037-6 · Cited by 192
Two-Dimensional Materials for Brain-Inspired Computing Hardware
Hadke, S. S., Kang, M., Sangwan, V. K., & Hersam, M. C. (2025) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00631 · Cited by 112
Brain-Inspired Computing: A Systematic Survey and Future Trends
Li, G., Deng, L., Tang, H., Pan, G., Tian, Y., Roy, K., & Maass, W. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3429360 · Cited by 154
The road to commercial success for neuromorphic technologies
Muir, D. R., & Sheik, S. (2025) · Nature Communications · doi:10.1038/s41467-025-57352-1 · Cited by 96
Metadata
- Authors
- Modha, D. S., Akopyan, F., Andreopoulos, A., Appuswamy, R., Arthur, J. V., Cassidy, A. S., Datta, P., DeBole, M. V., Esser, S. K., Otero, C. O., Sawada, J., Taba, B., Amir, A., Bablani, D., Carlson, P. J., Flickner, M. D., Gandhasri, R., Garreau, G. J., Ito, M., Klamo, J. L., Kusnitz, J. A., McClatchey, N. J., McKinstry, J. L., Nakamura, Y., Nayak, T. K., Risk, W. P., Schleupen, K., Shaw, B., Sivagnaname, J., Smith, D. F., Terrizzano, I., & Ueda, T.
- Affiliations
- IBM (United States) (US)
- Corresponding author
- Modha, Dharmendra S.
- Akopyan, Filipp
- Andreopoulos, Alexander
- Appuswamy, Rathinakumar
- Arthur, John V.
- Cassidy, Andrew S.
- Datta, Pallab
- DeBole, Michael V.
- Esser, Steven K.
- Otero, Carlos Ortega
- Sawada, Jun
- Taba, Brian
- ORCID
- Modha, Dharmendra S.
- Akopyan, Filipp
- Andreopoulos, Alexander
- Cassidy, Andrew S.
- Datta, Pallab
- DeBole, Michael V.
- Esser, Steven K.
- Taba, Brian
- Amir, Arnon
- Bablani, Deepika
- Gandhasri, Rajamohan
- Garreau, Guillaume J.
- Ito, Megumi
- Klamo, Jennifer L.
- Nakamura, Yutaka
- Nayak, Tapan K.
- Risk, William P.
- Sivagnaname, Jay
- Terrizzano, Ignacio
- Ueda, Takanori
- Venue
- Science
- Published
- 2023-10-20
- Volume
- 382
- Issue
- 6668
- Pages
- 329-335
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4387772271
- Cited by
- 115
- References
- 47
- Citations by year
- 2026: 33 · 2025: 34 · 2024: 44 · 2023: 4
- FWCI
- 8.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- in-memory computing, memory-centric computing, low-precision arithmetic, energy efficiency, spatial computing, image classification, object detection, ResNet50, YOLOv4, programming models, neuromorphic hardware
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.