AI and ML Accelerator Survey and Trends
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
This paper updates the survey of AI accelerators and processors from past three years. This paper collects and summarizes the current commercial accelerators that have been publicly announced with peak performance and power consumption numbers. The performance and power values are plotted on a scatter graph, and a number of dimensions and observations from the trends on this plot are again discussed and analyzed. Two new trends plots based on accelerator release dates are included in this year's paper, along with the additional trends of some neuromorphic, photonic, and memristor-based inference accelerators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the past few years, some companies and universities have presented application specific integrated circuits (ASICs) based on the complementary metal oxide semiconductor (CMOS) technology that are capable to compute and store information in the same unit.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [22]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
1.1 Computing's energy problem (and what we can do about it)
Horowitz, M. (2014) · 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC) · doi:10.1109/isscc.2014.6757323 · Cited by 2,069
The End of Moore's Law: A New Beginning for Information Technology
Theis, T. N., & Wong, H.-S. P. (2017) · Computing in Science & Engineering · doi:10.1109/mcse.2017.29 · Cited by 996
An Analysis of Deep Neural Network Models for Practical Applications
Canziani, A., Paszke, A., & Culurciello, E. (2016) · arXiv · doi:10.48550/arxiv.1605.07678 · Cited by 969 · cited 1×
“As in past years, this paper continues with last year’s focus on accelerators and processors that are geared toward deep neural networks (DNNs) and convolutional neural networks (CNNs) as they are quite computationally intense [12].”
BackgroundA new golden age for computer architecture
Hennessy, J. L., & Patterson, D. A. (2019) · Communications of the ACM · doi:10.1145/3282307 · Cited by 690
Advancing Neuromorphic Computing With Loihi: A Survey of Results and Outlook
Davies, M., Wild, A., Orchard, G., Sandamirskaya, Y., Guerra, G. A. F., Joshi, P., Plank, P., & Risbud, S. R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3067593 · Cited by 688
Artificial neural networks in hardware: A survey of two decades of progress
Misra, J., & Saha, I. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.03.021 · Cited by 646
There’s plenty of room at the Top: What will drive computer performance after Moore’s law?
Leiserson, C. E., Thompson, N. C., Emer, J. S., Kuszmaul, B. C., Lampson, B. W., Sanchez, D., & Schardl, T. B. (2020) · Science · doi:10.1126/science.aam9744 · Cited by 469
A Survey of Accelerator Architectures for Deep Neural Networks
Chen, Y., Xie, Y., Song, L., Chen, F., & Tang, T. (2020) · Engineering · doi:10.1016/j.eng.2020.01.007 · Cited by 370
A Survey of Neuromorphic Computing and Neural Networks in Hardware
Schuman, C. D., Potok, T. E., Patton, R. M., Birdwell, J. D., Dean, M. E., Rose, G. S., & Plank, J. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06963 · Cited by 352
Efficient Neuromorphic Signal Processing with Loihi 2
Orchard, G., Frady, E. P., Rubin, D. B. D., Sanborn, S., Shrestha, S. B., Sommer, F. T., & Davies, M. (2021) · 2021 IEEE Workshop on Signal Processing Systems (SiPS) · doi:10.1109/sips52927.2021.00053 · Cited by 265
A domain-specific supercomputer for training deep neural networks
Jouppi, N. P., Yoon, D. H., Kurian, G., Li, S., Patil, N., Laudon, J., Young, C., & Patterson, D. (2020) · Communications of the ACM · doi:10.1145/3360307 · Cited by 258
Domain-specific hardware accelerators
Dally, W. J., Turakhia, Y., & Han, S. (2020) · Communications of the ACM · doi:10.1145/3361682 · Cited by 246
Compute Solution for Tesla's Full Self-Driving Computer
Talpes, E., Sarma, D. D., Venkataramanan, G., Bannon, P., McGee, B., Floering, B., Jalote, A., Hsiong, C., Arora, S., Gorti, A., et al. (2020) · IEEE Micro · doi:10.1109/mm.2020.2975764 · Cited by 193
Efficient Processing of Deep Neural Networks
Sze, V., Chen, Y., Yang, T.-J., & Emer, J. (2020) · Synthesis lectures on computer architecture · doi:10.2200/s01004ed1v01y202004cac050 · Cited by 184
1.1 Deep Learning Hardware: Past, Present, and Future
LeCun, Y. (2019) · 2019 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2019.8662396 · Cited by 182
Survey and Benchmarking of Machine Learning Accelerators
Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J. (2019) · 2019 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec.2019.8916327 · Cited by 175
Self-citationA domain-specific architecture for deep neural networks
Jouppi, N. P., Young, C., Patil, N., & Patterson, D. (2018) · Communications of the ACM · doi:10.1145/3154484 · Cited by 166
Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going
Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W., Cheung, P. Y. K., & Constantinides, G. A. (2020) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 166
Survey of Machine Learning Accelerators
Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J. (2020) · 2020 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec43674.2020.9286149 · Cited by 163
Self-citationEfficient Processing of Deep Neural Networks
Sze, V., Chen, Y., Yang, T.-J., & Emer, J. (2020) · Synthesis lectures on computer architecture · doi:10.1007/978-3-031-01766-7 · Cited by 162
Think Fast: A Tensor Streaming Processor (TSP) for Accelerating Deep Learning Workloads
Abts, D., Ross, J., Sparling, J., Wong-VanHaren, M., Baker, M., Hawkins, T., Bell, A., Thompson, J., Kahsai, T., Kimmell, G., et al. (2020) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca45697.2020.00023 · Cited by 160
James, C. D., Aimone, J. B., Miner, N. E., Vineyard, C. M., Rothganger, F. H., Carlson, K. D., Mulder, S. A., Draelos, T. J., Faust, A., Marinella, M. J., et al. (2017) · Biologically Inspired Cognitive Architectures · doi:10.1016/j.bica.2016.11.002 · Cited by 153
AI Accelerator Survey and Trends
Reuther, A., Michaleas, P. W., Jones, M. P., Gadepally, V. N., Samsi, S., & Kepner, J. (2021) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec49654.2021.9622867 · Cited by 124
Self-citationThe decline of computers as a general purpose technology
Thompson, N., & Spanuth, S. (2021) · Communications of the ACM · doi:10.1145/3430936 · Cited by 116
A Survey on Silicon Photonics for Deep Learning
Sunny, F., Taheri, E., Nikdast, M., & Pasricha, S. (2021) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3459009 · Cited by 114
DLA: Compiler and FPGA Overlay for Neural Network Inference Acceleration
Abdelfattah, M. S., Han, D., Bitar, A., DiCecco, R., O'Connell, S., Shanker, N., Chu, J., Prins, I., Fender, J., Ling, A. C., et al. (2018) · 2018 28th International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2018.00077 · Cited by 88
Dissecting the Graphcore IPU Architecture via Microbenchmarking
Jia, Z., Tillman, B., Maggioni, M., & Scarpazza, D. P. (2019) · arXiv · doi:10.48550/arxiv.1912.03413 · Cited by 83
Fast Stencil-Code Computation on a Wafer-Scale Processor
Rocki, K., Essendelft, D. T. V., Sharapov, I., Schreiber, R., Morrison, M., Kibardin, V., Portnoy, A., Dietiker, J.-F., Syamlal, M., & James, M. (2020) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41405.2020.00062 · Cited by 70
Viale, A., Marchisio, A., Martina, M., Masera, G., & Shafique, M. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533738 · Cited by 66
Accelerating Scientific Applications With SambaNova Reconfigurable Dataflow Architecture
Emani, M. K., Vishwanath, V., Adams, C., Papka, M. E., Stevens, R. L., Florescu, L., Jairath, S., Liu, W., Nama, T., & Sujeeth, A. K. (2021) · Computing in Science & Engineering · doi:10.1109/mcse.2021.3057203 · Cited by 61
Structural and Parametric Identification of Knowm Memristors
Ostrovskii, V. Y., Fedoseev, P. S., Bobrova, Y. O., & Бутусов, Д. (2021) · Nanomaterials · doi:10.3390/nano12010063 · Cited by 59
Medina, E., & Dagan, E. (2020) · IEEE Micro · doi:10.1109/mm.2020.2975185 · Cited by 58
Survey of neural network hardware
Lindsey, C. S., & Lindblad, T. (1995) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.205116 · Cited by 49
High performance Monte Carlo simulation of ising model on TPU clusters
Yang, K., Chen, Y., Roumpos, G., Colby, C., & Anderson, J. (2019) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3295500.3356149 · Cited by 48
AI Chips: What They Are and Why They Matter
Center for Security and Emerging Technology, Khan, S., & Mann, A. (2020) · doi:10.51593/20190014 · Cited by 47
SambaNova SN10 RDU: A 7nm Dataflow Architecture to Accelerate Software 2.0
Prabhakar, R., Jairath, S., & Shin, J. L. (2022) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc42614.2022.9731612 · Cited by 44
AI Enabling Technologies: A SurveyPreprint
Gadepally, V. N., Goodwin, J. A., Kepner, J., Reuther, A., Reynolds, H. J. D., Samsi, S., Su, J. K., & Martinez, D. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03592 · Cited by 41
Self-citationLarge-Scale Discrete Fourier Transform on TPUs
Lu, T., Chen, Y., Hechtman, B. A., Wang, T., & Anderson, J. (2021) · IEEE Access · doi:10.1109/access.2021.3092312 · Cited by 41
Accelerating MRI Reconstruction on TPUs
Lu, T., Marin, T., Zhuo, Y., Chen, Y., & Ma, C. (2020) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec43674.2020.9286192 · Cited by 36
Large-scale distributed linear algebra with tensor processing units
Lewis, A. G. M., Beall, J., Ganahl, M., Hauru, M., Mallick, S. B., & Vidal, G. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2122762119 · Cited by 27
Nonuniform Fast Fourier Transform on Tpus
Lu, T., Marin, T., Zhuo, Y., Chen, Y., & Ma, C. (2021) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi48211.2021.9434068 · Cited by 25
3.3 Kunlun: A 14nm High-Performance AI Processor for Diversified Workloads
Ouyang, J., Du, X., Ma, Y., & Liu, J. (2021) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc42613.2021.9366056 · Cited by 22
Using the Graphcore IPU for Traditional HPC ApplicationsPreprint
Louw, T. R., & McIntosh‐Smith, S. (2020) · Bristol Research (University of Bristol) · Cited by 21
Tensor Processing Units for Financial Monte Carlo
Belletti, F., King, D., Yang, K., Nelet, R., Shafi, Y., Shen, Y., & Anderson, J. (2020) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976137.2 · Cited by 20
8-bit Numerical Formats for Deep Neural Networks
Noune, B., Jones, P., Justus, D., Masters, D., & Luschi, C. (2022) · arXiv · doi:10.48550/arxiv.2206.02915 · Cited by 19
Accelerating physics simulations with tensor processing units: An inundation modeling example
Hu, R. L., Pierce, D. M., Shafi, Y., Boral, A., Anisimov, V., Nevo, S., & Chen, Y. (2022) · The International Journal of High Performance Computing Applications · doi:10.1177/10943420221102873 · Cited by 17
Molecular Dynamics Simulations on Cloud Computing and Machine Learning Platforms
Sharma, P., & Jadhao, V. (2021) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud53861.2021.00101 · Cited by 15
Benchmarking the MAX78000 artificial intelligence microcontroller for deep learning applications
Clay, M., Grecos, C., Shirvaikar, M. V., & Richey, B. (2022) · Real-Time Image Processing and Deep Learning · doi:10.1117/12.2622390 · Cited by 12
2023 IEEE Hot Chips 35 Symposium (HCS)
(2023) · doi:10.1109/hcs59251.2023 · Cited by 12
Digital neuromorphic chips for deep learning inference: a comprehensive study
Langroudi, H. F., Pandit, T., Indovina, M. A., & Kudithipudi, D. (2019) · SPIE Applications of Machine Learning · doi:10.1117/12.2529407 · Cited by 9
Light-in-the-loop: using a photonics co-processor for scalable training of neural networksPreprint
Launay, J., Poli, I., Müller, K., Carron, I., Daudet, L., Krząkała, F., & Gigan, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01475 · Cited by 9
High Performance Monte Carlo Simulation of Ising Model on TPU ClustersPreprint
Yang, K., Chen, Y., Roumpos, G., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11714 · Cited by 8
Barnell, M. D., Raymond, C., Wilson, M. S., Isereau, D., & Cicotta, C. (2020) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec43674.2020.9286246 · Cited by 7
Digital Neural Network Accelerators
Rueckert, U. (2020) · The frontiers collection · doi:10.1007/978-3-030-18338-7_12 · Cited by 5
Cottle, E., Michel, F., Wilson, J., New, N., & Kundu, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.09044 · Cited by 5
Microchips that mimic the human brain could make AI far more energy efficient
(2022) · AAAS Articles DO Group · doi:10.1126/science.add1074 · Cited by 1
Tensor Processing Units for Financial Monte CarloPreprint
Belletti, F., King, D., Yang, K., et al. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1906.02818 · Cited by 1
Research works printed but not linked: 116
- Gadepally, 2019, AI Enabling Technologies
- Liao, 2001, Neural Networks in Hardware: A Survey
- Rogers, 2021, An Academic’s Attempt to Clear the Fog of the Machine Learning Accelerator War - SIGARCH
- Roos, 2019, FPGA Acceleration Card Delivers on Bandwidth, Speed, and Flexibility
- 2018, aiWare3 Hardware IP Helps Drive Autonomous Vehicles To Production
- Merritt, 2019, Startup Accelerates AI at the Sensor
- Peng, 2019, Alibaba’s New AI Chip Can Process Nearly 80K Images Per Second
- Clarke, 2018, Indo-US Startup Preps Agent-based AI Processor
- Hamilton, 2018, AWS Inferentia Machine Learning Processor
- Evangelist, 2020, Deep dive into Amazon Inferentia: A Custom-Built Chip to Enhance ML and AI
- 2017, Taking a Deeper Look at AMD Radeon Instinct GPUs for Deep Learning
- Smith, 2018, AMD Announces Radeon Instinct MI60 & MI50 Accelerators Powered By 7nm Vega
- Schor, 2020, Arm Ethos is for Ubiquitous AI At the Edge
- Ward-Foxton, 2022, Axelera Demos AI Test Chip After Taping Out in Four Months
- Merritt, 2018, Baidu Accelerator Rises in AI
- Duckett, 2018, Baidu Creates Kunlun Silicon for AI
- Wheeler, 2019, Bitmain SoC Brings AI to the Edge
- Demler, 2020, Blaize Ignites Edge-AI Performance
- Wu, 2018, Chinese AI Chip Maker Cambricon Unveils New Cloud-Based Smart Chip
- Cutress, 2018, Cambricon, Maker of Hauwei’s Kirin NPU IP, Build a Big AI Chip and PCIe Card
- Gwennap, 2019, Kendryte Embeds AI for Surveillance
- Hock, 2019, Introducing the Cerebras CS-1, the Industry’s Fastest Artificial Intelligence Computer
- Trader, 2021, Cerebras Doubles AI Performance with Second-Gen 7nm Wafer Scale Engine
- 2019, Cornami Achieves Unprecedented Performance at Lowest Power Dissipation for Deep Neural Networks
- Clarke, 2019, GlobalFoundries Aids Launch of Chinese AI Startup
- Mehta, Performance Estimation and Benchmarks for Real-World Edge Inference Applications
- 2019, Edge TPU
- Teich, 2018, Tearing Apart Google’s TPU 3.0 AI Coprocessor
- Jouppi, Ten Lessons From Three Generations Shaped Google’s TPUv4i, 1
- Peckham, 2022, Google Cloud’s New TPU v4 ML Hub Packs 9 Exaflops of AI
- Gwennap, 2020, Groq Rocks Neural Networks
- Lacey, 2017, Preliminary IPU Benchmarks
- 2020, Dell DSS8440 Graphcore IPU Server
- Ward-Foxton, 2020, Graphcore Takes on Nvidia with Second-Gen AI Accelerator
- Tyson, 2022, Graphcore Bow IPU Introduces TSMC 3D Wafer-on-Wafer Processor
- 2020, GAP Application Processors
- Turley, 2020, GAP9 for ML at the Edge EEJournal
- Hemsoth, 2020, Groq Shares Recipe for TSP Nodes, Systems
- Ward-Foxton, 2019, Gyrfalcon Unveils Fourth AI Accelerator Chip - EE Times
- 2020, SolidRun, Gyrfalcon Develop Arm-based Edge Op-timized AI Inference Server
- Gwennap, 2019, Habana Offers Gaudi for AI Training
- Gwennap, 2019, Habana Wins Cigar for AI Inference
- Ward-Foxton, 2019, Details of Hailo AI Edge Accelerator Emerge
- 2020, Horizon Robotics Journey2 Automotive AI Processor Series
- 2020, Ascend 310 AI Processor
- 2020, Ascend 910 AI Processor
- Hemsoth, 2018, Intel FPGA Architecture Focuses on Deep Learning Inference
- Hruska, 2017, New Movidius Myriad X VPU Packs a Custom Neural Compute Engine
- De Gelas, 2019, Intel’s Xeon Cascade Lake vs. NVIDIA Turing: An Analysis in AI
- 2020, Intel Xeon Platinum 8180
- 2020, Intel Xeon Platinum 8280
- Dupont de Dinechin, Kalray’s MPPA® Manycore Processor: At the Heart of Intelligent Systems
- Clarke, 2020, NXP, Kalray Demo Coolidge Parallel Processor in ’BlueBox
- Ward-Foxton, 2020, Kneron’s Next-Gen Edge AI Chip Gets $40m Boost
- 2021, Kneron Attracts Strategic Investors
- 2020, Maxim Debuts Homegrown AI Accelerator in Latest ULP SoC
- Jani, 2021, Maxim Showcases Efficient Custom AI
- Morgan, 2017, Drilling Into Microsoft’s BrainWave Soft Deep Learning Chip
- Ward-Foxton, 2021, Mythic Resizes its AI Chip
- Hemsoth, 2018, A Mythic Approach to Deep Learning Inference
- Fick, 2018, Mythic @ Hot Chips 2018
- Freund, 2019, NovuMind: An Early Entrant in AI Silicon
- Yoshida, 2018, NovuMind’s AI Chip Sparks Controversy
- Morgan, 2021, Nvidia Rounds Out “Ampere” Lineup With Two New Accelerators
- Krashinsky, 2020, NVIDIA Ampere Architecture In-Depth
- Need, 2017, CoRR, abs/1706.0
- Cutress, 2018, NVIDIA’s DGX-2: Sixteen Tesla V100s, 30TB of NVMe, Only $400K
- Campa, 2020, Defining AI Innovation with NVIDIA DGX A100
- Smith, 2022, NVIDIA Hopper GPU Architecture and H100 Accelerator Announced: Working Smarter and Harder
- 2019, NVIDIA Gives Jetson AGX Xavier a Trim, Announces Nano-Sized Jetson Xavier NX
- Funk, 2022, NVIDIA Jetson AGX Orin: The Next-Gen Platform That Will Power Our AI Robot Overlords Unveiled
- 2022, Jetson AGX Orin for Next-Gen Robotics
- Franklin, 2017, NVIDIA Jetson TX2 Delivers Twice the Intelligence to the Edge
- Hill, 2022, NVIDIA Unveils Ampere-Infused DRIVE AGX For Autonomous Cars, Isaac Robotics Platform With BMW Partnership
- NVIDIA Tesla P100
- Smith, 2018, 16GB NVIDIA Tesla V100 Gets Reprieve; Remains in Production
- Kilgariff, 2018, NVIDIA Turing Architecture In-Depth
- 2019, NVIDIA Tesla V100 Tensor Core GPU
- McGregor, 2020, Perceive Exits Stealth With Super Efficient Machine Learning Chip For Smarter Devices
- Schor, 2017, The 2,048-core PEZY-SC2 Sets a Green500 Record
- 2020, MN-Core
- Cutress, 2019, Preferred Networks: A 500 W Custom PCIe Card using 3000 mm2 Silicon
- Firu, 2019, Quadric Edge Supercomputer
- Ward-Foxton, 2020, Qualcomm Cloud AI 100 Promises Impressive Performance per Watt for Near-Edge AI
- McGrath, 2019, Qualcomm Targets AI Inferencing in the Cloud
- 2018, Rockchip Released Its First AI Processor RK3399Pro NPU Performance Up to 2.4TOPs
- Gwennap, 2020, Machine Learning Moves to the Edge
- McGrath, 2018, Tech Heavyweights Back AI Chip Startup
- Merritt, 2018, Startup Rolls AI Chips for Audio
- Shilov, 2022, Tachyum Teases 128-Core CPU: 5.7 GHz, 950W, 16 DDR5 Channels
- Gwennap, 2020, Tenstorrent Scales AI Performance: Architecture Leads in Data-Center Power Efficiency
- 2020, FSD Chip - Tesla
- Ward-Foxton, 2021, TI’s First Automotive SoC with an AI Accelerator Launches
- 2021, TDA4VM Jacinto Processors for ADAS and Autonomous Vehicles
- Demler, 2020, TI Jacinto Accelerates Level 3 ADAS
- Merritt, 2019, Samsung, Toshiba Detail AI Chips
- Gwennap, 2020, Untether Delivers At-Memory AI
- Hilson, 2022, Startup Tachyum Offers Universal Processor for Evaluation
- Toon, 2020, Introducing 2nd Generation IPU Systems for AI at Scale
- Lunden, 2020, Graphcore Unveils New GC200 Chip and the Expandable M2000 IPU Machine That Runs on Them
- Ward-Foxton, 2020, SambaNova Emerges From Stealth With Record-Breaking AI System
- Prabhakar, SambaNova SN10 RDU: Accelerating Software 2.0 with Dataflow, 1
- Peckham, 2022, Intel’s Habana Labs Unveils Gaudi2, Greco AI Processors
- Morgan, 2022, Intel Pits New Gaudi2 AI Training Engine Against Nvidia GPUs
- Martin, 2022, Samsung, Others Test Esperanto’s 1,000-Core RISC-V AI Chip
- Freund, 2021, Esperanto Launches AI Accelerator with over 1000 RISCV Cores
- Peckham, 2021, Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip
- Shilov, 2021, Via Shutters Centaur Technology Site, Sells Off Equipment
- Burt, 2022, Chip Makers Press For Standardized FP8 Format For AI
- Ward-Foxton, 2021, Innatera Unveils Neuromorphic AI Chip to Accelerate Spiking Networks
- Levy, 2021, Innatera’s Spiking Neural Processor
- Ward-Foxton, 2020, Optical Compute Promises Game-Changing AI Performance
- 2021, Optical Chip Solves Hardest Math Problems Faster than GPUs
- Wilson, 2020, The Multiply and Fourier Transform Unit: A Micro-Scale Optical Processor
- Schneider, 2019, A Neural-Net Based on Light Could Best Digital Computers
- Choi, 2022, Photonic Chip Performs Image Recognition at the Speed of Light
Cited by
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
Recent Advances and Future Prospects for Memristive Materials, Devices, and Systems
Song, M.-K., Kang, J.-H., Zhang, X., Ji, W., Ascoli, A., Messaris, I., Demirkol, A. S., Dong, B., Aggarwal, S., Wan, W., et al. (2023) · ACS Nano · doi:10.1021/acsnano.3c03505 · Cited by 300
Intelligent Computing: The Latest Advances, Challenges, and Future
Zhu, S., Yu, T., Xu, T., Chen, H., Dustdar, S., Gigan, S., Gunduz, D., Hossain, E., Jin, Y., Lin, F., et al. (2023) · Intelligent Computing · doi:10.34133/icomputing.0006 · Cited by 290
A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms
Silvano, C., Ielmini, D., Ferrandi, F., Fiorin, L., Curzel, S., Benini, L., Conti, F., Garofalo, A., Zambelli, C., Calore, E., et al. (2025) · ACM Computing Surveys · doi:10.1145/3729215 · Cited by 262
DGEMM on integer matrix multiplication unit
Ootomo, H., Ozaki, K., & Yokota, R. (2024) · The International Journal of High Performance Computing Applications · doi:10.1177/10943420241239588 · Cited by 82
Metadata
- Authors
- Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J.
- Affiliations
- MIT Lincoln Laboratory (US)
- Venue
- 2022 IEEE High Performance Extreme Computing Conference (HPEC)
- Publisher
- IEEE
- Published
- 2022-09-19
- Pages
- 1-10
- OpenAlex
- W4308090791
- Cited by
- 109
- References
- 58
- Citations by year
- 2026: 25 · 2025: 29 · 2024: 30 · 2023: 23 · 2022: 2
- FWCI
- 16.89
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE High Performance Extreme Computing Conference (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- AI accelerators, machine learning accelerators, peak performance, power consumption, power-performance tradeoff, neuromorphic processors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.