Dissecting the Graphcore IPU Architecture via Microbenchmarking
Open accessAbstract
This report focuses on the architecture and performance of the Intelligence Processing Unit (IPU), a novel, massively parallel platform recently introduced by Graphcore and aimed at Artificial Intelligence/Machine Learning (AI/ML) workloads. We dissect the IPU's performance behavior using microbenchmarks that we crafted for the purpose. We study the IPU's memory organization and performance. We study the latency and bandwidth that the on-chip and off-chip interconnects offer, both in point-to-point transfers and in a spectrum of collective operations, under diverse loads. We evaluate the IPU's compute power over matrix multiplication, convolution, and AI/ML primitives. We discuss actual performance in comparison with its theoretical limits. Our findings reveal how the IPU's architectural design affects its performance. Moreover, they offer simple mental models to predict an application's performance on the IPU, on the basis of the computation and communication steps it involves. This report is the natural extension to a novel architecture of a continuing effort of ours that focuses on the microbenchmark-based discovery of massively parallel architectures.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Resource-efficient computing devices that require less natural resources to build and use can be seen as an obvious gain in environmental impacts, and different hardware platforms are being developed as alternatives to GPUs and CPUs.
“Resource-efficient computing devices that require less natural resources (energy, water, raw materials) to build and use can be seen as an obvious gain in terms of environmental impacts, and different hardware platforms are being developed towards this end as an alternative to GPUs and CPUs, which represent the current status quo of AI computing hardware [61, 62].”
From From Efficiency Gains to Rebound Effects: The Problem of Jevons' Paradox in AI's Polarized Environmental Debate (2025) · cites this paper as [61]
The paper studies the Graphcore IPU as an alternative computing platform and reports in §5.1 (Matrix Multiplication; page unavailable) that one IPU was more energy-efficient than a V100 GPU on the tested matrix-multiplication workloads. It does not establish that such devices require less water or raw materials to build, or that they deliver an overall environmental gain. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
(2016) · Cited by 31,590 · see citing works
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465 · see citing works
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196 · see citing works
A Bridging Model for Parallel Computation
Valiant, L. G. (1990) · ACM eBooks · doi:10.1145/3749740.3749753 · Cited by 3,697 · see citing works
LogP: towards a realistic model of parallel computation
Culler, D., Karp, R. M., Patterson, D. A., Sahay, A., Schauser, K. E., Santos, E. E., Subramonian, R., & von Eicken, T. (1993) · ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · doi:10.1145/155332.155333 · Cited by 1,504 · see citing works
TestU01: A C library for empirical testing of random number generators
L'Ecuyer, P., & Simard, R. (2007) · ACM Transactions on Mathematical Software · doi:10.1145/1268776.1268777 · Cited by 1,014 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.00567 · Cited by 741 · see citing works
Alexandrov, A. D., Ionescu, M. F., Schauser, K. E., & Scheiman, C. J. (1995) · ACM Symposium on Parallelism in Algorithms and Architectures (SPAA) · doi:10.1145/215399.215427 · Cited by 488 · see citing works
Cell Multiprocessor Communication Network: Built for Speed
Kistler, M., Perrone, M., & Petrini, F. (2006) · IEEE Micro · doi:10.1109/mm.2006.49 · Cited by 392 · see citing works
Dissecting the NVIDIA Volta GPU Architecture via Microbenchmarking
Jia, Z., Maggioni, M., Staiger, B., & Scarpazza, D. P. (2018) · arXiv · doi:10.48550/arxiv.1804.06826 · Cited by 233 · see citing works
Self-citationParallel random numbers: as easy as 1, 2, 3
Salmon, J. K., Moraes, M. A., Dror, R. O., & Shaw, D. E. (2011) · Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1145/2063384.2063405 · Cited by 227 · see citing works
Scrambled Linear Pseudorandom Number Generators
Blackman, D., & Vigna, S. (2021) · ACM Transactions on Mathematical Software · doi:10.1145/3460772 · Cited by 133 · see citing works
Microbenchmark performance comparison of high-speed cluster interconnects
Liu, J., Chandrasekaran, B., Yu, W., Wu, J., Darius Buntinas, A., Kini, S. P., Panda, D. K. D., & Wyckoff, P. (2004) · IEEE Micro · doi:10.1109/mm.2004.1268994 · Cited by 94 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [2][2] Z. Jia, M. Maggioni, J. Smith, and D. P. Scarpazza, 'Dissecting the NVidia Turing T4 GPU architecture via microbenchmarking,' 2019. [Online]. Available: https://arxiv.org/abs/1903.07486 - · arXiv
Cited by
Sorted by citations
Pruning and quantization for deep neural network acceleration: A survey
Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 969 · see citing works
Embedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 662 · see citing works
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Dao, T., Fu, D. Y., Ermon, S., Rudra, A., & Ré, C. (2022) · arXiv · doi:10.48550/arxiv.2205.14135 · Cited by 1,214 · see citing works
“Performance on other hardware accelerators are similar [48, 50].”
BackgroundThe Deep Learning Compiler: A Comprehensive Survey
Li, M., Liu, Y., Liu, X., Sun, Q., You, X., Yang, H.-L., Luan, Z.-Z., Gan, L., Yang, G.-W., & Qian, D. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3030548 · Cited by 261 · see citing works
AEGNN: Asynchronous Event-based Graph Neural Networks
Schaefer, S., Gehrig, D., & Scaramuzza, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01205 · Cited by 169 · see citing works
A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms
Silvano, C., Ielmini, D., Ferrandi, F., Fiorin, L., Curzel, S., Luca Benini, C., Conti, F., Garofalo, A., Zambelli, C., Calore, E., et al. (2025) · ACM Computing Surveys · doi:10.1145/3729215 · Cited by 170 · see citing works
AI and ML Accelerator Survey and Trends
Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J. (2022) · 2022 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec55821.2022.9926331 · Cited by 109 · see citing works
Accelerating CNN Inference on ASICs: A Survey
Moolchandani, D., Kumar, A., & Sarangi, S. R. (2020) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2020.101887 · Cited by 90 · see citing works
AKG: automatic kernel generation for neural processing units using polyhedral transformations
Zhao, J., Li, B., Nie, W., Geng, Z., Zhang, R., Gao, X., Cheng, B., Wu, C. H., Cheng, Y., Li, Z., et al. (2021) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3453483.3454106 · Cited by 84 · see citing works
Beyond Peak Performance: Comparing the Real Performance of AI-Optimized FPGAs and GPUs
Boutros, A., Nurvitadhi, E., Ma, R., Gribok, S., Zhao, Z., Hoe, J. C., Betz, V., & Langhammer, M. (2020) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/icfpt51103.2020.00011 · Cited by 78 · see citing works
Luccioni, A. S., Strubell, E., & Crawford, K. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732007 · Cited by 71 · see citing works
Lee, J., Mukhanov, L., Molahosseini, A. S., Minhas, U. I., Yang, H., del Rincón, J. M., Dichev, K., Hong, C.-H., & Vandierendonck, H. (2023) · ACM Computing Surveys · doi:10.1145/3587095 · Cited by 55 · see citing works
Bundle Adjustment on a Graph Processor
Ortiz, J., Pupilli, M., Leutenegger, S., & Davison, A. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00249 · Cited by 35 · see citing works
Not All GPUs Are Created Equal: Characterizing Variability in Large-Scale, Accelerator-Rich Systems
Sinha, P., Guliani, A., Jain, R., Tran, B., Sinclair, M. D., & Venkataraman, S. (2022) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41404.2022.00070 · Cited by 34 · see citing works
Pipelined Backpropagation at Scale: Training Large Models without BatchesPreprint
Kosson, A., Chiley, V., Venigalla, A., Hestness, J., & Koster, U. (2020) · Conference on Machine Learning and Systems · doi:10.48550/arxiv.2003.11666 · Cited by 39 · see citing works
Zhang, Z., & Zohren, S. (2021) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2105.10430 · Cited by 20 · see citing works
Gepner, P. (2021) · Annals of Computer Science and Information Systems · doi:10.15439/2021f004 · Cited by 18 · see citing works
Accelerating Simulation-based Inference with Emerging AI Hardware
Kulkarni, S., Tsyplikhin, A., Krell, M. M., & Moritz, C. A. (2020) · IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc2020.2020.00003 · Cited by 17 · see citing works
Manticore: Hardware-Accelerated RTL Simulation with Static Bulk-Synchronous Parallelism
Emami, M., Kashani, S., Kamahori, K., Pourghannad, M. S., Raj, R., & Larus, J. R. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3623278.3624750 · Cited by 17 · see citing works
Raman, S. R. S., Xie, S., & Kulkarni, J. P. (2022) · IEEE Journal on Exploratory Solid-State Computational Devices and Circuits · doi:10.1109/jxcdc.2022.3188366 · Cited by 16 · see citing works
Single Flux Quantum Based Ultrahigh Speed Spiking Neuromorphic Processor ArchitecturePreprint
Bozbey, A., Karamuftuoglu, M. A., Razmkhah, S., & Özbayoğlu, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.10354 · Cited by 15 · see citing works
Photonic Reconfigurable Accelerators for Efficient Inference of CNNs With Mixed-Sized Tensors
Vatsavai, S. S., & Thakkar, I. G. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3197538 · Cited by 13 · see citing works
GPU Domain Specialization via Composable On-Package Architecture
Fu, Y., Bolotin, E., Chatterjee, N., Nellans, D. W., & Keckler, S. W. (2021) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3484505 · Cited by 14 · see citing works
Scalable, Programmable and Dense: The HammerBlade Open-Source RISC-V Manycore
Jung, D. C., Ruttenberg, M., Gao, P., Davidson, S., Petrisko, D., Li, K., Kamath, A. K., Cheng, L., Xie, S., Pan, P., et al. (2024) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca59077.2024.00061 · Cited by 11 · see citing works
Energy-efficient neural networks with near-threshold processors and hardware accelerators
Nunez-Yanez, J. L., & Howard, N. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102062 · Cited by 11 · see citing works
iPUG: Accelerating Breadth-First Graph Traversals Using Manycore Graphcore IPUs
Burchard, L., Moe, J., Schroeder, D. T., Pogorelov, K., & Langguth, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78713-4_16 · Cited by 11 · see citing works
Studying the potential of Graphcore IPUs for applications in Particle PhysicsPreprint
Mohan, L. R. M., Marshall, A. M., Maddrell-Mander, S., O’Hanlon, D. P., Petridis, K. A., Rademacker, J. H., Rege, V., & Titterton, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.09210 · Cited by 11 · see citing works
MP-Rec: Hardware-Software Co-design to Enable Multi-path Recommendation
Hsia, S., Gupta, U., Acun, B., Ardalani, N., Zhong, P., Wei, G.-Y., Brooks, D. M., & Wu, C.-J. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3582016.3582068 · Cited by 10 · see citing works
HASP: Hierarchical Asynchronous Parallelism for Multi-NN Tasks
Li, H., Ma, S., Wang, T., Zhang, W., Wang, G., Song, C., Qu, H., Lin, J., Ma, C., Pei, J., et al. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3329937 · Cited by 10 · see citing works
Parallel Training of Deep Networks with Local UpdatesPreprint
Laskin, M., Metz, L., Nabarrao, S., Saroufim, M., Noune, B., Luschi, C., Sohl-Dickstein, J. N., & Abbeel, P. (2020) · arXiv.org · doi:10.48550/arxiv.2012.03837 · Cited by 35 · see citing works
Sparse and dense matrix multiplication hardware for heterogeneous multi-precision neural networks
Nunez-Yanez, J. L., & Hosseinabady, M. (2021) · Array · doi:10.1016/j.array.2021.100101 · Cited by 9 · see citing works
Hardware-accelerated Simulation-based Inference of Stochastic Epidemiology Models for COVID-19
Kulkarni, S., Krell, M. M., Nabarro, S., & Moritz, C. A. (2022) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3471188 · Cited by 9 · see citing works
Eidetic: An In-Memory Matrix Multiplication Accelerator for Neural Networks
Eckert, C. A., Subramaniyan, A. K., Wang, X., Augustine, C., Iyer, R., & Das, R. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3214151 · Cited by 9 · see citing works
Rościszewski, P., Krzywaniak, A., Iserte, S., Rojek, K., & Gepner, P. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.05.004 · Cited by 9 · see citing works
Space Efficient Sequence Alignment for SRAM-Based Computing: X-Drop on the Graphcore IPU
Burchard, L., Zhao, M., Langguth, J., Buluç, A., & Guidi, G. (2023) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3581784.3607094 · Cited by 9 · see citing works
Graphcore C2 Card performance for image-based deep learning application: A ReportPreprint
Kacher, I., Portaz, M., Randrianarivo, H., & Sylvain Peyronnet, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11670 · Cited by 9 · see citing works
SongC: A Compiler for Hybrid Near-Memory and In-Memory Many-Core Architecture
Lin, J., Qu, H., Ma, S., Ji, X., Li, H., Li, X., Song, C., & Zhang, W. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3311948 · Cited by 8 · see citing works
Tricking AI chips into simulating the human brain: A detailed performance analysis
Landsmeer, L. P. L., Engelen, M., Miedema, R., & Strydis, C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127953 · Cited by 8 · see citing works
Burchard, L., Cai, X. H., & Langguth, J. (2021) · IEEE International Conference on High Performance Computing, Data, and Analytics · doi:10.1109/hipc53243.2021.00030 · Cited by 8 · see citing works
Caffe Barista: Brewing Caffe with FPGAs in the Training Loop
Vink, D. A., Rajagopal, A., Venieris, S. I., & Bouganis, C.-S. (2020) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl50879.2020.00059 · Cited by 8 · see citing works
P arendi : Thousand-Way Parallel RTL Simulation
Emami, M., Bourgeat, T., & Larus, J. R. (2025) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3676641.3716010 · Cited by 7 · see citing works
A Construction Kit for Efficient Low Power Neural Network Accelerator Designs
Jokic, P., Azarkhish, E., Bonetti, A., Pons, M., Emery, S., & Luca Benini, C. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3520127 · Cited by 7 · see citing works
Light-in-the-loop: using a photonics co-processor for scalable training of neural networksPreprint
Launay, J., Poli, I., Müller, K., Carron, I., Daudet, L., Krząkała, F., & Gigan, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01475 · Cited by 7 · see citing works
Helal, H., Firoz, J., Bilbrey, J. A., Sprueill, H. W., Herman, K. M., Krell, M. M., Murray, T., Roldan, M. L., Kraus, M., Li, A., et al. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01312 · Cited by 6 · see citing works
Novel flexible buffering architectures for 3D-NoCs
Said, M., Sarihi, A., Patooghy, A., El-Mohandes, A. M., Badawy, A. A., & Gebali, F. (2020) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2020.100472 · Cited by 6 · see citing works
GTA: Generating high-performance tensorized program with dual-task scheduling
Xie, A., Hu, Y., Wang, Y., Li, Z., Gao, Y., & Cheng, Z. (2025) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2025.103359 · Cited by 5 · see citing works
Mathematics of Digital Hyperspace
Kepner, J., Davis, T., Gadepally, V. N., Jananthan, H., & Milechin, L. (2021) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw52791.2021.00048 · Cited by 5 · see citing works
Breaking the Memory Wall for AI Chip with a New Dimension
Tam, E., Jiang, S., Duan, P., Meng, S., Pang, Y., Huang, C., Han, Y., Xie, J., Cui, Y., Yu, J., et al. (2020) · South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM) · doi:10.1109/seeda-cecnsm49515.2020.9221795 · Cited by 5 · see citing works
Croci, M., & Giles, M. B. (2022) · IMA Journal of Numerical Analysis · doi:10.1093/imanum/drac012 · Cited by 20 · see citing works
Performance Modeling of Weather Forecast Machine Learning for Efficient HPC
Selvam, K. P., & Brorsson, M. (2022) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs54860.2022.00127 · Cited by 4 · see citing works
Preprocessing Pipeline Optimization for Scientific Deep Learning Workloads
Ibrahim, K. Z., & Oliker, L. (2022) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps53621.2022.00112 · Cited by 4 · see citing works
Implementing Spatio-Temporal Graph Convolutional Networks on Graphcore IPUs
Moe, J., Pogorelov, K., Schroeder, D. T., & Langguth, J. (2022) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw55747.2022.00016 · Cited by 4 · see citing works
Time-series ML-regression on Graphcore IPU-M2000 and Nvidia A100
Balewski, J. T., Liu, Z., Tsyplikhin, A., Roland, M. L., & Bouchard, K. E. (2022) · IEEE/ACM International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS) · doi:10.1109/pmbs56514.2022.00019 · Cited by 4 · see citing works
Finkbeiner, J., Gmeinder, T., Pupilli, M., Titterton, A., & Neftci, E. O. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29087 · Cited by 4 · see citing works
Sukumar, S. R., Balma, J. A., Xu, C., & Serebryakov, S. (2021) · 2021 IEEE/ACM Programming Environments for Heterogeneous Computing (PEHC) · doi:10.1109/pehc54839.2021.00010 · Cited by 4 · see citing works
Lee, S., Hwang, S., Kim, M. J., Choi, J., & Ahn, J. H. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3207134 · Cited by 4 · see citing works
Accelerating Recommender Systems via Hardware "scale-in"Preprint
Krishna, S., & Krishna, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05230 · Cited by 4 · see citing works
Performance of a geometric deep learning pipeline for HL-LHC particle tracking
Ju, X., Murnane, D., Calafiura, P., Choma, N., Conlon, S., Farrell, S., Xu, Y., Spiropulu, M., Vlimant, J.-R., Aurisano, A., et al. (2021) · The European Physical Journal C · doi:10.1140/epjc/s10052-021-09675-8 · Cited by 76 · see citing works
EN-T: Optimizing Tensor Computing Engines Performance via Encoder-Based Methodology
Wu, Q., Gui, Y., Zeng, Z., Wang, X., Liang, H., & Jin, X. (2024) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd63220.2024.00097 · Cited by 3 · see citing works
Wu, Q., Liang, H., Gui, Y., Zeng, Z., He, Z., Tao, L., Wang, X., Zhao, L., Zeng, Z., Yuan, W., et al. (2025) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca61900.2025.00058 · Cited by 3 · see citing works
Evaluating Energy Efficiency of Ai Accelerators Using Two Mlperf Benchmarks
Ferdaus, F., Wu, X., Taylor, V., Lan, Z., Shanmugavelu, S., Vishwanath, V., & Papka, M. E. (2025) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid64434.2025.00035 · Cited by 3 · see citing works
Burchard, L., Hustad, K. G., Langguth, J., & Cai, X. H. (2023) · Frontiers in Physics · doi:10.3389/fphy.2023.979699 · Cited by 3 · see citing works
iPuma: High-Performance Sequence Alignment on the Graphcore IPU
Zhao, M., Burchard, L., Schroeder, D. T., Langguth, J., & Cai, X. (2024) · ISC High Performance (ISC) · doi:10.23919/isc.2024.10528941 · Cited by 2 · see citing works
HUNIPU: Efficient Hungarian Algorithm on IPUs
Huang, C., Mathiasen, A., Dean, J., Mottin, D., & Assent, I. (2024) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew61823.2024.00062 · Cited by 2 · see citing works
A Case Study on Coupling OpenFOAM with Different Machine Learning Frameworks
Orland, F., Brose, K. S., Bissantz, J., Ferraro, F., Terboven, C., & Hasse, C. (2022) · doi:10.1109/ai4s56813.2022.00007 · Cited by 2 · see citing works
Comparison of Graphcore IPUs and Nvidia GPUsfor cosmology applicationsPreprint
Arcelin, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02465 · Cited by 2 · see citing works
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped StructuresPreprint
Chelombiev, I., Justus, D., Orr, D., Dietrich, A., Gressmann, F., Koliousis, A., & Luschi, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05822 · Cited by 4 · see citing works
Lee, E. H., Krell, M. M., Tsyplikhin, A., Rege, V., Colak, E., & Yeom, K. W. (2021) · arXiv (Cornell University) · Cited by 2 · see citing works
RETRACTED: Linear Assignment on Tile-Centric Accelerators: Redesigning Hungarian Algorithm on IPUs
Huang, C., Mathiasen, A., Dean, J., Langguth, J., Mottin, D., & Assent, I. (2025) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611978339.9 · Cited by 1 · see citing works
RetractedPhysics-informed generative real-time lens-free imaging
Liu, R. B., Liu, Z., Wolf, M. G. A., Purohit, K. P., Fritz, G., Feng, Y., Hansen, C. G., Bagnaninchi, P., Solvas, X. C. I., & Yang, Y. (2025) · Cell Reports Physical Science · doi:10.1016/j.xcrp.2025.102792 · Cited by 1 · see citing works
Research Project of Mass-Parallel Processor Based on Multitread Core with Specialized Accelerators
Eisymont, L., Nikitin, A. A., Биконов, Д. В., Бражкин, А. А., Peplov, I. S., Kvant, N.-I. I., Fedorenko, P., Ermakov, S., Eisymont, A., & Comlev, A. (2020) · Voprosy kiberbezopasnosti · doi:10.21681/2311-3456-2020-03-22-39 · Cited by 1 · see citing works
A Follow-the-Leader Strategy Using Hierarchical Deep Neural Networks with Grouped Convolutions
Solomon, J. E., & Charette, F. (2021) · SN Computer Science · doi:10.1007/s42979-021-00572-1 · Cited by 1 · see citing works
Mini Minds: Exploring Bebeshka and Zlata Baby Models
Proskurina, I., Metzler, G., & Velcin, J. (2023) · Proceedings of the BabyLM Challenge at the 27th Conference on Computational Natural Language Learning · doi:10.18653/v1/2023.conll-babylm.4 · Cited by 1 · see citing works
2022 AI Testbed Expeditions Report
Vishwanath, V., USDOE Office of Science (SC), Emani, M. K., Taylor, V., Foster, I., Habib, S., Papka, M., Babu, A., CHAN, H., Cherukara, M., et al. (2022) · doi:10.2172/2217141 · Cited by 1 · see citing works
Pfeil, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.08685
2022 roadmap on neuromorphic computing and engineering
Christensen, D. V., Dittmann, R., Linares-Barranco, B., Sebastian, A., Le Gallo, M., Redaelli, A., Slesazeck, S., Mikolajick, T., Spiga, S., Menzel, S., et al. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac4a83
Facilitating CoDesign with Automatic Code Similarity Learning
Nguyen, T., Strohmaier, E., & Shalf, J. M. (2021) · IEEE/ACM Workshop on the LLVM Compiler Infrastructure in HPC (LLVM-HPC) · doi:10.1109/llvmhpc54804.2021.00011
Odd-Even Flexible Router for High Performance Network-on-Chips
Hentges, G., & Abdelrehim, M. (2021) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci54926.2021.00343
Cost-Aware TVM (CAT) Tensorization for Modern Deep Learning Accelerators
Hu, Y., Wang, Y., Dan, X., Hu, X., Liu, F., & Li, J. (2022) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd56317.2022.00058
Sharma, S., Maity, S. K., Gupta, K. G., Das, A., Sajeed, M., & Wandhekar, S. (2023) · International Conference on Information Technology, Computer, and Electrical Engineering · doi:10.1109/icitacee58587.2023.10277517
DNNDaSher: A Compiler Framework for Dataflow Compatible End-to-End Acceleration on IBM AIU
Sen, S., Jain, S., Krithivasan, S., Venkataramani, S., & Srinivasan, V. (2024) · IEEE Micro · doi:10.1109/mm.2024.3423750
Accelerating Deep Neural Networks in FPGA SoC
Bishwokarma, R., & Xiong, X. (2024) · IEEE Long Island Systems, Applications and Technology Conference (LISAT) · doi:10.1109/lisat63094.2024.10808022
Data Movement Is All You Need: A Case Study on Optimizing Transformers
Ivanov, A., Dryden, N., Ben-Nun, T., Li, S., & Hoefler, T. (2020) · arXiv · doi:10.48550/arxiv.2007.00072 · Cited by 78 · see citing works
- Authors
- Jia, Z., Tillman, B., Maggioni, M., & Scarpazza, D. P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1912.03413
- OpenAlex
- W2992192853
- Cited by
- 83
- References
- 15
- Citations by year
- 2025: 7 · 2024: 9 · 2023: 10 · 2022: 19 · 2021: 20 · 2020: 17 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › Interconnection Networks and Systems
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Keywords
- microbenchmarking, massively parallel architectures, memory organization, collective communication, matrix multiplication, convolution, performance modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
