The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Hardware Architecture and Software Stack for PIM Based on Commercial DRAM Technology : Industrial Product
Abstract
Emerging applications such as deep neural network demand high off-chip memory bandwidth. However, under stringent physical constraints of chip packages and system boards, it becomes very expensive to further increase the bandwidth of off-chip memory. Besides, transferring data across the memory hierarchy constitutes a large fraction of total energy consumption of systems, and the fraction has steadily increased with the stagnant technology scaling and poor data reuse characteristics of such emerging applications. To cost-effectively increase the bandwidth and energy efficiency, researchers began to reconsider the past processing-in-memory (PIM) architectures and advance them further, especially exploiting recent integration technologies such as 2.5D/3D stacking. Albeit the recent advances, no major memory manufacturer has developed even a proof-of-concept silicon yet, not to mention a product. This is because the past PIM architectures often require changes in host processors and/or application code which memory manufacturers cannot easily govern. In this paper, elegantly tackling the aforementioned challenges, we propose an innovative yet practical PIM architecture. To demonstrate its practicality and effectiveness at the system level, we implement it with a 20nm DRAM technology, integrate it with an unmodified commercial processor, develop the necessary software stack, and run existing applications without changing their source code. Our evaluation at the system level shows that our PIM improves the performance of memory-bound neural network kernels and applications by 11.2× and 3.5×, respectively. Atop the performance improvement, PIM also reduces the energy per bit transfer by 3.5×, and the overall energy efficiency of the system running the applications by 3.2×.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · International Conference on Machine Learning · Cited by 13,995
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
cuDNN: Efficient Primitives for Deep Learning
Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J. J., Catanzaro, B., & Shelhamer, E. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.0759 · Cited by 943
DRAMSim2: A Cycle Accurate Memory System Simulator
Rosenfeld, P., Cooper-Balis, E., & Jacob, B. (2011) · IEEE Computer Architecture Letters · doi:10.1109/l-ca.2011.4 · Cited by 908
A scalable processing-in-memory accelerator for parallel graph processing
Ahn, J., Hong, S., Yoo, S., Mutlu, O., & Choi, K. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750386 · Cited by 767
Patterson, D., Anderson, T., Cardwell, N., Fromm, R., Keeton, K., Kozyrakis, C., Thomas, R., & Yelick, K. (1997) · IEEE Micro · doi:10.1109/40.592312 · Cited by 665
GPUs and the Future of Parallel Computing
Keckler, S. W., Dally, W. J., Khailany, B., Garland, M., & Glasco, D. (2011) · IEEE Micro · doi:10.1109/mm.2011.89 · Cited by 658
Streaming End-to-end Speech Recognition for Mobile Devices
He, Y., Sainath, T. N., Prabhavalkar, R., McGraw, I., Alvarez, R., Zhao, D., Rybach, D., Kannan, A., Wu, Y., Pang, R., et al. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682336 · Cited by 601
Reddi, V. J., Cheng, C., Kanter, D., Mattson, P., Schmuelling, G., Wu, C.-J., Anderson, B., Breughe, M., Charlebois, M., Chou, W., et al. (2020) · 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca45697.2020.00045 · Cited by 505
Purdum, J. (1983) · Medical Entomology and Zoology · Cited by 482
TETRIS: Scalable and Efficient Neural Network Acceleration with 3D Memory
Gao, M., Pu, J., Yang, X., Horowitz, M., & Kozyrakis, C. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037702 · Cited by 421
Deep Learning Recommendation Model for Personalization and Recommendation Systems
Naumov, M., Mudigere, D., Shi, H.-J. M., Huang, J., Sundaraman, N., Park, J., Wang, X., Gupta, U., Wu, C.-J., Azzolini, A. G., et al. (2019) · arXiv · doi:10.48550/arxiv.1906.00091 · Cited by 411
Processing in memory: the Terasys massively parallel PIM array
Gokhale, M., Holmes, B., & Iobst, K. (1995) · Computer · doi:10.1109/2.375174 · Cited by 365
Neurocube: a programmable digital neuromorphic architecture with high-density 3D memory
Kim, D., Kung, J., Chai, S., Yalamanchili, S., & Mukhopadhyay, S. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001178 · Cited by 342
Serving DNNs in Real Time at Datacenter Scale with Project Brainwave
Chung, E., Fowers, J., Ovtcharov, K., Papamichael, M., Caulfield, A., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., et al. (2018) · IEEE Micro · doi:10.1109/mm.2018.022071131 · Cited by 328
IntelŴVirtualization Technology for Directed I/O
Abramson, D. (2006) · Intel Technology Journal · doi:10.1535/itj.1003.02 · Cited by 293
The Architectural Implications of Facebook's DNN-Based Personalized Recommendation
Gupta, U., Wu, C.-J., Wang, X., Naumov, M., Reagen, B., Brooks, D., Cottel, B., Hazelwood, K., Hempstead, M., Jia, B., et al. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00047 · Cited by 273
Practical Near-Data Processing for In-Memory Analytics Frameworks
Gao, M., Ayers, G., & Kozyrakis, C. (2015) · 2015 International Conference on Parallel Architecture and Compilation (PACT) · doi:10.1109/pact.2015.22 · Cited by 266
Dissecting the NVIDIA Volta GPU Architecture via Microbenchmarking
Jia, Z., Maggioni, M., Staiger, B., & Scarpazza, D. P. (2018) · arXiv · doi:10.48550/arxiv.1804.06826 · Cited by 233
FlexRAM: Toward an advanced Intelligent Memory system
Kang, Y., Huang, W., Yoo, S.-M., Keen, D., Ge, Z., Lam, V., Pattnaik, P., & Torrellas, J. (2012) · 2012 IEEE 30th International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2012.6378608 · Cited by 229
Computational RAM: implementing processors in memory
Elliott, D. G., Stumm, M., Snelgrove, W. M., Cojocaru, C., & Mckenzie, R. (1999) · IEEE Design & Test of Computers · doi:10.1109/54.748803 · Cited by 218
Haidar, A., Tomov, S., Dongarra, J., & Higham, N. J. (2018) · SC18: International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2018.00050 · Cited by 218
Newton: A DRAM-maker’s Accelerator-in-Memory (AiM) Architecture for Machine Learning
He, M., Song, C., Kim, I., Jeong, C., Kim, S., Park, I., Thottethodi, M., & Vijaykumar, T. N. (2020) · 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00040 · Cited by 208
DeepRecSys: A System for Optimizing End-To-End At-Scale Neural Recommendation Inference
Gupta, U., Hsia, S., Saraph, V., Wang, X., Reagen, B., Wei, G.-Y., Lee, H.-H. S., Brooks, D., & Wu, C.-J. (2020) · 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca45697.2020.00084 · Cited by 173
HBM: Memory solution for bandwidth-hungry processors
Kim, J., & Kim, Y. (2014) · IEEE Hot Chips Symposium · doi:10.1109/hotchips.2014.7478812 · Cited by 110
Self-citationAccelerating reduction and scan using tensor core units
Dakkak, A., Li, C., Xiong, J., Gelado, I., & Hwu, W.-M. (2019) · International Conference on Supercomputing · doi:10.1145/3330345.3331057 · Cited by 99
McDRAM: Low Latency and Energy-Efficient Matrix Computations in DRAM
Shin, H., Kim, D., Park, E., Park, S., Park, Y.-S., & Yoo, S. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857044 · Cited by 89
Self-citationApplication-Transparent Near-Memory Processing Architecture with Memory Channel Network
Alian, M., Min, S., Asghari-Moghaddam, H., Dhar, A., Wang, D. K., Rower, T., McPadden, A., O'Halloran, O., Chen, D., Xiong, J., et al. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00070 · Cited by 69
Self-citationKolli, A., Rosen, J., Diestelhorst, S., Saidi, A. G., Pelley, S., Liu, S., Chen, P. M., & Wenisch, T. F. (2016) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783761 · Cited by 69
MIOpen: An Open Source Library For Deep Learning Primitives
Khan, J., Fultz, P., Tamazov, A., Lowell, D., Liu, C., Melesse, M., Nandhimandalam, M., Nasyrov, K., Perminov, I., Shah, T., et al. (2020) · Proceedings of the 30th International Conference on Computer Graphics and Machine Vision (GraphiCon 2020). Part 2 · doi:10.51130/graphicon-2020-2-2-2 · Cited by 48
MViD: Sparse Matrix-Vector Multiplication in Mobile DRAM for Accelerating Recurrent Neural Networks
Kim, B., Chung, J., Lee, E., Jung, W., Lee, S., Choi, J., Park, J., Wi, M., Lee, S., & Ahn, J. H. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2984496 · Cited by 30
Self-citationIn-DRAM near-data approximate acceleration for GPUs
Yazdanbakhsh, A., Song, C., Sacks, J., Lotfi-Kamran, P., Esmaeilzadeh, H., & Kim, N. S. (2018) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1145/3243176.3243188 · Cited by 29
Self-citation
Metadata
- Authors
- Lee, S., Kang, S.-H., Lee, J., Kim, H., Lee, E., Seo, S., Yoon, H., Lee, S., Lim, K., Shin, H., Kim, J., Seongil, O., Iyer, A., Wang, D., Sohn, K., & Kim, N. S.
- Venue
- 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 43-56
- OpenAlex
- W3189166979
- Cited by
- 269
- References
- 39
- FWCI
- 23.28
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.