The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
CACTI 7: New Tools for Interconnect Exploration in Innovative Off-Chip Memories
Abstract
Historically, server designers have opted for simple memory systems by picking one of a few commoditized DDR memory products. We are already witnessing a major upheaval in the off-chip memory hierarchy, with the introduction of many new memory products—buffer-on-board, LRDIMM, HMC, HBM, and NVMs, to name a few. Given the plethora of choices, it is expected that different vendors will adopt different strategies for their high-capacity memory systems, often deviating from DDR standards and/or integrating new functionality within memory systems. These strategies will likely differ in their choice of interconnect and topology, with a significant fraction of memory energy being dissipated in I/O and data movement. To make the case for memory interconnect specialization, this paper makes three contributions. First, we design a tool that carefully models I/O power in the memory system, explores the design space, and gives the user the ability to define new types of memory interconnects/topologies. The tool is validated against SPICE models, and is integrated into version 7 of the popular CACTI package. Our analysis with the tool shows that several design parameters have a significant impact on I/O power. We then use the tool to help craft novel specialized memory system channels. We introduce a new relay-on-board chip that partitions a DDR channel into multiple cascaded channels. We show that this simple change to the channel topology can improve performance by 22% for DDR DRAM and lower cost by up to 65% for DDR DRAM. This new architecture does not require any changes to DIMMs, and it efficiently supports hybrid DRAM/NVM systems. Finally, as an example of a more disruptive architecture, we design a custom DIMM and parallel bus that moves away from the DDR3/DDR4 standards. To reduce energy and improve performance, the baseline data channel is split into three narrow parallel channels and the on-DIMM interconnects are operated at a lower frequency. In addition, this allows us to design a two-tier error protection strategy that reduces data transfers on the interconnect. This architecture yields a performance improvement of 18% and a memory power reduction of 23%. The cascaded channel and narrow channel architectures serve as case studies for the new tool and show the potential for benefit from re-organizing basic memory interconnects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Strukov, D. B., Snider, G. S., Stewart, D. R., & Williams, R. S. (2008) · Nature · doi:10.1038/nature06932 · Cited by 11,828
(2010) · Cited by 4,411
Bailey, D. H., Barszcz, E., Barton, J. T., Browning, D. S., Carter, R. L., Dagum, L., Fatoohi, R. A., Frederickson, P. O., Lasinski, T. A., Schreiber, R. S., et al. (1991) · The International Journal of Supercomputing Applications · doi:10.1177/109434209100500306 · Cited by 2,395
Architecting phase change memory as a scalable dram alternative
Lee, B. C., İpek, E., Mutlu, O., & Burger, D. (2009) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/1555754.1555758 · Cited by 1,380
Scalable high performance main memory system using phase-change memory technology
Qureshi, M. K., Srinivasan, V., & Rivers, J. A. (2009) · Proceedings of the 36th annual international symposium on Computer architecture · doi:10.1145/1555754.1555760 · Cited by 1,277
NVSim: A Circuit-Level Performance, Energy, and Area Model for Emerging Nonvolatile Memory
Dong, X., Xu, C., Xie, Y., & Jouppi, N. P. (2012) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2012.2185930 · Cited by 1,217
Ramulator: A Fast and Extensible DRAM Simulator
Kim, Y., Yang, W., & Mutlu, O. (2016) · IEEE Computer Architecture Letters · doi:10.1109/lca.2015.2414456 · Cited by 764
Dynamic Warp Formation and Scheduling for Efficient GPU Control Flow
Fung, W. W. L., Sham, I., Yuan, G., & Aamodt, T. M. (2007) · 40th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 2007) · doi:10.1109/micro.2007.30 · Cited by 724
Optimizing NUCA Organizations and Wiring Alternatives for Large Caches with CACTI 6.0
Muralimanohar, N., Balasubramonian, R., & Jouppi, N. (2007) · 40th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 2007) · doi:10.1109/micro.2007.33 · Cited by 501
Self-citationThe case for RAMClouds: scalable high-performance storage entirely in DRAM
Ousterhout, J., Agrawal, P., Erickson, D., Kozyrakis, C., Leverich, J., Mazières, D., Mitra, S., Narayanan, A., Parulkar, G., Rosenblum, M., et al. (2010) · ACM SIGOPS Operating Systems Review · doi:10.1145/1713254.1713276 · Cited by 447
Hybrid memory cube new DRAM architecture increases density and performance
Jeddeloh, J., & Keeth, B. (2012) · 2012 Symposium on VLSI Technology (VLSIT) · doi:10.1109/vlsit.2012.6242474 · Cited by 444
Page placement in hybrid memory systems
Ramos, L. E. D. S., Gorbatov, E., & Bianchini, R. (2011) · International Conference on Supercomputing · doi:10.1145/1995896.1995911 · Cited by 392
Pawlowski, J. T. (2011) · 2011 IEEE Hot Chips 23 Symposium (HCS) · doi:10.1109/hotchips.2011.7477494 · Cited by 391
Disaggregated memory for expansion and sharing in blade servers
Lim, K., Chang, J., Mudge, T., Ranganathan, P., Reinhardt, S. K., & Wenisch, T. F. (2009) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/1555754.1555789 · Cited by 365
Understanding the Energy Consumption of Dynamic Random Access Memories
Vogelsang, T. (2010) · 2010 43rd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1109/micro.2010.42 · Cited by 257
Towards energy-proportional datacenter memory with mobile DRAM
Malladi, K. T., Lee, B. C., Nothaft, F. A., Kozyrakis, C., Periyathambi, K., & Horowitz, M. (2012) · ACM SIGARCH Computer Architecture News · doi:10.1145/2366231.2337164 · Cited by 203
Row buffer locality aware caching policies for hybrid memories
Yoon, H., Meza, J., Ausavarungnirun, R., Harding, R. A., & Mutlu, O. (2012) · 2012 IEEE 30th International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2012.6378661 · Cited by 183
NVSim: A Circuit-Level Performance, Energy, and Area Model for Emerging Non-volatile Memory
Dong, X., Xu, C., Jouppi, N., & Xie, Y. (2014) · Emerging Memory Technologies · doi:10.1007/978-1-4419-9551-3_2 · Cited by 176
Towards energy-proportional datacenter memory with mobile DRAM
Malladi, K. T., Nothaft, F. A., Periyathambi, K., Lee, B. C., Kozyrakis, C., & Horowitz, M. (2012) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2012.6237004 · Cited by 156
Zheng, H., Jiang, L., Zhang, Z., & Zhu, Z. (2009) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/1555754.1555788 · Cited by 59
BOOM: enabling mobile memory based low-power server DIMMs
Yoon, D. H., Chang, J., Muralimanohar, N., & Ranganathan, P. (2012) · ACM SIGARCH Computer Architecture News · doi:10.1145/2366231.2337163 · Cited by 54
Self-citation
Cited by
Kelle: Co-design KV Caching and eDRAM for Efficient LLM Serving in Edge Computing
Xia, T., & Zhang, S. Q. (2025) · Proceedings of the 58th IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3725843.3756071 · Cited by 3
Metadata
- Authors
- Balasubramonian, R., Kahng, A. B., Muralimanohar, N., Shafiee, A., & Srinivas, V.
- Venue
- ACM Transactions on Architecture and Code Optimization
- Published
- 2017-06-28
- Volume
- 14
- Issue
- 2
- Pages
- 1-25
- ISSN
- 1544-3566 (ISSN-L)
- 1544-3973
- OpenAlex
- W2725159389
- Cited by
- 559
- References
- 21
- FWCI
- 24.30
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.