The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Practical Near-Data Processing for In-Memory Analytics Frameworks
Abstract
The end of Dennard scaling has made all systemsenergy-constrained. For data-intensive applications with limitedtemporal locality, the major energy bottleneck is data movementbetween processor chips and main memory modules. For such workloads, the best way to optimize energy is to place processing near the datain main memory. Advances in 3D integrationprovide an opportunity to implement near-data processing (NDP) withoutthe technology problems that similar efforts had in the past. This paper develops the hardware and software of an NDP architecturefor in-memory analytics frameworks, including MapReduce, graphprocessing, and deep neural networks. We develop simple but scalablehardware support for coherence, communication, and synchronization, anda runtime system that is sufficient to support analytics frameworks withcomplex data patterns while hiding all thedetails of the NDP hardware. Our NDP architecture provides up to 16x performance and energy advantageover conventional approaches, and 2.5x over recently-proposed NDP systems. We also investigate the balance between processing and memory throughput, as well as the scalability and physical and logical organization of the memory system. Finally, we show that it is critical to optimize software frameworksfor spatial locality as it leads to 2.9x efficiency improvements for NDP.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
MapReduce: Simplified Data Processing on Large Cluster
Senior Software Developer, A. U., & Dayalan, M. (2018) · International Journal of Research and Engineering · doi:10.21276/ijre.2018.5.5.4 · Cited by 2,948
Li, S., Ahn, J. H., Strong, R. D., Brockman, J. B., Tullsen, D. M., & Jouppi, N. P. (2009) · Proceedings of the 42nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/1669112.1669172 · Cited by 2,376
Dark silicon and the end of multicore scaling
Esmaeilzadeh, H., Blem, E., St. Amant, R., Sankaralingam, K., & Burger, D. (2011) · Proceedings of the 38th annual international symposium on Computer architecture · doi:10.1145/2000064.2000108 · Cited by 1,532
PowerGraph: distributed graph-parallel computation on natural graphs
Gonzalez, J. E., Low, Y., Gu, H., Bickson, D., & Guestrin, C. (2012) · doi:10.5555/2387880.2387883 · Cited by 1,451
Challenges and opportunities with big data
Labrinidis, A., & Jagadish, H. V. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2367502.2367572 · Cited by 1,070
DRAMSim2: A Cycle Accurate Memory System Simulator
Rosenfeld, P., Cooper-Balis, E., & Jacob, B. (2011) · IEEE Computer Architecture Letters · doi:10.1109/l-ca.2011.4 · Cited by 908
A scalable processing-in-memory accelerator for parallel graph processing
Ahn, J., Hong, S., Yoo, S., Mutlu, O., & Choi, K. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750386 · Cited by 767
Dynamic Warp Formation and Scheduling for Efficient GPU Control Flow
Fung, W. W. L., Sham, I., Yuan, G., & Aamodt, T. M. (2007) · 40th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 2007) · doi:10.1109/micro.2007.30 · Cited by 724
Three-dimensional integrated circuits
Topol, A. W., Tulipe, D. C. L., Shi, L., Frank, D. J., Bernstein, K., Steen, S. E., Kumar, A., Singco, G. U., Young, A. M., Guarini, K. W., et al. (2006) · IBM Journal of Research and Development · doi:10.1147/rd.504.0491 · Cited by 703
X-Stream: edge-centric graph processing using streaming partitions
Roy, A., Mihailovic, I., & Zwaenepoel, W. (2013) · Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles · doi:10.1145/2517349.2522740 · Cited by 673
ORION 2.0: A Fast and Accurate NoC Power and Area Model for Early-Stage Design Space Exploration
Kahng, A. B., Li, B., Peh, L.-S., & Samadi, K. (2008) · Cited by 670
Patterson, D., Anderson, T., Cardwell, N., Fromm, R., Keeton, K., Kozyrakis, C., Thomas, R., & Yelick, K. (1997) · IEEE Micro · doi:10.1109/40.592312 · Cited by 665
Self-citationProject Adam: building an efficient and scalable deep learning training system
Chilimbi, T. M., Suzue, Y., Apacible, J., & Kalyanaraman, K. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685094 · Cited by 550
3D-Stacked Memory Architectures for Multi-core Processors
Loh, G. H. (2008) · ACM SIGARCH Computer Architecture News · doi:10.1145/1394608.1382159 · Cited by 541
Optimizing NUCA Organizations and Wiring Alternatives for Large Caches with CACTI 6.0
Muralimanohar, N., Balasubramonian, R., & Jouppi, N. (2007) · 40th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 2007) · doi:10.1109/micro.2007.33 · Cited by 501
Dark Silicon and the End of Multicore Scaling
Esmaeilzadeh, H., Blem, E., St. Amant, R., Sankaralingam, K., & Burger, D. (2012) · IEEE Micro · doi:10.1109/mm.2012.17 · Cited by 490
Motoyoshi, M. (2009) · Proceedings of the IEEE · doi:10.1109/jproc.2008.2007462 · Cited by 481
ZSim: fast and accurate microarchitectural simulation of thousand-core systems
Sanchez, D., & Kozyrakis, C. (2013) · Proceedings of the 40th Annual International Symposium on Computer Architecture · doi:10.1145/2485922.2485963 · Cited by 460
Self-citationHybrid memory cube new DRAM architecture increases density and performance
Jeddeloh, J., & Keeth, B. (2012) · 2012 Symposium on VLSI Technology (VLSIT) · doi:10.1109/vlsit.2012.6242474 · Cited by 444
3D-Stacked Memory Architectures for Multi-core Processors
Loh, G. H. (2008) · 2008 International Symposium on Computer Architecture · doi:10.1109/isca.2008.15 · Cited by 438
Pawlowski, J. T. (2011) · 2011 IEEE Hot Chips 23 Symposium (HCS) · doi:10.1109/hotchips.2011.7477494 · Cited by 391
TOP-PIM: throughput-oriented programmable processing in memory
Zhang, D., Jayasena, N., Lyashevsky, A., Greathouse, J. L., Xu, L., & Ignatowski, M. (2014) · Proceedings of the 23rd international symposium on High-performance parallel and distributed computing · doi:10.1145/2600212.2600213 · Cited by 320
Farmahini-Farahani, A., Ahn, J. H., Morrow, K., & Kim, N. S. (2015) · 2015 IEEE 21st International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2015.7056040 · Cited by 274
Lee, D. U., Kim, K. W., Kim, K. W., Kim, H., Kim, J. Y., Park, Y. J., Kim, J. H., Kim, D. S., Park, H. B., Shin, J. W., et al. (2014) · 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC) · doi:10.1109/isscc.2014.6757501 · Cited by 253
An Efficient and Scalable Semiconductor Architecture for Parallel Automata Processing
Dlugosch, P., Brown, D., Glendenning, P., Leventhal, M., & Noyes, H. (2014) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2014.8 · Cited by 238
Near-Data Processing: Insights from a MICRO-46 Workshop
Balasubramonian, R., Chang, J., Manning, T., Moreno, J. H., Murphy, R., Nair, R., & Swanson, S. (2014) · IEEE Micro · doi:10.1109/mm.2014.55 · Cited by 235
FlexRAM: Toward an advanced Intelligent Memory system
Kang, Y., Huang, W., Yoo, S.-M., Keen, D., Ge, Z., Lam, V., Pattnaik, P., & Torrellas, J. (2012) · 2012 IEEE 30th International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2012.6378608 · Cited by 229
Express Cube Topologies for on-Chip Interconnects
Grot, B., Hestness, J., Keckler, S. W., & Mutlu, O. (2009) · 2009 IEEE 15th International Symposium on High Performance Computer Architecture · doi:10.1109/hpca.2009.4798251 · Cited by 191
PicoServer: using 3D stacking technology to enable a compact energy efficient chip multiprocessor
Kgil, T., D'Souza, S., Saidi, A., Binkert, N., Dreslinski, R., Mudge, T., Reinhardt, S., & Flautner, K. (2006) · Proceedings of the 12th international conference on Architectural support for programming languages and operating systems · doi:10.1145/1168857.1168873 · Cited by 189
Phoenix++: modular MapReduce for shared-memory systems
Talbot, J., Yoo, R. M., & Kozyrakis, C. (2011) · Proceedings of the second international workshop on MapReduce and its applications · doi:10.1145/1996092.1996095 · Cited by 187
Self-citationEXECUBE-A New Architecture for Scaleable MPPs
Kogge, P. (1994) · 1994 International Conference on Parallel Processing (ICPP'94) · doi:10.1109/icpp.1994.108 · Cited by 187
Active Memory Cube: A processing-in-memory architecture for exascale systems
Nair, R., Antao, S. F., Bertolli, C., Bose, P., Brunheroto, J. R., Chen, T., Cher, C.-Y., Costa, C. H. A., Doi, J., Evangelinos, C., et al. (2015) · IBM Journal of Research and Development · doi:10.1147/jrd.2015.2409732 · Cited by 186
SCD: A scalable coherence directory with flexible sharer set encoding
Sánchez, D., & Kozyrakis, C. (2012) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2012.6168950 · Cited by 115
Self-citationSouri, S. J., Banerjee, K., Mehrotra, A. P., & Saraswat, K. C. (2000) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/337292.337394 · Cited by 108
From Microprocessors to Nanostores: Rethinking Data-Centric Systems
Ranganathan, P. (2011) · Computer · doi:10.1109/mc.2011.18 · Cited by 107
Supporting Very Large DRAM Caches with Compound-Access Scheduling and MissMap
Loh, G. H., & Hill, M. D. (2012) · IEEE Micro · doi:10.1109/mm.2012.25 · Cited by 66
Fang, Z., Zhang, L., Carter, J. B., Ibrahim, A., & Parker, M. A. (2007) · International Conference on Supercomputing · doi:10.1145/1274971.1275004 · Cited by 52
Integrated 3D-stacked server designs for increasing physical density of key-value stores
Gutierrez, A., Cieslak, M., Giridhar, B., Dreslinski, R., Ceze, L., & Mudge, T. (2014) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2541940.2541951 · Cited by 50
Improving VLIW Processor Performance Using Three-Dimensional (3D) DRAM Stacking
Pan, Y., & Zhang, T. (2009) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap.2009.11 · Cited by 14
Cited by
TETRIS: Scalable and Efficient Neural Network Acceleration with 3D Memory
Gao, M., Pu, J., Yang, X., Horowitz, M., & Kozyrakis, C. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037702 · Cited by 421
Self-citationDRISA: a DRAM-based Reconfigurable In-Situ Accelerator
Li, S., Niu, D., Malladi, K. T., Zheng, H., Brennan, B., & Xie, Y. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3123977 · Cited by 326
Processing data where it makes sense: Enabling in-memory computation
Mutlu, O., Ghose, S., Gómez-Luna, J., & Ausavarungnirun, R. (2019) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2019.01.009 · Cited by 300
GraphR: Accelerating Graph Processing Using ReRAM
Song, L., Zhuo, Y., Qian, X., Li, H., & Chen, Y. (2018) · 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00052 · Cited by 295
Google Workloads for Consumer Devices: Mitigating Data Movement Bottlenecks
Boroumand, A., Ghose, S., Kim, Y., Ausavarungnirun, R., Shiu, E., Thakur, R., Kim, D., Kuusela, A., Knies, A., Ranganathan, P., et al. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173177 · Cited by 273
Metadata
- Authors
- Gao, M., Ayers, G., & Kozyrakis, C.
- Venue
- 2015 International Conference on Parallel Architecture and Compilation (PACT)
- Publisher
- IEEE
- Published
- 2015-10
- Pages
- 113-124
- OpenAlex
- W2545376626
- Cited by
- 266
- References
- 40
- FWCI
- 35.19
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.