The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Analyzing CUDA workloads using a detailed GPU simulator
Abstract
Modern Graphic Processing Units (GPUs) provide sufficiently flexible programming models that understanding their performance can provide insight in designing tomorrow's manycore processors, whether those are GPUs or otherwise. The combination of multiple, multithreaded, SIMD cores makes studying these GPUs useful in understanding tradeoffs among memory, data, and thread level parallelism. While modern GPUs offer orders of magnitude more raw computing power than contemporary CPUs, many important applications, even those with abundant data level parallelism, do not achieve peak performance. This paper characterizes several non-graphics applications written in NVIDIA's CUDA programming model by running them on a novel detailed microarchitecture performance simulator that runs NVIDIA's parallel thread execution (PTX) virtual instruction set. For this study, we selected twelve non-trivial CUDA applications demonstrating varying levels of performance improvement on GPU hardware (versus a CPU-only sequential version of the application). We study the performance of these applications on our GPU performance simulator with configurations comparable to contemporary high-end graphics cards. We characterize the performance impact of several microarchitecture design choices including choice of interconnect topology, use of caches, design of memory controller, parallel workload distribution mechanisms, and memory request coalescing hardware. Two observations we make are (1) that for the applications we study, performance is more sensitive to interconnect bisection bandwidth rather than latency, and (2) that, for some applications, running fewer threads concurrently than on-chip resources might otherwise allow can improve performance by reducing contention in the memory system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nickolls, J., Buck, I., Garland, M., & Skadron, K. (2008) · Queue · doi:10.1145/1365490.1365500 · Cited by 1,610
(2008) · doi:10.1145/1401132.1401152 · Cited by 1,575
NVIDIA Tesla: A Unified Graphics and Computing Architecture
Lindholm, E., Nickolls, J., Oberman, S., & Montrym, J. (2008) · IEEE Micro · doi:10.1109/mm.2008.31 · Cited by 1,362
Optimization principles and application performance evaluation of a multithreaded GPU using CUDA
Ryoo, S., Rodrigues, C. I., Baghsorkhi, S. S., Stone, S. S., Kirk, D. B., & Hwu, W.-M. W. (2008) · Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming · doi:10.1145/1345206.1345220 · Cited by 903
Accelerating Large Graph Algorithms on the GPU Using CUDA
Harish, P., & Narayanan, P. J. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77220-0_21 · Cited by 734
Dynamic Warp Formation and Scheduling for Efficient GPU Control Flow
Fung, W. W. L., Sham, I., Yuan, G., & Aamodt, T. M. (2007) · 40th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 2007) · doi:10.1109/micro.2007.30 · Cited by 724
Self-citationThe microarchitecture of the Pentium 4 processor
Hinton, G. (2001) · Medical Entomology and Zoology · Cited by 608
The design and implementation of a first-generation CELL processor
Pham, D., Asano, S., Bolliger, M., Day, M. N., Hofstee, H. P., Johns, C., Kahle, J., Kameyama, A., Keaty, J., Masubuchi, Y., et al. (2005) · ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005. · doi:10.1109/isscc.2005.1493930 · Cited by 544
Microarchitectural Design Space Exploration Using an Architecture-Centric Approach
Dubach, C., Jones, T., & O'Boyle, M. (2007) · 40th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 2007) · doi:10.1109/micro.2007.12 · Cited by 407
High-throughput sequence alignment using Graphics Processing Units
Schatz, M. C., Trapnell, C., Delcher, A. L., & Varshney, A. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-474 · Cited by 310
Cited by
Dark silicon and the end of multicore scaling
Esmaeilzadeh, H., Blem, E., St. Amant, R., Sankaralingam, K., & Burger, D. (2011) · Proceedings of the 38th annual international symposium on Computer architecture · doi:10.1145/2000064.2000108 · Cited by 1,532
A detailed and flexible cycle-accurate Network-on-Chip simulator
Jiang, N., Balfour, J., Becker, D. U., Towles, B., Dally, W. J., Michelogiannakis, G., & Kim, J. (2013) · 2013 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2013.6557149 · Cited by 790
Ramulator: A Fast and Extensible DRAM Simulator
Kim, Y., Yang, W., & Mutlu, O. (2016) · IEEE Computer Architecture Letters · doi:10.1109/lca.2015.2414456 · Cited by 764
GPUWattch: enabling energy optimizations in GPGPUs
Leng, J., Hetherington, T., ElTantawy, A., Gilani, S., Kim, N. S., Aamodt, T. M., & Reddi, V. J. (2013) · Proceedings of the 40th Annual International Symposium on Computer Architecture · doi:10.1145/2485922.2485964 · Cited by 500
Self-citationDemystifying GPU microarchitecture through microbenchmarking
Wong, H., Papadopoulou, M.-M., Sadooghi-Alvandi, M., & Moshovos, A. (2010) · 2010 IEEE International Symposium on Performance Analysis of Systems & Software (ISPASS) · doi:10.1109/ispass.2010.5452013 · Cited by 439
Self-citationMulti2Sim: a simulation framework for CPU-GPU computing
Ubal, R., Jang, B., Mistry, P., Schaa, D., & Kaeli, D. (2012) · Proceedings of the 21st international conference on Parallel architectures and compilation techniques · doi:10.1145/2370816.2370865 · Cited by 434
Accelerating CUDA graph algorithms at maximum warp
Hong, S., Kim, S. K., Oguntebi, T., & Olukotun, K. (2011) · Proceedings of the 16th ACM symposium on Principles and practice of parallel programming · doi:10.1145/1941553.1941590 · Cited by 339
A characterization of the Rodinia benchmark suite with comparison to contemporary CMP workloads
Che, S., Sheaffer, J. W., Boyer, M., Szafaryn, L. G., Wang, L., & Skadron, K. (2010) · IEEE International Symposium on Workload Characterization (IISWC'10) · doi:10.1109/iiswc.2010.5650274 · Cited by 302
Processing data where it makes sense: Enabling in-memory computation
Mutlu, O., Ghose, S., Gómez-Luna, J., & Ausavarungnirun, R. (2019) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2019.01.009 · Cited by 300
Scalable Computing: Practice and Experience
(2013) · Scalable Computing Practice and Experience · doi:10.12694/issn.1895-1767 · Cited by 280
GPU-Qin: A methodology for evaluating the error resilience of GPGPU applications
Fang, B., Pattabiraman, K., Ripeanu, M., & Gurumurthi, S. (2014) · 2014 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2014.6844486 · Cited by 142
NVBitFI: Dynamic Fault Injection for GPUs
Tsai, T., Hari, S. K. S., Sullivan, M., Villa, O., & Keckler, S. W. (2021) · 2021 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) · doi:10.1109/dsn48987.2021.00041 · Cited by 93
Simulating cortical networks on heterogeneous multi-GPU systems
Nere, A., Franey, S., Hashmi, A., & Lipasti, M. (2013) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2012.02.006 · Cited by 6
Metadata
- Authors
- Bakhoda, A., Yuan, G. L., Fung, W. W. L., Wong, H., & Aamodt, T. M.
- Venue
- 2009 IEEE International Symposium on Performance Analysis of Systems and Software
- Publisher
- IEEE
- Published
- 2009-04
- Pages
- 163-174
- OpenAlex
- W1979527452
- Cited by
- 1,663
- References
- 14
- FWCI
- 34.97
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.