A genetic algorithms approach to modeling the performance of memory-bound computations
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Benchmarks that measure memory bandwidth, such as STREAM, Apex-MAPS and MultiMAPS, are increasingly popular due to the "Von Neumann" bottleneck of modern processors which causes many calculations to be memory-bound. We present a scheme for predicting the performance of HPC applications based on the results of such benchmarks. A Genetic Algorithm approach is used to "learn" bandwidth as a function of cache hit rates per machine with MultiMAPS as the fitness test. The specific results are 56 individual performance predictions including 3 full-scale parallel applications run on 5 different modern HPC architectures, with various CPU counts and inputs, predicted within 10 % average difference with respect to independently verified runtimes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, they rarely provide insights into how to improve performance of programs, compilers, or computers [1] or they can be hard to use by non-experts [27].”
From Roofline: an insightful visual performance model for multicore architectures (2009) · cites this paper as [27]
Citations
Cites
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088
Bailey, D. H., Barszcz, E., Barton, J. T., Browning, D. S., Carter, R. L., Dagum, L., Fatoohi, R. A., Frederickson, P. O., Lasinski, T. A., Schreiber, R. S., et al. (1991) · The International Journal of Supercomputing Applications · doi:10.1177/109434209100500306 · Cited by 2,395
Hitting the memory wall: implications of the obvious
Wulf, W. A., & McKee, S. A. (1995) · ACM SIGARCH Computer Architecture News · doi:10.1145/216585.216588 · Cited by 1,624
Hitting the Memory Wall: Implications of the Obvious
Wulf, W. A., & McKee, S. A. (1995) · Cited by 1,379
An oceanic general circulation model framed in hybrid isopycnic-Cartesian coordinates
Bleck, R. (2002) · Ocean Modelling · doi:10.1016/s1463-5003(01)00012-9 · Cited by 1,343
Efficiently exploring architectural design spaces via predictive modeling
Ïpek, E., McKee, S. A., Caruana, R., de Supinski, B. R., & Schulz, M. (2006) · Proceedings of the 12th international conference on Architectural support for programming languages and operating systems · doi:10.1145/1168857.1168882 · Cited by 323
Converting thread-level parallelism to instruction-level parallelism via simultaneous multithreading
Lo, J. L., Emer, J. S., Levy, H. M., Stamm, R. L., Tullsen, D. M., & Eggers, S. J. (1997) · ACM Transactions on Computer Systems · doi:10.1145/263326.263382 · Cited by 233
Cross-architecture performance predictions for scientific applications using parameterized models
Marin, G., & Mellor-Crummey, J. (2004) · Proceedings of the joint international conference on Measurement and modeling of computer systems · doi:10.1145/1005686.1005691 · Cited by 228
Research works printed but not linked: 15
- McCalpin J., Memory bandwidth and machine balance in current high performance computers, IEEE Technical Committee on Computer Architecture Newsletter.
- 10.5555/1032659.1034232 · doi:10.5555/1032659.1034232
- Hoke C. C., 2004, Applied Aerodynamics Conference and Exhibit.
- Buning P. G., 2003, Langley Research Center
- J. H. Holland Adaptation in Natural and Artificial Systems. University of Michigan Press 1975 J. H. Holland Adaptation in Natural and Artificial Systems. University of Michigan Press 1975
- McCalpin J., Memory bandwidth and machine balance in current high performance computers, IEEE Technical Committee on Computer Architecture Newsletter.
- Ballansc R. S., 1962, New York
- Abandah G., 1996, Proceedings Int'l Parallel Processing Symposium, 249
- Hosie A., 1999, Proceedings of Frontiers of Massively Parallel Computing '99
- 10.5555/1762418.1762521 · doi:10.5555/1762418.1762521
- 10.5555/1114280.1114372 · doi:10.5555/1114280.1114372
- Snir M., 2005, Technical Report No. UIUCDCS-R-2005-2611
- X. Gao. PhD Thesis. 2006. University of California Computer Science Department. X. Gao. PhD Thesis. 2006. University of California Computer Science Department.
- Chen Y., 2007, Dongarra Editor, 2
- Phansalkar A., 2006, Proceedings of SPEC Benchmark Workshop
Cited by
Williams, S., Waterman, A., & Patterson, D. A. (2009) · Communications of the ACM · doi:10.1145/1498765.1498785 · Cited by 2,798
Williams, S., Waterman, A., & Patterson, D. (2009) · doi:10.2172/1407078 · Cited by 110
PSINS: An Open Source Event Tracer and Execution Simulator for MPI Applications
Tikir, M. M., Laurenzano, M. A., Carrington, L., & Snavely, A. E. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-03869-3_16 · Cited by 94
Self-citationPerformance projection of HPC applications using SPEC CFP2006 benchmarks
Sharkawi, S., DeSota, D., Panda, R., Indukuru, R., Stevens, S., Taylor, V., & Wu, X. (2009) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2009.5161057 · Cited by 51
Meswani, M. R., Carrington, L., Unat, D., Snavely, A. E., Baden, S. B., & Poole, S. (2012) · The International Journal of High Performance Computing Applications · doi:10.1177/1094342012468180 · Cited by 49
Self-citation
Metadata
- Authors
- Tikir, M. M., Carrington, L., Strohmaier, E., & Snavely, A.
- Affiliations
- San Diego Supercomputer Center (US)
- Lawrence Berkeley National Laboratory (US)
- Venue
- Proceedings of the 2007 ACM/IEEE conference on Supercomputing
- Publisher
- ACM
- Published
- 2007-11-10
- Pages
- 1-12
- ISSN
- 1063-9535 (ISSN-L)
- OpenAlex
- W2109811664
- Cited by
- 66
- References
- 36
- Citations by year
- 2024: 1 · 2023: 1 · 2022: 1 · 2020: 1 · 2019: 4 · 2018: 2 · 2017: 3 · 2016: 8 · 2015: 2 · 2014: 4 · 2013: 6 · 2012: 11
- FWCI
- 3.94
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE Conference on Supercomputing (SC) (publishedVersion)
- Funders
- National Science Foundation (406312, 516162)
- Office of Science (SciDAC2)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed and Parallel Computing Systems
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- memory bandwidth, performance prediction, genetic algorithm, STREAM benchmark, cache hit rate, von Neumann bottleneck, HPC applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.