Latency lags bandwith
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
As I review performance trends, I am struck by a consistent theme across many technologies: bandwidth improves much more quickly than latency. Here, I list a half-dozen performance milestones to document this observation, many reasons why it happens, a few ways to cope with it, a rule of thumb to quantify it, plus an example of how to design systems differently based on this observation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We believe that for the recent past and foreseeable future, off-chip memory bandwidth will often be the constraining resource [23].”
From Roofline: an insightful visual performance model for multicore architectures (2009) · cites this paper as [23]
Citations
Cites
Computer Architecture: A Quantitative Approach
Hennessy, J. L., & Patterson, D. A. (1989) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 9,374
Self-citationComputer Organization and Design: the Hardware/Software Interface
Patterson, D. A., & Hennessy, J. L. (1993) · Cited by 1,623
Self-citationComputer organization and design (2nd ed.): the hardware/software interface
Patterson, D. A., & Hennessy, J. L. (1997) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 216
Self-citationTechnological impact of magnetic hard disk drives on storage systems
GROCHOWSKI, E., & Halem, R. D. (2003) · IBM Systems Journal · doi:10.1147/sj.422.0338 · Cited by 166
A survey of synchronous RAM architectures
Gries, M. (1999) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-004287257 · Cited by 6
Research works printed but not linked: 3
- Hennessy J., 1990, Morgan Kauffman
- Patterson D., 2004, CA, 1994, 1998
- Ross P. 5 commandments of engineering. IEEE Spectrum (Dec. 2003). Ross P. 5 commandments of engineering. IEEE Spectrum (Dec. 2003).
Cited by
Williams, S., Waterman, A., & Patterson, D. A. (2009) · Communications of the ACM · doi:10.1145/1498765.1498785 · Cited by 2,798
Self-citation(2006) · Cited by 1,979
Self-citationIn-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,240
Self-citationComputer Architecture, Fifth Edition: A Quantitative Approach
Hennessy, J. L., & Patterson, D. A. (2011) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 889
Self-citationOverview of candidate device technologies for storage-class memory
Burr, G. W., Kurdi, B. N., Scott, J. C., Lam, C. H., Gopalakrishnan, K., & Shenoy, R. S. (2008) · IBM Journal of Research and Development · doi:10.1147/rd.524.0449 · Cited by 687
Metadata
- Authors
- Patterson, D. A.
- Affiliations
- University of California, Berkeley (US)
- Corresponding author
- Patterson, David A.
- ORCID
- Patterson, David A.
- Venue
- Communications of the ACM
- Published
- 2004-10
- Volume
- 47
- Issue
- 10
- Pages
- 71-75
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W1999563089
- Cited by
- 238
- References
- 5
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 2 · 2022: 11 · 2021: 6 · 2020: 6 · 2019: 8 · 2018: 10 · 2017: 11 · 2016: 16 · 2015: 12 · 2014: 17 · 2013: 16 · 2012: 9
- FWCI
- 15.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Traffic and Congestion Control
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- latency, bandwidth, performance trends, network performance, system design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.