A scalable, commodity data center network architecture
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Today's data centers may contain tens of thousands of computers with significant aggregate bandwidth requirements. The network architecture typically consists of a tree of routing and switching elements with progressively more specialized and expensive equipment moving up the network hierarchy. Unfortunately, even when deploying the highest-end IP switches/routers, resulting topologies may only support 50% of the aggregate bandwidth available at the edge of the network, while still incurring tremendous cost. Non-uniform bandwidth among data center nodes complicates application design and limits overall system performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1979) · Cited by 43,841
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004 · cited 1×
“A query to a web search engine often requires parallel communication wi th every node in the cluster hosting the inverted index to return t he most relevant results [7].”
BackgroundGhemawat, S., Gobioff, H., & Leung, S.-T. (2003) · ACM SIGOPS Operating Systems Review · doi:10.1145/1165389.945450 · Cited by 4,984
(2007) · doi:10.1145/1294261.1294281 · Cited by 3,447 · cited 2×
“Applications running on cluster-based file systems [18, 28, 13, 26] often require remote-node access before proceeding with their I/O operations.”
Kohler, E., Morris, R., Chen, B., Jannotti, J., & Kaashoek, M. F. (2000) · ACM Transactions on Computer Systems · doi:10.1145/354871.354874 · Cited by 2,413
Fat-trees: Universal networks for hardware-efficient supercomputing
Leiserson, C. E. (1985) · IEEE Transactions on Computers · doi:10.1109/tc.1985.6312192 · Cited by 1,325
GPFS: A Shared-Disk File System for Large Computing Clusters
Schmuck, F., & Haskin, R. L. (2002) · Cited by 1,242
The Internet Engineering Task Force
Needleman, M. (2000) · Serials Review · doi:10.1016/s0098-7913(99)00073-8 · Cited by 457
NetFPGA--An Open Platform for Gigabit-Rate Network Switching and Routing
Lockwood, J. W., McKeown, N., Watson, G., Gibb, G., Hartke, P., Naous, J., Raghuraman, R., & Luo, J. (2007) · 2007 IEEE International Conference on Microelectronic Systems Education (MSE'07) · doi:10.1109/mse.2007.69 · Cited by 314
Multipath Issues in Unicast and Multicast Next-Hop Selection
Thaler, D., & Hopps, C. (2000) · doi:10.17487/rfc2991 · Cited by 300
Cited by
Cloud computing: state-of-the-art and research challenges
Zhang, Q., Cheng, L., & Boutaba, R. (2010) · Journal of Internet Services and Applications · doi:10.1007/s13174-010-0007-6 · Cited by 3,515
Network traffic characteristics of data centers in the wild
Benson, T., Akella, A., & Maltz, D. A. (2010) · Proceedings of the 10th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1879141.1879175 · Cited by 2,214
VL2: a scalable and flexible data center network
Greenberg, A., Hamilton, J. R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Maltz, D. A., Patel, P., & Sengupta, S. (2009) · Proceedings of the ACM SIGCOMM 2009 conference on Data communication · doi:10.1145/1592568.1592576 · Cited by 2,111
Alizadeh, M., Greenberg, A., Maltz, D. A., Padhye, J., Patel, P., Prabhakar, B., Sengupta, S., & Sridharan, M. (2010) · Proceedings of the ACM SIGCOMM 2010 conference · doi:10.1145/1851182.1851192 · Cited by 1,877
B4: experience with a globally-deployed software defined wan
Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., Venkata, S., Wanderer, J., Zhou, J., Zhu, M., et al. (2013) · Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM · doi:10.1145/2486001.2486019 · Cited by 1,771
Self-citationThe Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
Barroso, L. A., & Hölzle, U. (2009) · Synthesis lectures on computer architecture · doi:10.2200/s00193ed1v01y200905cac006 · Cited by 1,714
BCube: a high performance, server-centric network architecture for modular data centers
Guo, C., Lu, G., Li, D., Wu, H., Zhang, X., Shi, Y., Tian, C., Zhang, Y., & Lu, S. (2009) · Proceedings of the ACM SIGCOMM 2009 conference on Data communication · doi:10.1145/1592568.1592577 · Cited by 1,372
B4: experience with a globally-deployed software defined wan
Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., Venkata, S., Wanderer, J., Zhou, J., Zhu, M., et al. (2013) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2534169.2486019 · Cited by 1,004
Self-citationImproving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement
Meng, X., Pappas, V., & Zhang, L. (2010) · 2010 Proceedings IEEE INFOCOM · doi:10.1109/infcom.2010.5461930 · Cited by 935
PortLand: a scalable fault-tolerant layer 2 data center network fabric
Niranjan Mysore, R., Pamboris, A., Farrington, N., Huang, N., Miri, P., Radhakrishnan, S., Subramanya, V., & Vahdat, A. (2009) · Proceedings of the ACM SIGCOMM 2009 conference on Data communication · doi:10.1145/1592568.1592575 · Cited by 929
Self-citationHelios: a hybrid electrical/optical switch architecture for modular data centers
Farrington, N., Porter, G., Radhakrishnan, S., Bazzaz, H. H., Subramanya, V., Fainman, Y., Papen, G., & Vahdat, A. (2010) · Proceedings of the ACM SIGCOMM 2010 conference · doi:10.1145/1851182.1851223 · Cited by 918
Self-citationInside the Social Network's (Datacenter) Network
Roy, A., Zeng, H., Bagga, J., Porter, G., & Snoeren, A. C. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787472 · Cited by 849
Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport
Baliga, J., Ayre, R. W. A., Hinton, K., & Tucker, R. S. (2011) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2060451 · Cited by 840
A survey on software-defined network and openflow: From concept to implementation
Hu, F., Hao, Q., & Bao, K. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2326417 · Cited by 752
“While SDN is suitable for some deployment environments (such as homes [76], [77], data centers [78], and the enterprise [79]), delegating control to a remote system has raised a number of questions on control-plane scaling implications of such an approach.”
BackgroundTowards predictable datacenter networks
Ballani, H., Costa, P., Karagiannis, T., & Rowstron, A. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018465 · Cited by 750
VL2: a scalable and flexible data center network
Greenberg, A., Hamilton, J. R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Maltz, D. A., Patel, P., & Sengupta, S. (2009) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1594977.1592576 · Cited by 711
Improving datacenter performance and robustness with multipath TCP
Raiciu, C., Barre, S., Pluntke, C., Greenhalgh, A., Wischik, D., & Handley, M. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018467 · Cited by 678
Data Center Network Virtualization: A Survey
Bari, M. F., Boutaba, R., Esteves, R., Granville, L. Z., Podlesny, M., Rabbani, M. G., Zhang, Q., & Zhani, M. F. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.090512.00043 · Cited by 677
c-Through: part-time optics in data centers
Wang, G., Andersen, D. G., Kaminsky, M., Papagiannaki, K., Ng, T. S. E., Kozuch, M., & Ryan, M. (2010) · Proceedings of the ACM SIGCOMM 2010 conference · doi:10.1145/1851182.1851222 · Cited by 653
MicroTE: fine grained traffic engineering for data centers
Benson, T., Anand, A., Akella, A., & Zhang, M. (2011) · Proceedings of the Seventh COnference on emerging Networking EXperiments and Technologies · doi:10.1145/2079296.2079304 · Cited by 604
Better never than late: meeting deadlines in datacenter networks
Wilson, C., Ballani, H., Karagiannis, T., & Rowtron, A. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018443 · Cited by 579
Don't settle for eventual: scalable causal consistency for wide-area storage with COPS
Lloyd, W., Freedman, M. J., Kaminsky, M., & Andersen, D. G. (2011) · Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles · doi:10.1145/2043556.2043593 · Cited by 565
FAWN: a fast array of wimpy nodes
Andersen, D. G., Franklin, J., Kaminsky, M., Phanishayee, A., Tan, L., & Vasudevan, V. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629577 · Cited by 561
Resource Management in Clouds: Survey and Research Challenges
Jennings, B., & Stadler, R. (2015) · Journal of Network and Systems Management · doi:10.1007/s10922-014-9307-7 · Cited by 548
Understanding data center traffic characteristics
Benson, T., Anand, A., Akella, A., & Zhang, M. (2010) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1672308.1672325 · Cited by 548
Alizadeh, M., Greenberg, A., Maltz, D. A., Padhye, J., Patel, P., Prabhakar, B., Sengupta, S., & Sridharan, M. (2010) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1851275.1851192 · Cited by 548
BCube: a high performance, server-centric network architecture for modular data centers
Guo, C., Lu, G., Li, D., Wu, H., Zhang, X., Shi, Y., Tian, C., Zhang, Y., & Lu, S. (2009) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1594977.1592577 · Cited by 535
Characterizing cloud computing hardware reliability
Vishwanath, K. V., & Nagappan, N. (2010) · Proceedings of the 1st ACM symposium on Cloud computing · doi:10.1145/1807128.1807161 · Cited by 509
RDMA over Commodity Ethernet at Scale
Guo, C., Wu, H., Deng, Z., Soni, G., Ye, J., Padhye, J., & Lipshteyn, M. (2016) · Proceedings of the 2016 ACM SIGCOMM Conference · doi:10.1145/2934872.2934908 · Cited by 497
Heracles: improving resource efficiency at scale
Lo, D., Cheng, L., Govindaraju, R., Ranganathan, P., & Kozyrakis, C. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2749475 · Cited by 466
OSA: An Optical Switching Architecture for Data Center Networks With Unprecedented Flexibility
Chen, K., Singla, A., Singh, A., Ramachandran, K., Xu, L., Zhang, Y., Wen, X., & Chen, Y. (2014) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2013.2253120 · Cited by 463
Finishing flows quickly with preemptive scheduling
Hong, C.-Y., Caesar, M., & Godfrey, P. B. (2012) · Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication · doi:10.1145/2342356.2342389 · Cited by 451
TIMELY: RTT-based Congestion Control for the Datacenter
Mittal, R., Lam, V. T., Dukkipati, N., Blem, E., Wassel, H., Ghobadi, M., Vahdat, A., Wang, Y., Wetherall, D., & Zats, D. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787510 · Cited by 448
Self-citationUnderstanding data center traffic characteristics
Benson, T., Anand, A., Akella, A., & Zhang, M. (2009) · Proceedings of the 1st ACM workshop on Research on enterprise networking · doi:10.1145/1592681.1592692 · Cited by 447
Verma, S., Kawamoto, Y., Fadlullah, Z. M., Nishiyama, H., & Kato, N. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2694469 · Cited by 422
Multi-resource packing for cluster schedulers
Grandl, R., Ananthanarayanan, G., Kandula, S., Rao, S., & Akella, A. (2014) · Proceedings of the 2014 ACM conference on SIGCOMM · doi:10.1145/2619239.2626334 · Cited by 421
Energy proportional datacenter networks
Abts, D., Marty, M. R., Wells, P. M., Klausler, P., & Liu, H. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1816004 · Cited by 414
Mahout: Low-overhead datacenter traffic management using end-host-based elephant detection
Curtis, A. R., Kim, W., & Yalagandula, P. (2011) · 2011 Proceedings IEEE INFOCOM · doi:10.1109/infcom.2011.5934956 · Cited by 402
Pingmesh: A Large-Scale System for Data Center Network Latency Measurement and Analysis
Guo, C., Yuan, L., Xiang, D., Dang, Y., Huang, R., Maltz, D., Liu, Z., Wang, V., Pang, B., Chen, H., et al. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787496 · Cited by 390
A Power Benchmarking Framework for Network Devices
Mahadevan, P., Sharma, P., Banerjee, S., & Ranganathan, P. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01399-7_62 · Cited by 387
PortLand: a scalable fault-tolerant layer 2 data center network fabric
Niranjan Mysore, R., Pamboris, A., Farrington, N., Huang, N., Miri, P., Radhakrishnan, S., Subramanya, V., & Vahdat, A. (2009) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1594977.1592575 · Cited by 379
Self-citationHelios: a hybrid electrical/optical switch architecture for modular data centers
Farrington, N., Porter, G., Radhakrishnan, S., Bazzaz, H. H., Subramanya, V., Fainman, Y., Papen, G., & Vahdat, A. (2010) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1851275.1851223 · Cited by 362
Self-citationA survey on service function chaining
Bhamare, D., Jain, R., Samaka, M., & Erbad, A. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.09.001 · Cited by 331
Augmenting data center networks with multi-gigabit wireless links
Halperin, D., Kandula, S., Padhye, J., Bahl, P., & Wetherall, D. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018442 · Cited by 312
ProjecToR: Agile Reconfigurable Data Center Interconnect
Ghobadi, M., Mahajan, R., Phanishayee, A., Devanur, N., Kulkarni, J., Ranade, G., Blanche, P.-A., Rastegarfar, H., Glick, M., & Kilper, D. (2016) · Proceedings of the 2016 ACM SIGCOMM Conference · doi:10.1145/2934872.2934911 · Cited by 286
DRILL: Micro Load Balancing for Low-latency Data Center Networks
Ghorbani, S., Yang, Z., Godfrey, P. B., Ganjali, Y., & Firoozshahian, A. (2017) · Proceedings of the Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3098822.3098839 · Cited by 271
Network topology design at 27,000 km/hour
Bhattacherjee, D., & Singla, A. (2019) · Proceedings of the 15th International Conference on Emerging Networking Experiments And Technologies · doi:10.1145/3359989.3365407 · Cited by 271
Mirror mirror on the ceiling: flexible wireless links for data centers
Zhou, X., Zhang, Z., Zhu, Y., Li, Y., Kumar, S., Vahdat, A., Zhao, B. Y., & Zheng, H. (2012) · Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication · doi:10.1145/2342356.2342440 · Cited by 270
Self-citationA Survey on Data Center Networking (DCN): Infrastructure and Operations
Xia, W., Zhao, P., Wen, Y., & Xie, H. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2626784 · Cited by 267
HyperX: topology, routing, and packaging of efficient large-scale networks
Ahn, J. H., Binkert, N., Davis, A., McLaren, M., & Schreiber, R. S. (2009) · Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis · doi:10.1145/1654059.1654101 · Cited by 264
VM consolidation: A real case based on OpenStack Cloud
Corradi, A., Fanelli, M., & Foschini, L. (2014) · Future Generation Computer Systems · doi:10.1016/j.future.2012.05.012 · Cited by 240
Proteus: a topology malleable data center network
Singla, A., Singh, A., Ramachandran, K., Xu, L., & Zhang, Y. (2010) · Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks · doi:10.1145/1868447.1868455 · Cited by 229
“[ 6 , 10]. While for certain traffic patterns this is a necessity, recent work has argued that such traffic patterns are, at the least, not ubiquitous [13].”
BackgroundDOS: a scalable optical switch for datacenters
Ye, X., Yin, Y., Yoo, S. J. B., Mejia, P., Proietti, R., & Akella, V. (2010) · Proceedings of the 6th ACM/IEEE Symposium on Architectures for Networking and Communications Systems · doi:10.1145/1872007.1872037 · Cited by 223
“For example, Al-Fares [ 1 ] uses commodity off-the-shelf Ethernet switches while InfiniBand [15] utilizes special switches based on the InfiniBand protocol.”
BackgroundMethodCloudNaaS: a cloud networking platform for enterprise applications
Benson, T., Akella, A., Shaikh, A., & Sahu, S. (2011) · Proceedings of the 2nd ACM Symposium on Cloud Computing · doi:10.1145/2038916.2038924 · Cited by 206
“All links in the Fat-Tree topologies are assumed to be 1Gbps.”
MethodInfluentialA taxonomy and survey on Green Data Center Networks
Bilal, K., Malik, S. U. R., Khalid, O., Hameed, A., Alvarez, E., Wijaysekara, V., Irfan, R., Shrestha, S., Dwivedy, D., Ali, M., et al. (2014) · Future Generation Computer Systems · doi:10.1016/j.future.2013.07.006 · Cited by 201
Alibaba HPN: A Data Center Network for Large Language Model Training
Qian, K., Xi, Y., Cao, J., Gao, J., Xu, Y., Guan, Y., Fu, B., Shi, X., Zhu, F., Miao, R., et al. (2024) · Proceedings of the ACM SIGCOMM 2024 Conference · doi:10.1145/3651890.3672265 · Cited by 176
Datacenter Traffic Control: Understanding Techniques and Tradeoffs
Noormohammadpour, M., & Raghavendra, C. S. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2782753 · Cited by 172
“1) Fat-Tree: Fat-Tree [10], shown in Figure 2(a), is a multi-rooted tree topology where every root is called a core switch.”
Network configuration synthesis with abstract topologies
Beckett, R., Mahajan, R., Millstein, T., Padhye, J., & Walker, D. (2017) · Proceedings of the 38th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3062341.3062367 · Cited by 62
Efficient multi-tenant virtual machine allocation in cloud data centers
Li, J., Li, D., Ye, Y., & Lu, X. (2015) · Tsinghua Science and Technology · doi:10.1109/tst.2015.7040517 · Cited by 45
Responsive multipath TCP in SDN-based datacenters
Duan, J., Wang, Z., & Wu, C. (2015) · 2015 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2015.7249165 · Cited by 37
“From the routing aspect, datacenter networks are typically built on a fat-tree topology [2], providing redundant paths between different hosts.”
BackgroundMethodInfluential
Metadata
- Authors
- Al-Fares, M., Loukissas, A., & Vahdat, A.
- Venue
- Proceedings of the ACM SIGCOMM 2008 conference on Data communication
- Publisher
- ACM
- Published
- 2008-08-17
- Pages
- 63-74
- OpenAlex
- W4238465620
- Cited by
- 1,679
- References
- 12
- FWCI
- 40.46
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.