The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Network traffic characteristics of data centers in the wild
Abstract
Although there is tremendous interest in designing improved networks for data centers, very little is known about the network-level traffic characteristics of data centers today. In this paper, we conduct an empirical study of the network traffic in 10 data centers belonging to three different categories, including university, enterprise campus, and cloud data centers. Our definition of cloud data centers includes not only data centers employed by large online service providers offering Internet-facing applications but also data centers used to host data-intensive (MapReduce style) applications). We collect and analyze SNMP statistics, topology and packet-level traces. We examine the range of applications deployed in these data centers and their placement, the flow-level and packet-level transmission properties of these applications, and their impact on network and link utilizations, congestion and packet drops. We describe the implications of the observed traffic patterns for data center internal traffic engineering as well as for recently proposed architectures for data center networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476
Wide area traffic: the failure of Poisson modeling
Paxson, V., & Floyd, S. (1995) · IEEE/ACM Transactions on Networking · doi:10.1109/90.392383 · Cited by 3,708
A scalable, commodity data center network architecture
Al-Fares, M., Loukissas, A., & Vahdat, A. (2008) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1402946.1402967 · Cited by 3,175
Bro: a system for detecting network intruders in real-time
Paxson, V. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00112-7 · Cited by 2,636
VL2: a scalable and flexible data center network
Greenberg, A., Hamilton, J. R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Maltz, D. A., Patel, P., & Sengupta, S. (2009) · Proceedings of the ACM SIGCOMM 2009 conference on Data communication · doi:10.1145/1592568.1592576 · Cited by 2,111
Self-citationA scalable, commodity data center network architecture
Al-Fares, M., Loukissas, A., & Vahdat, A. (2008) · Proceedings of the ACM SIGCOMM 2008 conference on Data communication · doi:10.1145/1402958.1402967 · Cited by 1,679
Hedera: dynamic flow scheduling for data center networks
Al-Fares, M., Radhakrishnan, S., Raghavan, B., Huang, N., & Vahdat, A. M. (2010) · doi:10.5555/1855711.1855730 · Cited by 1,450
BCube: a high performance, server-centric network architecture for modular data centers
Guo, C., Lu, G., Li, D., Wu, H., Zhang, X., Shi, Y., Tian, C., Zhang, Y., & Lu, S. (2009) · Proceedings of the ACM SIGCOMM 2009 conference on Data communication · doi:10.1145/1592568.1592577 · Cited by 1,372
On the self-similar nature of Ethernet traffic
Leland, W. E., Taqqu, M. S., Willinger, W., & Wilson, D. V. (1993) · Conference proceedings on Communications architectures, protocols and applications · doi:10.1145/166237.166255 · Cited by 1,077
The nature of data center traffic: measurements & analysis
Kandula, S., Sengupta, S., Greenberg, A., Patel, P., & Chaiken, R. (2009) · Proceedings of the 9th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1644893.1644918 · Cited by 1,030
Cited by
Software-Defined Networking: A Comprehensive Survey
Kreutz, D., Ramos, F. M. V., Esteves Verissimo, P., Esteve Rothenberg, C., Azodolmolky, S., & Uhlig, S. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2371999 · Cited by 5,050
DevoFlow: scaling flow management for high-performance networks
Curtis, A. R., Mogul, J. C., Tourrilhes, J., Yalagandula, P., Sharma, P., & Banerjee, S. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018466 · Cited by 959
Inside the Social Network's (Datacenter) Network
Roy, A., Zeng, H., Bagga, J., Porter, G., & Snoeren, A. C. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787472 · Cited by 849
A survey on software-defined network and openflow: From concept to implementation
Hu, F., Hao, Q., & Bao, K. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2326417 · Cited by 752
Understanding network failures in data centers: measurement, analysis, and implications
Gill, P., Jain, N., & Nagappan, N. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018477 · Cited by 714
Xie, J., Yu, F. R., Huang, T., Xie, R., Liu, J., Wang, C., & Liu, Y. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2866942 · Cited by 700
MicroTE: fine grained traffic engineering for data centers
Benson, T., Anand, A., Akella, A., & Zhang, M. (2011) · Proceedings of the Seventh COnference on emerging Networking EXperiments and Technologies · doi:10.1145/2079296.2079304 · Cited by 604
Self-citationA Survey on Optical Interconnects for Data Centers
Kachris, C., & Tomkos, I. (2012) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.122111.00069 · Cited by 594
DevoFlow: scaling flow management for high-performance networks
Curtis, A. R., Mogul, J. C., Tourrilhes, J., Yalagandula, P., Sharma, P., & Banerjee, S. (2011) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2043164.2018466 · Cited by 543
A roadmap for traffic engineering in SDN-OpenFlow networks
Akyildiz, I. F., Lee, A., Wang, P., Luo, M., & Chou, W. (2014) · Computer Networks · doi:10.1016/j.comnet.2014.06.002 · Cited by 536
On scalability of software-defined networking
Yeganeh, S. H., Tootoonchian, A., & Ganjali, Y. (2013) · IEEE Communications Magazine · doi:10.1109/mcom.2013.6461198 · Cited by 500
OpenNF: enabling innovation in network function control
Gember-Jacobson, A., Viswanathan, R., Prakash, C., Grandl, R., Khalid, J., Das, S., & Akella, A. (2014) · Proceedings of the 2014 ACM conference on SIGCOMM · doi:10.1145/2619239.2626313 · Cited by 478
Self-citationOSA: An Optical Switching Architecture for Data Center Networks With Unprecedented Flexibility
Chen, K., Singla, A., Singh, A., Ramachandran, K., Xu, L., Zhang, Y., Wen, X., & Chen, Y. (2014) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2013.2253120 · Cited by 463
Distributed SDN Control: Survey, Taxonomy, and Challenges
Bannour, F., Souihi, S., & Mellouk, A. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2782482 · Cited by 452
Finishing flows quickly with preemptive scheduling
Hong, C.-Y., Caesar, M., & Godfrey, P. B. (2012) · Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication · doi:10.1145/2342356.2342389 · Cited by 451
Towards an elastic distributed SDN controller
Dixit, A., Hao, F., Mukherjee, S., Lakshman, T. V., & Kompella, R. (2013) · Proceedings of the second ACM SIGCOMM workshop on Hot topics in software defined networking · doi:10.1145/2491185.2491193 · Cited by 445
Orchestrating Virtualized Network Functions
Bari, F., Chowdhury, S. R., Ahmed, R., Boutaba, R., & Duarte, O. C. M. B. (2016) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2016.2569020 · Cited by 417
Pingmesh: A Large-Scale System for Data Center Network Latency Measurement and Analysis
Guo, C., Yuan, L., Xiang, D., Dang, Y., Huang, R., Maltz, D., Liu, Z., Wang, V., Pang, B., Chen, H., et al. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787496 · Cited by 390
Self-citationA survey: Control plane scalability issues and approaches in Software-Defined Networking (SDN)
Karakus, M., & Durresi, A. (2017) · Computer Networks · doi:10.1016/j.comnet.2016.11.017 · Cited by 373
E2: a framework for NFV applications
Palkar, S., Lan, C., Han, S., Jang, K., Panda, A., Ratnasamy, S., Rizzo, L., & Shenker, S. (2015) · Proceedings of the 25th Symposium on Operating Systems Principles · doi:10.1145/2815400.2815423 · Cited by 322
Augmenting data center networks with multi-gigabit wireless links
Halperin, D., Kandula, S., Padhye, J., Bahl, P., & Wetherall, D. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018442 · Cited by 312
Understanding network failures in data centers: measurement, analysis, and implications
Gill, P., Jain, N., & Nagappan, N. (2011) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2043164.2018477 · Cited by 304
On orchestrating virtual network functions
Bari, M. F., Chowdhury, S. R., Ahmed, R., & Boutaba, R. (2015) · 2015 11th International Conference on Network and Service Management (CNSM) · doi:10.1109/cnsm.2015.7367338 · Cited by 300
Towards an elastic distributed SDN controller
Dixit, A., Hao, F., Mukherjee, S., Lakshman, T. V., & Kompella, R. (2013) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2534169.2491193 · Cited by 287
Statistical Characterization of Business-Critical Workloads Hosted in Cloud Datacenters
Shen, S., Van Beek, V., & Iosup, A. (2015) · 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing · doi:10.1109/ccgrid.2015.60 · Cited by 286
AuTO: scaling deep reinforcement learning for datacenter-scale automatic traffic optimization
Chen, L., Lingys, J., Chen, K., & Liu, F. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230551 · Cited by 282
(2014) · doi:10.5555/2616448.2616456 · Cited by 281
DRILL: Micro Load Balancing for Low-latency Data Center Networks
Ghorbani, S., Yang, Z., Godfrey, P. B., Ganjali, Y., & Firoozshahian, A. (2017) · Proceedings of the Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3098822.3098839 · Cited by 271
Mirror mirror on the ceiling: flexible wireless links for data centers
Zhou, X., Zhang, Z., Zhu, Y., Li, Y., Kumar, S., Vahdat, A., Zhao, B. Y., & Zheng, H. (2012) · Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication · doi:10.1145/2342356.2342440 · Cited by 270
A Survey on Data Center Networking (DCN): Infrastructure and Operations
Xia, W., Zhao, P., Wen, Y., & Xie, H. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2626784 · Cited by 267
FlowSense: Monitoring Network Utilization with Zero Measurement Cost
Yu, C., Lumezanu, C., Zhang, Y., Singh, V., Jiang, G., & Madhyastha, H. V. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-36516-4_4 · Cited by 264
Revisiting network support for RDMA
Mittal, R., Shpiner, A., Panda, A., Zahavi, E., Krishnamurthy, A., Ratnasamy, S., & Shenker, S. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230557 · Cited by 258
Optical interconnection networks in data centers: recent trends and future challenges
Kachris, C., Kanonakis, K., & Tomkos, I. (2013) · IEEE Communications Magazine · doi:10.1109/mcom.2013.6588648 · Cited by 252
ElastiCon: an elastic distributed sdn controller
Dixit, A. A., Hao, F., Mukherjee, S., Lakshman, T. V., & Kompella, R. (2014) · Proceedings of the tenth ACM/IEEE symposium on Architectures for networking and communications systems · doi:10.1145/2658260.2658261 · Cited by 222
“For instance, based on measurements over real data centers in [3], we estimate that the peak-to-median ratio of flow arrival rates is almost 1-2 orders of magnitude (more details in Section 2).”
BackgroundOnline flow size prediction for improved network routing
Poupart, P., Chen, Z., Jaini, P., Fung, F., Susanto, H., Geng, Y., Chen, L., Chen, K., & Jin, H. (2016) · 2016 IEEE 24th International Conference on Network Protocols (ICNP) · doi:10.1109/icnp.2016.7785324 · Cited by 96
Optimizing Virtual Machine placement in IaaS data centers: Taxonomy, review and open issues
Talebian, H., Gani, A., Sookhak, M., Abdelatif, A. A., Yousafzai, A., Vasilakos, A. V., & Yu, F. R. (2020) · Cluster Computing · doi:10.1007/s10586-019-02954-w · Cited by 72
Responsive multipath TCP in SDN-based datacenters
Duan, J., Wang, Z., & Wu, C. (2015) · 2015 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2015.7249165 · Cited by 37
“Many large flows exist in a datacenter network, for content replication, virtual machine migration, and data shuffling in MapReduce-like computational workloads, which constitute the majority of datacenter traffic [1].”
BackgroundAn energy-efficient VM placement method for cloud data centers using a hybrid genetic algorithm
Kaaouache, M. A., & Bouamama, S. (2018) · Journal of Systems and Information Technology · doi:10.1108/jsit-10-2017-0089 · Cited by 18
Metadata
- Authors
- Benson, T., Akella, A., & Maltz, D. A.
- Venue
- Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
- Publisher
- ACM
- Published
- 2010-11
- Pages
- 267-280
- OpenAlex
- W2168595508
- Cited by
- 2,214
- References
- 26
- FWCI
- 61.58
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.