The DOI matches its Crossref record; 69 of the 72 references it cites were found in a registry or an index.
An Open-Source Benchmark Suite for Microservices and Their Hardware-Software Implications for Cloud & Edge Systems
Open accessAbstract
Cloud services have recently started undergoing a major shift from monolithic applications, to graphs of hundreds or thousands of loosely-coupled microservices. Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and cloud utilization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Witten, I. H. (2008) · Cited by 9,143
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
Self-citationDean, J., & Barroso, L. A. (2013) · Communications of the ACM · doi:10.1145/2408776.2408794 · Cited by 1,852
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
Barroso, L. A., & Hölzle, U. (2009) · Synthesis lectures on computer architecture · doi:10.2200/s00193ed1v01y200905cac006 · Cited by 1,711
(2011) · doi:10.5555/1972457.1972488 · Cited by 1,619
Large-scale cluster management at Google with Borg
Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., & Wilkes, J. (2015) · Proceedings of the Tenth European Conference on Computer Systems · doi:10.1145/2741948.2741964 · Cited by 1,468
Ferdman, M., Adileh, A., Kocberber, O., Volos, S., Alisafaee, M., Jevdjic, D., Kaynak, C., Popescu, A. D., Ailamaki, A., & Falsafi, B. (2012) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2150976.2150982 · Cited by 818
Delimitrou, C., & Kozyrakis, C. (2014) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2541940.2541941 · Cited by 704
Self-citationA reconfigurable fabric for accelerating large-scale datacenter services
Putnam, A. R., Caulfield, A. M., Chung, E. S., Chiou, D., Constantinides, K., Demme, J., Esmaeilzadeh, H., Fowers, J., Gopal, G. P., Gray, J., et al. (2014) · ACM SIGARCH Computer Architecture News · doi:10.1145/2678373.2665678 · Cited by 700
Schwarzkopf, M., Konwinski, A., Abd-El-Malek, M., & Wilkes, J. (2013) · European Conference on Computer Systems · doi:10.1145/2465351.2465386 · Cited by 651
Delimitrou, C., & Kozyrakis, C. (2013) · doi:10.1145/2451116.2451125 · Cited by 618
Self-citationOusterhout, K., Wendell, P., Zaharia, M., & Stoica, I. G. (2013) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/2517349.2522716 · Cited by 586
Nathuji, R., Kansal, A., & Ghaffarkhah, A. (2010) · European Conference on Computer Systems · doi:10.1145/1755913.1755938 · Cited by 571
Distributed caching with memcached
Fitzpatrick, B. (2004) · Linux journal · Cited by 505
Dapper, a Large-Scale Distributed Systems Tracing Infrastructure
Sigelman, B. H., Barroso, L. A., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., Jaspan, S., & Shanbhag, C. (2010) · Cited by 477
Lo, D., Cheng, L., Govindaraju, R., Ranganathan, P., & Kozyrakis, C. (2015) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/2749469.2749475 · Cited by 469
BigDataBench: A Big Data Benchmark Suite from Internet ServicesPreprint
Wang, L., Zhan, J., Luo, C., Zhu, Y., Yang, Q., He, Y., Gao, W., & Jia, Z. (2014) · Cited by 440
Self-citationBigDataBench: A big data benchmark suite from internet services
Wang, L., Zhan, J., Luo, C., Zhu, Y., Yang, Q., He, Y., Gao, W., Jia, Z., Shi, Y., Zhang, S., et al. (2014) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2014.6835958 · Cited by 422
Self-citationPower management of online data-intensive services
Meisner, D., Sadler, C. M., Barroso, L. A., Weber, W.-D., & Wenisch, T. F. (2011) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/2000064.2000103 · Cited by 412
Profiling a warehouse-scale computer
Kanev, S., Darago, J. P., Hazelwood, K., Ranganathan, P., Moseley, T., Wei, G.-Y., & Brooks, D. M. (2015) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/2749469.2750392 · Cited by 409
Madhavapeddy, A., Mortier, R., Rotsos, C., Scott, D., Singh, B., Gazagnaire, T., Smith, S., Hand, S., & Crowcroft, J. (2013) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2451116.2451167 · Cited by 400
Distributed caching with memcached
FitzpatrickBrad (2004) · Linux journal · doi:10.5555/1012889.1012894 · Cited by 390
Yang, H., Breslow, A. D., Mars, J., & Tang, L. (2013) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/2485922.2485974 · Cited by 346
Serving DNNs in Real Time at Datacenter Scale with Project Brainwave
Chung, E. S., Fowers, J., Ovtcharov, K., Papamichael, M. K., Caulfield, A. M., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., et al. (2018) · IEEE Micro · doi:10.1109/mm.2018.022071131 · Cited by 329
Prabhakar, R., Zhang, Y., Koeplinger, D., Feldman, M., Zhao, T. Y., Hadjis, S., Pedram, A., Kozyrakis, C., & Olukotun, K. (2017) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3079856.3080256 · Cited by 255
Self-citationLi, J., Sharma, N. K., Ports, D. R. K., & Gribble, S. D. (2014) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/2670979.2670988 · Cited by 235
Reconciling high server utilization and sub-millisecond quality-of-service
Leverich, J., & Kozyrakis, C. (2014) · European Conference on Computer Systems · doi:10.1145/2592798.2592821 · Cited by 221
Data Mining, Fourth Edition: Practical Machine Learning Tools and Techniques
Witten, I. H., Frank, E., Hall, M. A., & Pal, C. (2016) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 199
Google-Wide Profiling: A Continuous Profiling Infrastructure for Data Centers
Ren, G., Tune, E., Moseley, T., Shi, Y., Rus, S., & Hundt, R. (2010) · IEEE Micro · doi:10.1109/mm.2010.68 · Cited by 197
Reddi, V. J., Lee, B. C., Chilimbi, T. M., & Vaid, K. (2010) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/1815961.1816002 · Cited by 194
Hauswald, J., Laurenzano, M. A., Zhang, Y., Li, C., Rovinski, A., Khurana, A., Dreslinski, R., Mudge, T., Petrucci, V., Tang, L., et al. (2015) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2694344.2694347 · Cited by 193
Self-citationExploiting Platform Heterogeneity for Power Efficient Data Centers
Nathuji, R., Isci, C., & Gorbatov, E. (2007) · International Conference on Autonomic Computing · doi:10.1109/icac.2007.16 · Cited by 192
The BellKor 2008 Solution to the Netflix Prize
Bell, R. M., Koren, Y., & Volinsky, C. T. (2007) · Cited by 190
Convergence and efficiency of subgradient methods for quasiconvex minimization
Kiwiel, K. C. (2001) · Mathematical Programming · doi:10.1007/pl00011414 · Cited by 184
The mystery machine: end-to-end performance analysis of large-scale internet services
Chow, M., Meisner, D., Flinn, J., Peek, D., & Wenisch, T. F. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685066 · Cited by 182
Benchmarking microservice systems for software engineering research
Zhou, X., Peng, X., Xie, T., Sun, J., Xu, C., Ji, C., & Zhao, W. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3183440.3194991 · Cited by 181
Tailbench: a benchmark suite and evaluation methodology for latency-critical applications
Kasture, H., & Sánchez, D. (2016) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2016.7581261 · Cited by 179
QoS-Aware scheduling in heterogeneous datacenters with paragon
Delimitrou, C., & Kozyrakis, C. (2013) · ACM Transactions on Computer Systems · doi:10.1145/2556583 · Cited by 155
Self-citationDelimitrou, C., Sánchez, D., & Kozyrakis, C. (2015) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/2806777.2806779 · Cited by 155
Self-citationMars, J., & Tang, L. (2013) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/2485922.2485975 · Cited by 148
Workload characterization for microservices
Ueda, T., Nakaike, T., & Ohara, M. (2016) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2016.7581269 · Cited by 138
Understanding Service-Oriented Architecture
(2006) · Springer eBooks · doi:10.1007/1-4020-3705-8_1 · Cited by 131
The Architectural Implications of Cloud Microservices
Gan, Y., & Delimitrou, C. (2018) · IEEE Computer Architecture Letters · doi:10.1109/lca.2018.2839189 · Cited by 121
Self-citationEnergy-Aware Virtual Machine Dynamic Provision and Scheduling for Cloud Computing
Lin, C., Liu, P., & Wu, J. (2011) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud.2011.94 · Cited by 115
μ Suite: A Benchmark Suite for Microservices
Sriraman, A., & Wenisch, T. F. (2018) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2018.8573515 · Cited by 104
Flinn, J. (2012) · Synthesis lectures on mobile and pervasive computing · doi:10.2200/s00447ed1v01y201209mpc010 · Cited by 98
Delimitrou, C., & Kozyrakis, C. (2016) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2872362.2872365 · Cited by 89
Self-citationScalable 10Gbps TCP/IP Stack Architecture for Reconfigurable Hardware
Sidler, D., Alonso, G., Blott, M., Karras, K., Vissers, K., & Carley, R. (2015) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2015.12 · Cited by 88
Automatic Generation of Efficient Accelerators for Reconfigurable Hardware
Koeplinger, D., Prabhakar, R., Zhang, Y., Delimitrou, C., Kozyrakis, C., & Olukotun, K. (2016) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2016.20 · Cited by 71
Self-citationDelimitrou, C., & Kozyrakis, C. (2018) · Communications of the ACM · doi:10.1145/3232559 · Cited by 68
Self-citationAutomatic generation of efficient accelerators for reconfigurable hardware
Koeplinger, D., Delimitrou, C., Prabhakar, R., Kozyrakis, C., Zhang, Y., & Olukotun, K. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001150 · Cited by 67
Self-citationAura: An IoT Based Cloud Infrastructure for Localized Mobile Computation Outsourcing
Hasan, R., Hossain, M., & Khan, R. H. (2015) · IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud) · doi:10.1109/mobilecloud.2015.37 · Cited by 58
Generating Configurable Hardware from Parallel Patterns
Prabhakar, R., Koeplinger, D., Brown, K. J., Lee, H., De, C., Kozyrakis, C., & Olukotun, K. (2016) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2872362.2872415 · Cited by 57
Kaynak, C., Grot, B., & Falsafi, B. (2013) · Proceedings of the ... annual International Symposium on Microarchitecture/Proceedings of the annual International Symposium on Microarchitecture · doi:10.1145/2540708.2540732 · Cited by 54
Delimitrou, C., & Kozyrakis, C. (2017) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3037697.3037703 · Cited by 50
Self-citationLow-latency TCP/IP stack for data center applications
Sidler, D., István, Z., & Alonso, G. (2016) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2016.7577319 · Cited by 47
Yang, H., Chen, Q., Riaz, M., Luan, Z., Tang, L., & Mars, J. (2017) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3079856.3080224 · Cited by 47
Microarchitectural implications of event-driven server-side web applications
Zhu, Y., Richins, D., Halpern, M., & Reddi, V. J. (2015) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/2830772.2830792 · Cited by 45
Workload characterization of interactive cloud services on big and small server platforms
Chen, S., Gal-On, S., Delimitrou, C., Manne, S., & Martínez, J. F. (2017) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2017.8167770 · Cited by 41
Self-citationQuality-of-Service-Aware Scheduling in Heterogeneous Data centers with Paragon
Delimitrou, C., & Kozyrakis, C. (2014) · IEEE Micro · doi:10.1109/mm.2014.7 · Cited by 38
Self-citationmilliScope: A Fine-Grained Monitoring Framework for Performance Debugging of n-Tier Web Services
Lai, C.-A., Kimball, J., Zhu, Τ., Wang, Q., & Pu, C. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.228 · Cited by 29
A Study of Long-Tail Latency in n-Tier Systems: RPC vs. Asynchronous Invocations
Wang, Q., Lai, C.-A., Kanemasa, Y., Zhang, S., & Pu, C. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.32 · Cited by 29
Mobile processors for energy-efficient web search
Reddi, V. J., Lee, B. C., Chilimbi, T. M., & Vaid, K. (2011) · ACM Transactions on Computer Systems · doi:10.1145/2003690.2003693 · Cited by 21
Brawny vs. Wimpy: Evaluation and Analysis of Modern Workloads on Heterogeneous Processors
Gupta, V., & Schwan, K. (2013) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2013.130 · Cited by 14
Limitations of Load Balancing Mechanisms for N-Tier Systems in the Presence of Millibottlenecks
Zhu, Τ., Li, J., Kimball, J., Park, J., Lai, C.-A., Pu, C., & Wang, Q. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.188 · Cited by 10
The Impact of Software Resource Allocation on Consolidated n-Tier Applications
Li, J., Wang, Q., Lai, C. A., Park, J., Yokoyama, D., & Pu, C. (2014) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud.2014.51 · Cited by 7
Kratzke, N., & Quint, P.-C. (2016) · International Conference on Cloud Computing and Services Science · doi:10.5220/0005732202230231 · Cited by 7
Flagged first, then by citations
3 of the 72 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
Characterizing Microservice Dependency and Performance
Luo, S., Xu, H., Lu, C., Ye, K., Xu, G., Zhang, L., Ding, Y. F., He, J., & Xu, C. (2021) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3472883.3487003 · Cited by 305
Du, D., Yu, T., Xia, Y., Zang, B., Yan, G., Qin, C., Wu, Q., & Chen, H. (2020) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3373376.3378512 · Cited by 282
Serverless Computing: A Survey of Opportunities, Challenges, and Applications
Shafiei, H., Khonsari, A., & Mousavi, P. (2022) · ACM Computing Surveys · doi:10.1145/3510611 · Cited by 319
Chen, S., Delimitrou, C., & Martínez, J. F. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304005 · Cited by 269
Self-citation
Metadata
- Authors
- Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., Hu, K., Pancholi, M., He, Y., Clancy, B., Colen, C., Wen, F., Leung, C., Wang, S., Zaruvinsky, L., Espinosa, M., Lin, R., Liu, Z., Padilla, J., & Delimitrou, C.
- Affiliations
- Cornell University (US)
- Cornell University, Ithaca, NY, USA
- Venue
- Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems
- Publisher
- ACM
- Published
- 2019-04-04
- Pages
- 3-18
- OpenAlex
- W2931122162
- Cited by
- 665
- References
- 72
- Citations by year
- 2026: 103 · 2025: 127 · 2024: 117 · 2023: 91 · 2022: 67 · 2021: 71 · 2020: 67 · 2019: 21
- FWCI
- 45.01
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (publishedVersion)
- Funders
- NSF (CNS-1422088)
- Topics
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- microservices, benchmark suite, hardware-software co-design, cloud systems, edge computing, quality of service, monolith to microservices migration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
