Cited by 666Cloud Computing and Resource ManagementSoftware System Performance and ReliabilityParallel Computing and Optimization Techniques

An Open-Source Benchmark Suite for Microservices and Their Hardware-Software Implications for Cloud & Edge Systems

Open access
Gan, Yu, Zhang, Yanqi, Cheng, Dailun, Shetty, Ankitha, Rathi, Priyal, Katarki, Nayan, Bruno, Ariana, Hu, Justin +16 more·2019·Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems

Abstract

Cloud services have recently started undergoing a major shift from monolithic applications, to graphs of hundreds or thousands of loosely-coupled microservices. Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and cloud utilization.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3297858.3304013

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

3 of the 72 references couldn’t be matched to a known paper.

Research works printed but not linked: 20

  1. 2016. The Evolution of Microservices. https://www.slideshare.net/ adriancockcroft/evolution-of-microservices-craft-conference.
  2. Adrian Cockroft [n. d.]. Microservices Workshop: Why, what, and how to get there. http://www.slideshare.net/adriancockcroft/ microservices-workshop-craft-conference.
  3. Adrian M. Caulfield, Eric S. Chung, Andrew Putnam, Hari Angepat, Jeremy Fowers, Michael Haselman, Stephen Heil, Matt Humphrey, Puneet Kaur, Joo-Young Kim, Daniel Lo, Todd Massengill, Kalin Ovtcharov, Michael Papamichael, Lisa Woods, Sitaram Lanka, Derek Chiou, and Doug Burger. 2016. A Cloud-scale Acceleration Archi- tecture. In The 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO-49). IEEE Press, Piscataway, NJ, USA, Arti- cle 7, 13 pages. http://dl.acm.org/citation.cfm?id=3195638.3195647
  4. Christina Delimitrou and Christos Kozyrakis. [n. d.]. Paragon: QoS- Aware Scheduling for Heterogeneous Datacenters. In Proceedings of the Eighteenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Houston, TX, USA, 2013.
  5. Christina Delimitrou and Christos Kozyrakis. [n. d.]. Quasar: Resource- Efficient and QoS-Aware Cluster Management. In Proceedings of the Nineteenth International Conference on Architectural Support for Pro- gramming Languages and Operating Systems (ASPLOS). Salt Lake City, UT, USA, 2014.
  6. Christina Delimitrou and Christos Kozyrakis. 2016. HCloud: Resource- Efficient Provisioning in Shared Cloud Systems. In Proceedings of the Twenty First International Conference on Architectural Support for Pro- gramming Languages and Operating Systems (ASPLOS).
  7. Christina Delimitrou and Christos Kozyrakis. 2017. Bolt: I Know What You Did Last Summer... In The Cloud. In Proceedings of the Twenty Second International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).
  8. Christina Delimitrou, Daniel Sanchez, and Christos Kozyrakis. 2015. Tarcil: Reconciling Scheduling Speed and Quality in Large Shared Clus- ters. In Proceedings of the Sixth ACM Symposium on Cloud Computing (SOCC).
  9. Daniel Firestone, Andrew Putnam, Sambhrama Mundkur, Derek Chiou, Alireza Dabagh, Mike Andrewartha, Hari Angepat, Vivek Bhanu, Adrian Caulfield, Eric Chung, Harish Kumar Chandrappa, Somesh Chaturmohta, Matt Humphrey, Jack Lavier, Norman Lam, Fengfen Liu, Kalin Ovtcharov, Jitu Padhye, Gautham Popuri, Shachar Raindel, Tejas Sapre, Mark Shaw, Gabriel Silva, Madhan Sivakumar, Nisheeth Srivastava, Anshuman Verma, Qasim Zuhair, Deepak Bansal, Doug Burger, Kushagra Vaid, David A. Maltz, and Albert Greenberg. 2018. Azure Accelerated Networking: SmartNICs in the Public Cloud. In 15th USENIX Symposium on Networked Systems Design and Implemen- tation (NSDI 18). USENIX Association, Renton, WA, 51-66. https: //www.usenix.org/conference/nsdi18/presentation/firestone
  10. Urs Hölzle. [n. d.]. Brawny cores still beat wimpy cores, most of the time. In IEEE Micro. 2010.
  11. Nane Kratzke and Peter-Christian Quint. 2016. Ppbench. In Proceedings of the 6th International Conference on Cloud Computing and Services Science -Volume 1 and 2 (CLOSER 2016). SCITEPRESS -Science and Technology Publications, Lda, Portugal, 223-231.
  12. David Lo, Liqun Cheng, Rama Govindaraju, Luiz André Barroso, and Christos Kozyrakis. [n. d.]. Towards Energy Proportionality for Large- scale Latency-critical Workloads. In Proceedings of the 41st Annual International Symposium on Computer Architecuture (ISCA). Minneapo- lis, MN, 2014.
  13. David Lo, Liqun Cheng, Rama Govindaraju, Parthasarathy Ran- ganathan, and Christos Kozyrakis. [n. d.]. Heracles: Improving Re- source Efficiency at Scale. In Proc. of the 42Nd Annual International Symposium on Computer Architecture (ISCA). Portland, OR, 2015.
  14. Jason Mars and Lingjia Tang. [n. d.]. Whare-map: heterogeneity in "homogeneous" warehouse-scale computers. In Proceedings of ISCA. Tel-Aviv, Israel, 2013.
  15. Ripal Nathuji, Aman Kansal, and Alireza Ghaffarkhah. [n. d.]. Q- Clouds: Managing Performance Interference Effects for QoS-Aware Clouds. In Proceedings of EuroSys. Paris,France, 2010.
  16. Kay Ousterhout, Patrick Wendell, Matei Zaharia, and Ion Stoica. [n. d.]. Sparrow: Distributed, Low Latency Scheduling. In Proceedings of SOSP. Farminton, PA, 2013.
  17. Malte Schwarzkopf, Andy Konwinski, Michael Abd-El-Malek, and John Wilkes. [n. d.]. Omega: flexible, scalable schedulers for large compute clusters. In Proceedings of EuroSys. Prague, Czech Republic, 2013.
  18. Takanori Ueda, Takuya Nakaike, and Moriyoshi Ohara. [n. d.]. Work- load characterization for microservices. In Proc. of IISWC. 2016.
  19. Hailong Yang, Alex Breslow, Jason Mars, and Lingjia Tang. [n. d.]. Bubble-flux: precise online QoS management for increased utilization in warehouse scale computers. In Proceedings of ISCA. 2013.
  20. Hailong Yang, Quan Chen, Moeiz Riaz, Zhongzhi Luan, Lingjia Tang, and Jason Mars. 2017. PowerChief: Intelligent Power Allocation for Multi-Stage Applications to Improve Responsiveness on Power Con- strained CMP. In Proceedings of the 44th Annual International Sympo- sium on Computer Architecture (ISCA '17). ACM, New York, NY, USA, 133-146.

Cited by

Sorted by citations

Authors
Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., Hu, K., Pancholi, M., He, Y., Clancy, B., Colen, C., Wen, F., Leung, C., Wang, S., Zaruvinsky, L., Espinosa, M., Lin, R., Liu, Z., Padilla, J., & Delimitrou, C.
Affiliations
  • Cornell University (US)
  • Cornell University, Ithaca, NY, USA
Venue
Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems
Publisher
ACM
Published
2019-04-04
Pages
3-18
OpenAlex
W2931122162
Cited by
665
References
72
Citations by year
2026: 103 · 2025: 127 · 2024: 117 · 2023: 91 · 2022: 67 · 2021: 71 · 2020: 67 · 2019: 21 · 2017: 1
FWCI
45.01
Type
conference paper
Language
en
Open access
Locations
International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (publishedVersion)
Funders
NSF (CNS-1422088)
Topics
  • Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
Keywords
microservices, benchmark suite, hardware-software co-design, cloud systems, edge computing, quality of service, monolith to microservices migration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review