The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis
Abstract
Loosely-coupled and light-weight microservices running in containers are replacing monolithic applications gradually. Understanding the characteristics of microservices is critical to make good use of microservice architectures. However, there is no comprehensive study about microservice and its related systems in production environments so far. In this paper, we present a solid analysis of large-scale deployments of microservices at Alibaba clusters. Our study focuses on the characterization of microservice dependency as well as its runtime performance. We conduct an in-depth anatomy of microservice call graphs to quantify the difference between them and traditional DAGs of data-parallel jobs. In particular, we observe that microservice call graphs are heavy-tail distributed and their topology is similar to a tree and moreover, many microservices are hot-spots. We reveal three types of meaningful call dependency that can be utilized to optimize microservice designs. Our investigation on microservice runtime performance indicates most microservices are much more sensitive to CPU interference than memory interference. To synthesize more representative microservice traces, we build a mathematical model to simulate call graphs. Experimental results demonstrate our model can well preserve those graph properties observed from Alibaba traces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476
Benchmarking cloud serving systems with YCSB
Cooper, B. F., Silberstein, A., Tam, E., Ramakrishnan, R., & Sears, R. (2010) · Proceedings of the 1st ACM symposium on Cloud computing · doi:10.1145/1807128.1807152 · Cited by 3,716
Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · Cited by 3,622
Distributed Systems: Principles and Paradigms
Tanenbaum, A. S., & van Steen, M. R. (2001) · Cited by 2,189
(2015) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 1,144
Heterogeneity and dynamicity of clouds at scale: Google trace analysis
Reiss, C., Tumanov, A., Ganger, G. R., Katz, R. H., & Kozuch, M. A. (2012) · Proceedings of the Third ACM Symposium on Cloud Computing · doi:10.1145/2391229.2391236 · Cited by 1,063
Vishwanathan, S. V. N., Schraudolph, N. N., Kondor, R., & Borgwardt, K. M. (2010) · CaltechAUTHORS (California Institute of Technology) · Cited by 850
Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304013 · Cited by 665
Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., & Bianchini, R. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132772 · Cited by 633
An analytical model for multi-tier internet services and its applications
Urgaonkar, B., Pacifici, G., Shenoy, P., Spreitzer, M., & Tantawi, A. (2005) · Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1064212.1064252 · Cited by 545
Dapper, a Large-Scale Distributed Systems Tracing Infrastructure
Sigelman, B. H., Barroso, L. A., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., Jaspan, S., & Shanbhag, C. (2010) · Cited by 477
FIRM: An Intelligent Fine-Grained Resource Management Framework for SLO-Oriented MicroservicesPreprint
Qiu, H., Banerjee, S. S., Jha, S., Kalbarczyk, Z., & Iyer, R. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.08509 · Cited by 447
Shahrad, M., Fonseca, R., Goiri, Í., Chaudhry, G., Batum, P., Cooke, J., Laureano, E., Tresness, C., Russinovich, M., & Bianchini, R. (2020) · arXiv · doi:10.48550/arxiv.2003.03423 · Cited by 391 · cited 1×
“There exist several public traces released from production clusters including Google Trace [24, 32], Alibaba Trace [21, 31], Azure Trace [14, 25], and so on.”
BackgroundTirmazi, M., Barker, A., Deng, N., Haque, M. E., Qin, Z. G., Hand, S., Harchol-Balter, M., & Wilkes, J. (2020) · Proceedings of the Fifteenth European Conference on Computer Systems · doi:10.1145/3342195.3387517 · Cited by 325
Seer: Leveraging Big Data to Navigate the Complexity of Performance Debugging in Cloud Microservices
Gan, Y., Zhang, Y., Hu, K., Cheng, D., He, Y., Pancholi, M., & Delimitrou, C. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304004 · Cited by 269
Firecracker: Lightweight virtualization for serverless applications
Agache, A., Brooker, M., Iordache, A., Liguori, A., Neugebauer, R., Piwonka, P., & Popa, D.-M. (2020) · Cited by 268
Sinan: ML-based and QoS-aware resource management for cloud microservices
Zhang, Y., Hua, W., Zhou, Z., Suh, G. E., & Delimitrou, C. (2021) · Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3445814.3446693 · Cited by 226
Characterizing serverless platforms with serverlessbench
Yu, T., Liu, Q., Du, D., Xia, Y., Zang, B., Lu, Z., Yang, P., Qin, C., & Chen, H. (2020) · Proceedings of the 11th ACM Symposium on Cloud Computing · doi:10.1145/3419111.3421280 · Cited by 192
Benchmarking microservice systems for software engineering research
Zhou, X., Peng, X., Xie, T., Sun, J., Xu, C., Ji, C., & Zhao, W. (2018) · Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings · doi:10.1145/3183440.3194991 · Cited by 168
Self-citationFuxi: a fault-tolerant resource management and job scheduling system at internet scale
Zhang, Z., Li, C., Tao, Y., Yang, R., Tang, H., & Xu, J. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2733004.2733012 · Cited by 156
Workload characterization for microservices
Ueda, T., Nakaike, T., & Ohara, M. (2016) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2016.7581269 · Cited by 138
μ Suite: A Benchmark Suite for Microservices
Sriraman, A., & Wenisch, T. F. (2018) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2018.8573515 · Cited by 113
Overload Control for Scaling WeChat Microservices
Zhou, H., Chen, M., Lin, Q., Wang, Y., She, X., Liu, S., Gu, R., Ooi, B. C., & Yang, J. (2018) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3267809.3267823 · Cited by 105
Liu, Q., & Yu, Z. (2018) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3267809.3267830 · Cited by 104
On the diversity of cluster workloads and its impact on research results
Amvrosiadis, G., Park, J. W., Ganger, G. R., Gibson, G. A., Baseman, E., & DeBardeleben, N. (2018) · USENIX Annual Technical Conference · Cited by 89
Characterizing and Synthesizing Task Dependencies of Data-Parallel Jobs in Alibaba Cloud
Tian, H., Zheng, Y., & Wang, W. (2019) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3357223.3362710 · Cited by 66
µtune: auto-tuned threading for OLDI microservices
Sriraman, A., & Wenisch, T. F. (2018) · Operating Systems Design and Implementation · doi:10.5555/3291168.3291182 · Cited by 50
High-density Multi-tenant Bare-metal Cloud
Zhang, X., Zheng, X., Wang, Z., Yang, H., Shen, Y., & Long, X. (2020) · Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3373376.3378507 · Cited by 40
Tracking and controlling microservice dependencies
Ghirotti, S. E., Reilly, T., & Rentz, A. (2018) · Communications of the ACM · doi:10.1145/3267118 · Cited by 12
Cited by
Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Data
Lee, C., Yang, T., Chen, Z., Su, Y., & Lyu, M. R. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00150 · Cited by 149
A systematic review on effective energy utilization management strategies in cloud data centers
Panwar, S. S., Rauthan, M. M. S., & Barthwal, V. (2022) · Journal of Cloud Computing · doi:10.1186/s13677-022-00368-5 · Cited by 65
HeMiRCA: fine-grained root cause analysis for microservices with heterogeneous data sources
Zhu, Z., Lee, C., Tang, X., & He, P. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3674726 · Cited by 26
(2024) · doi:10.1145/3597503.3639088 · Cited by 22
MRCA: metric-level root cause analysis for microservices via multi-modal data
Wang, Y., Zhu, Z., Fu, Q., Ma, Y., & He, P. (2024) · Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3691620.3695485 · Cited by 18
Metadata
- Authors
- Luo, S., Xu, H., Lu, C., Ye, K., Xu, G., Zhang, L., Ding, Y., He, J., & Xu, C.
- Venue
- Proceedings of the ACM Symposium on Cloud Computing
- Publisher
- ACM
- Published
- 2021-11
- Pages
- 412-426
- OpenAlex
- W3209366914
- Cited by
- 293
- References
- 29
- FWCI
- 39.12
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.