The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning
Abstract
Configuration tuning is vital to optimize the performance of database management system (DBMS). It becomes more tedious and urgent for cloud databases (CDB) due to the diverse database instances and query workloads, which make the database administrator (DBA) incompetent. Although there are some studies on automatic DBMS configuration tuning, they have several limitations. Firstly, they adopt a pipelined learning model but cannot optimize the overall performance in an end-to-end manner. Secondly, they rely on large-scale high-quality training samples which are hard to obtain. Thirdly, there are a large number of knobs that are in continuous space and have unseen dependencies, and they cannot recommend reasonable configurations in such high-dimensional continuous space. Lastly, in cloud environment, they can hardly cope with the changes of hardware configurations and workloads, and have poor adaptability. To address these challenges, we design an end-to-end automatic CDB tuning system, CDBTune, using deep reinforcement learning (RL). CDBTune utilizes the deep deterministic policy gradient method to find the optimal configurations in high-dimensional continuous space. CDBTune adopts a try-and-error strategy to learn knob settings with a limited number of samples to accomplish the initial training, which alleviates the difficulty of collecting massive high-quality samples. CDBTune adopts the reward-feedback mechanism in RL instead of traditional regression, which enables end-to-end learning and accelerates the convergence speed of our model and improves efficiency of online tuning. We conducted extensive experiments under 6 different workloads on real cloud databases to demonstrate the superiority of CDBTune. Experimental results showed that CDBTune had a good adaptability and significantly outperformed the state-of-the-art tuning tools and DBA experts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
A Primer on Neural Network Models for Natural Language Processing
Goldberg, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4992 · Cited by 1,201
Automatic Database Management System Tuning Through Large-scale Machine Learning
Van Aken, D., Pavlo, A., Gordon, G. J., & Zhang, B. (2017) · Proceedings of the 2017 ACM International Conference on Management of Data · doi:10.1145/3035918.3064029 · Cited by 573
Integrating vertical and horizontal partitioning into automated physical database design
Agrawal, S., Narasayya, V., & Yang, B. (2004) · Proceedings of the 2004 ACM SIGMOD international conference on Management of data · doi:10.1145/1007568.1007609 · Cited by 411
CORDS: automatic discovery of correlations and soft functional dependencies
Ilyas, I. F., Markl, V., Haas, P., Brown, P., & Aboulnaga, A. (2004) · Proceedings of the 2004 ACM SIGMOD international conference on Management of data · doi:10.1145/1007568.1007641 · Cited by 315
Tuning database configuration parameters with iTuned
Duan, S., Thummala, V., & Babu, S. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687767 · Cited by 267
AutoAdmin “what-if” index analysis utility
Chaudhuri, S., & Narasayya, V. (1998) · Proceedings of the 1998 ACM SIGMOD international conference on Management of data · doi:10.1145/276304.276337 · Cited by 255
Self-tuning database systems: a decade of progress
Chaudhuri, S., & Narasayya, V. R. (2007) · Cited by 249
BestConfig: tapping the performance potential of systems via automatic configuration tuning
Zhu, Y., Liu, J., Guo, M., Bao, Y., Ma, W., Liu, Z., Song, K., & Yang, Y. (2017) · Proceedings of the 2017 Symposium on Cloud Computing · doi:10.1145/3127479.3128605 · Cited by 239
The Asilomar report on database research
Bernstein, P., Brodie, M., Ceri, S., DeWitt, D., Franklin, M., Garcia-Molina, H., Gray, J., Held, J., Hellerstein, J., Jagadish, H. V., et al. (1998) · ACM SIGMOD Record · doi:10.1145/306101.306137 · Cited by 234
Deep Reinforcement Learning for Join Order Enumeration
Marcus, R., & Papaemmanouil, O. (2018) · Proceedings of the First International Workshop on Exploiting Artificial Intelligence Techniques for Data Management · doi:10.1145/3211954.3211957 · Cited by 227
Self-Driving Database Management Systems.
Pavlo, A., Angulo, G. B., Arulraj, J. J. P., Lin, H., Lin, J., Ma, L., Menon, P., Mowry, T. C., Perron, M., Quah, I., et al. (2017) · Conference on Innovative Data Systems Research · Cited by 203
Database Meets Deep Learning: Challenges and Opportunities
Wang, W., Zhang, M., Chen, G., Jagadish, H. V., Ooi, B. C., & Tan, K.-L. (2016) · ACM SIGMOD Record · doi:10.1145/3003665.3003669 · Cited by 158
Merging what's cracked, cracking what's merged: adaptive indexing in main-memory column-stores
Idreos, S., Manegold, S., Kuno, H., & Graefe, G. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/2002938.2002944 · Cited by 156
Learning : an introduction for students of education
O’Connor, K., & O’Connor, K. (1968) · Macmillan eBooks · Cited by 141
The comfort automatic tuning project
Weikum, G., Hasse, C., Moenkeberg, A., & Zabback, P. (1994) · Information Systems · doi:10.1016/0306-4379(94)90004-3 · Cited by 113
Rethinking Database System Architecture: Towards a Self-Tuning RISC-Style Database System
Chaudhuri, S., & Weikum, G. (2000) · Cited by 90
The Case for Automatic Database Administration using Deep Reinforcement LearningPreprint
Sharma, A., Schuhknecht, F., & Dittrich, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05643 · Cited by 87
Yoon, D. Y., Niu, N., & Mozafari, B. (2016) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/2882903.2915218 · Cited by 82
The uncracked pieces in database cracking
Schuhknecht, F., Jindal, A., & Dittrich, J. (2013) · Proceedings of the VLDB Endowment · doi:10.14778/2732228.2732229 · Cited by 80
A Q-Learning Scheme for Fair Coexistence Between LTE and Wi-Fi in Unlicensed Spectrum
Maglogiannis, V., Naudts, D., Shahid, A., et al. (2018) · IEEE Access · doi:10.1109/access.2018.2829492 · Cited by 62
Using probabilistic reasoning to automate software tuning
Sullivan, D. G., Seltzer, M., & Pfeffer, A. (2004) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/1005686.1005739 · Cited by 51
Sevcik, K. C., & Zilio, D. C. (1998) · TSpace (University of Toronto) · Cited by 44
Regularized Cost-Model Oblivious Database Tuning with Reinforcement Learning
Basu, D., Lin, Q., Chen, W., Vo, H. T., Yuan, Z., Senellart, P. P., & Bressan, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-662-53455-7_5 · Cited by 33
SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural NetworksPreprint
Wang, L., Ye, J., Zhao, Y., Wu, W., Li, A., Song, S. L., Xu, Z., & Kraska, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04380 · Cited by 30
Cited by
QTune: a query-aware database tuning system with deep reinforcement learning
Li, G., Zhou, X., Li, S., & Gao, B. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3352063.3352129 · Cited by 257
Self-citationAn end-to-end learning-based cost estimator
Sun, J., & Li, G. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3368289.3368296 · Cited by 256
Self-citationGPTuner: An LLM-Based Database Tuning System
Lao, J., Wang, Y., Li, Y., Wang, J., Zhang, Y., Cheng, Z., Chen, W., Tang, M., & Wang, J. (2025) · ACM SIGMOD Record · doi:10.1145/3733620.3733641 · Cited by 17
Self-citation
Metadata
- Authors
- Zhang, J., Liu, Y., Zhou, K., Li, G., Xiao, Z., Cheng, B., Xing, J., Wang, Y., Cheng, T., Liu, L., Ran, M., & Li, Z.
- Venue
- Proceedings of the 2019 International Conference on Management of Data
- Publisher
- ACM
- Published
- 2019-06-25
- Pages
- 415-432
- ISSN
- 0730-8078 (ISSN-L)
- OpenAlex
- W2948513753
- Cited by
- 318
- References
- 31
- FWCI
- 34.26
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.