The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
QTune: a query-aware database tuning system with deep reinforcement learning
Abstract
Database knob tuning is important to achieve high performance (e.g., high throughput and low latency). However, knob tuning is an NP-hard problem and existing methods have several limitations. First, DBAs cannot tune a lot of database instances on different environments (e.g., different database vendors). Second, traditional machine-learning methods either cannot find good configurations or rely on a lot of high-quality training examples which are rather hard to obtain. Third, they only support coarse-grained tuning (e.g., workload-level tuning) but cannot provide fine-grained tuning (e.g., query-level tuning). To address these problems, we propose a query-aware database tuning system QTune with a deep reinforcement learning (DRL) model, which can efficiently and effectively tune the database configurations. QTune first featurizes the SQL queries by considering rich features of the SQL queries. Then QTune feeds the query features into the DRL model to choose suitable configurations. We propose a Double-State Deep Deterministic Policy Gradient (DS-DDPG) model to enable query-aware database configuration tuning, which utilizes the actor-critic networks to tune the database configurations based on both the query vector and database states. QTune provides three database tuning granularities: query-level, workload-level, and cluster-level tuning. We deployed our techniques onto three real database systems, and experimental results show that QTune achieves high performance and outperforms the state-of-the-art tuning methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
(1996) · Cited by 20,179
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Deep Learning using Rectified Linear Units (ReLU)
Agarap, A. F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.08375 · Cited by 2,399
Classifier chains for multi-label classification
Read, J., Pfahringer, B., Holmes, G., & Frank, E. (2011) · Machine Learning · doi:10.1007/s10994-011-5256-5 · Cited by 2,289
An Introduction to Deep Reinforcement Learning
Vincent, F.-L., Peter, H., Riashat, I., Marc, G. B., & Joelle, P. (2018) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000071 · Cited by 1,286
Ester, M., Kriegel, H., Sander, J., & Xu, X. (1996) · Knowledge Discovery and Data Mining · Cited by 1,131
Automatic Database Management System Tuning Through Large-scale Machine Learning
Van Aken, D., Pavlo, A., Gordon, G. J., & Zhang, B. (2017) · Proceedings of the 2017 ACM International Conference on Management of Data · doi:10.1145/3035918.3064029 · Cited by 573
An introduction to deep reinforcement learning
François-Lavet, V., Henderson, P., Islam, R., Bellemare, M. G., & Pineau, J. (2018) · doi:10.1561/9781680835397 · Cited by 544
Variable Resolution Discretization in Optimal Control
Munos, R., & Moore, A. (2002) · Machine Learning · doi:10.1023/a:1017992615625 · Cited by 321
An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning
Zhang, J., Liu, Y., Zhou, K., Li, G., Xiao, Z., Cheng, B., Xing, J., Wang, Y., Cheng, T., Liu, L., et al. (2019) · Proceedings of the 2019 International Conference on Management of Data · doi:10.1145/3299869.3300085 · Cited by 318
Self-citationAli, R., Shahin, N., Zikria, Y. B., Kim, B.-S., & Kim, S. W. (2019) · IEEE Access · doi:10.1109/access.2018.2886216 · Cited by 274
Tuning database configuration parameters with iTuned
Duan, S., Thummala, V., & Babu, S. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687767 · Cited by 267
An end-to-end learning-based cost estimator
Sun, J., & Li, G. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3368289.3368296 · Cited by 256
Self-citationBinary relevance efficacy for multilabel classification
Luaces, O., Díez, J., Barranquero, J., del Coz, J. J., & Bahamonde, A. (2012) · Progress in Artificial Intelligence · doi:10.1007/s13748-012-0030-x · Cited by 244
BestConfig: tapping the performance potential of systems via automatic configuration tuning
Zhu, Y., Liu, J., Guo, M., Bao, Y., Ma, W., Liu, Z., Song, K., & Yang, Y. (2017) · Proceedings of the 2017 Symposium on Cloud Computing · doi:10.1145/3127479.3128605 · Cited by 239
Deep Reinforcement Learning for Join Order Enumeration
Marcus, R., & Papaemmanouil, O. (2018) · Proceedings of the First International Workshop on Exploiting Artificial Intelligence Techniques for Data Management · doi:10.1145/3211954.3211957 · Cited by 227
Human-in-the-loop data integration
Li, G. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137765.3137833 · Cited by 88
Self-citationA Q-Learning Scheme for Fair Coexistence Between LTE and Wi-Fi in Unlicensed Spectrum
Maglogiannis, V., Naudts, D., Shahid, A., et al. (2018) · IEEE Access · doi:10.1109/access.2018.2829492 · Cited by 62
Using probabilistic reasoning to automate software tuning
Sullivan, D. G., Seltzer, M., & Pfeffer, A. (2004) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/1005686.1005739 · Cited by 51
A Deep Deterministic Policy Gradient Approach to Medication Dosing and Surveillance in the ICU
Lin, R., Stanley, M. D., Ghassemi, M. M., & Nemati, S. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8513203 · Cited by 48
Regularized Cost-Model Oblivious Database Tuning with Reinforcement Learning
Basu, D., Lin, Q., Chen, W., Vo, H. T., Yuan, Z., Senellart, P. P., & Bressan, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-662-53455-7_5 · Cited by 33
A Gentle Introduction to Reinforcement Learning
Nowé, A., & Brys, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45856-4_2 · Cited by 29
Hierarchical Deep Reinforcement Learning For Robotics and Data Science
Krishnan, S. (2018) · UC Berkeley · Cited by 3
Cited by
An end-to-end learning-based cost estimator
Sun, J., & Li, G. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3368289.3368296 · Cited by 256
Self-citation
Metadata
- Authors
- Li, G., Zhou, X., Li, S., & Gao, B.
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2019-08
- Volume
- 12
- Issue
- 12
- Pages
- 2118-2130
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W2970851599
- Cited by
- 257
- References
- 27
- FWCI
- 14.73
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.