CoChat
Sign Up
Cited by 17Advanced Database Systems and QueriesCloud Computing and Resource ManagementData Management and Algorithms

The DOI matches its Crossref record.

Self-tuning Database Systems: A Systematic Literature Review of Automatic Database Schema Design and Tuning

Open access
Mozaffari, Maryam, Dignös, Anton, Gamper, Johann, Störl, Uta·2024·ACM Computing Surveys
DOI 10.1145/3665323
Open this paper in CoChat — free account

Abstract

Self-tuning is a feature of autonomic databases that includes the problem of automatic schema design. It aims at providing an optimized schema that increases the overall database performance. While in relational databases automatic schema design focuses on the automated design of the physical schema, in NoSQL databases all levels of representation are considered: conceptual, logical, and physical. This is mainly because the latter are mostly schema-less and lack a standard schema design procedure as is the case for SQL databases. In this work, we carry out a systematic literature survey on automatic schema design in both SQL and NoSQL databases. We identify the levels of representation and the methods that are used for the schema design problem, and we present a novel taxonomy to classify and compare different schema design solutions. Our comprehensive analysis demonstrates that, despite substantial progress that has been made, schema design is still a developing field and considerable challenges need to be addressed, notably for NoSQL databases. We highlight the most important findings from the results of our analysis and identify areas for future research work.

Overview

Integrity signals

Registry

Crossref · 10.1145/3665323

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 233

  1. Fatma Abdelhédi, Amal Ait Brahim, Faten Atigui, and Gilles Zurfluh. 2017. UMLtoNoSQL: Automatic transformation of conceptual schema to NoSQL databases. In Proceedings of the AICCSA. IEEE Computer Society, 272–279.
  2. Fatma Abdelhédi, Amal Ait Brahim, Rabah Tighilt Ferhat, and Gilles Zurfluh. 2020. Discovering of a conceptual model from a NoSQL database. In Proceedings of the ICEIS. SCITEPRESS, 61–72.
  3. Fatma Abdelhédi, Amal Ait Brahim, Rabah Tighilt Ferhat, and Gilles Zurfluh. 2020. Reverse engineering approach for NoSQL databases. In Proceedings of the DaWaK(LNCS, Vol. 12393). Springer, 60–69.
  4. Fatma Abdelhédi, Amal Ait Brahim, Hela Rajhi, Rabah Tighilt Ferhat, and Gilles Zurfluh. 2021. Automatic extraction of a document-oriented NoSQL schema. In Proceedings of the ICEIS. SCITEPRESS, 192–199.
  5. Dippy Aggarwal and Karen C. Davis. 2016. Employing graph databases as a standardization model towards addressing heterogeneity. In Proceedings of the IRI. IEEE Computer Society, 198–207.
  6. Sanjay Agrawal, Surajit Chaudhuri, Lubor Kollár, Arunprasad P. Marathe, Vivek R. Narasayya, and Manoj Syamala. 2004. Database tuning advisor for microsoft SQL server 2005. In Proceedings of the VLDB. 1110–1121.
  7. Sanjay Agrawal, Surajit Chaudhuri, and Vivek R. Narasayya. 2000. Automated selection of materialized views and indexes in SQL databases. In Proceedings of the VLDB. 496–505.
  8. Sanjay Agrawal, Vivek R. Narasayya, and Beverly Yang. 2004. Integrating vertical and horizontal partitioning into automated physical database design. In Proceedings of the SIGMOD. ACM, 359–370.
  9. Jacky Akoka and Isabelle Comyn-Wattiau. 2018. Roundtrip engineering of NoSQL databases. Enterprise Modelling and Information Systems Architectures 13, Special (2018), 281–292.
  10. Jacky Akoka, Isabelle Comyn-Wattiau, Cédric du Mouza, and Nicolas Prat. 2021. Mapping multidimensional schemas to property graph models. In Proceedings of the ER (Workshops)(LNCS, Vol. 13012). Springer, 3–14.
  11. Jacky Akoka, Isabelle Comyn-Wattiau, and Nicolas Prat. 2017. A four v’s design approach of NoSQL graph databases. In Proceedings of the ER Workshops(LNCS, Vol. 10651). Springer, 58–68.
  12. Alibaba. 2020. Alibaba self-driving database. Retrieved March 1, 2021 from https://www.alibabacloud.com/product/das/
  13. Ana Carolina Almeida, Fernanda Baião, Sérgio Lifschitz, Daniel Schwabe, and Maria Luiza Machado Campos. 2021. Tun-O \({}_{\mbox{CM}}\) : A model-driven approach to support database tuning decision making. Decis. Support Syst. 145 (2021), 113538. · DOI
  14. Ana Carolina Almeida, Angelo Brayner, José Maria Monteiro, Sérgio Lifschitz, and Rafael Pereira de Oliveira. 2016. Automatic physical design tuning based on hypothetical plans. In Proceedings of the SBBD. SBC, 115–120.
  15. Obaid Alotaibi and Eric Pardede. 2019. Transformation of schema from relational database (RDB) to NoSQL databases. Data 4, 4 (2019), 148. · DOI
  16. Henry D. Anderson and P. Bruce Berra. 1977. Minimum cost selection of secondary indexes for formatted files. ACM Transactions on Database Systems 2, 1 (1977), 68–90. · DOI
  17. Chaimae Asaad and Karim Baïna. 2018. NoSQL databases–seek for a design methodology. In Proceedings of the International Conference on Model and Data Engineering. Springer, 25–40.
  18. Paolo Atzeni, Francesca Bugiotti, Luca Cabibbo, and Riccardo Torlone. 2020. Data modeling in the NoSQL world. Computer Standards & Interfaces 67 (2020), 103149. · DOI
  19. Paolo Atzeni, Francesca Bugiotti, and Luca Rossi. 2014. Uniform access to NoSQL systems. Inf. Syst. 43 (2014), 117–133. · DOI
  20. Mohamed Amine Baazizi, Dario Colazzo, Giorgio Ghelli, and Carlo Sartiani. 2019. Parametric schema inference for massive JSON datasets. VLDB J. 28, 4 (2019), 497–521. · DOI
  21. R Bananno, Dario Maio, and Paolo Tiberio. 1985. An approximation algorithm for secondary index selection in relational database physical design. Comput. J. 28, 4 (1985), 398–405. · DOI
  22. Shreya Banerjee and Anirban Sarkar. 2016. Ontology driven meta-modeling for NoSQL databases: A conceptual perspective. International Journal of Software Engineering and Its Applications 10, 12 (2016), 41–64. · DOI
  23. Elena Baralis, Stefano Paraboschi, and Ernest Teniente. 1997. Materialized view selection in a multidimensional database. In Proceedings of the VLDB. 156–165.
  24. Elena Barcucci, Renzo Pinzani, and Renzo Sprugnoli. 1990. Optimal selection of secondary indexes. IEEE Trans. Software Eng. 16, 1 (1990), 32–38. · DOI
  25. Francesco Basciani, Juri Di Rocco, Davide Di Ruscio, Alfonso Pierantonio, and Ludovico Iovino. 2020. TyphonML: A modeling environment to develop hybrid polystores. In Proceedings of the MoDELS (Companion). ACM, 2:1–2:5.
  26. Debabrota Basu, Qian Lin, Weidong Chen, Hoang Tam Vo, Zihong Yuan, Pierre Senellart, and Stéphane Bressan. 2016. Regularized cost-model oblivious database tuning with reinforcement learning. Trans. Large Scale Data Knowl. Centered Syst. 28 (2016), 96–132.
  27. Carlo Batini, Cinzia Cappiello, Chiara Francalanci, and Andrea Maurino. 2009. Methodologies for data quality assessment and improvement. ACM Comput. Surv. 41, 3 (2009), 16:1–16:52.
  28. Peter Belknap, Benoît Dageville, Karl Dias, and Khaled Yagoub. 2009. Self-tuning for SQL performance in oracle database 11g. In Proceedings of the ICDE. IEEE Computer Society, 1694–1700.
  29. David Bermbach, Steffen Müller, Jacob Eberhardt, and Stefan Tai. 2015. Informed schema design for column store-based database services. In Proceedings of the SOCA. IEEE Computer Society, 163–172.
  30. Flavio Bonfatti, Dario Maio, and Paolo Tiberio. 1983. A separability-based method for secondary index selection in physical database design. In Proceedings of the Methodology and Tools for Data Base Design. North-Holland, 149–160.
  31. Mohamed Boussahoua, Omar Boussaid, and Fadila Bentayeb. 2017. Logical schema for data warehouse on column-oriented NoSQL databases. In Proceedings of the DEXA(LNCS, Vol. 10439). Springer, 247–256.
  32. Amal Ait Brahim, Rabah Tighilt Ferhat, and Gilles Zurfluh. 2019. Extraction process of conceptual model from a document-oriented NoSQL database. In Proceedings of the KSE. IEEE, 1–5.
  33. Amal Ait Brahim, Rabah Tighilt Ferhat, and Gilles Zurfluh. 2019. Model driven extraction of NoSQL databases schema: Case of MongoDB. In Proceedings of the KDIR. 145–154.
  34. Nicolas Bruno. 2011. Automated Physical Database Design and Tuning. CRC Press. · DOI
  35. Nicolas Bruno and Surajit Chaudhuri. 2005. Automatic physical database tuning: A relaxation-based approach. In Proceedings of the SIGMOD. ACM, 227–238.
  36. Nicolas Bruno and Surajit Chaudhuri. 2006. To tune or not to tune? A lightweight physical design alerter. In Proceedings of the VLDB. ACM, 499–510.
  37. Nicolas Bruno and Surajit Chaudhuri. 2007. An online approach to physical design tuning. In Proceedings of the ICDE. IEEE, 826–835.
  38. Nicolas Bruno and Rimma V. Nehme. 2008. Configuration-parametric query optimization for physical design tuning. In Proceedings of the SIGMOD. ACM, 941–952.
  39. Carlos Javier Fernández Candel, Diego Sevilla Ruiz, and Jesús Joaquín García Molina. 2021. A unified metamodel for NoSQL and relational databases. Inf. Syst. 104 (2021), 101898.
  40. Alberto Caprara, Matteo Fischetti, and Dario Maio. 1995. Exact and approximate algorithms for the index selection problem in physical database design. IEEE Trans. Knowl. Data Eng. 7, 6 (1995), 955–967. · DOI
  41. Alberto Caprara and Juan José Salazar González. 1999. Separating lifted odd-hole inequalities to solve the index selection problem. Discrete Applied Mathematics 92, 2-3 (1999), 111–134. · DOI
  42. Arnaud Castelltort and Anne Laurent. 2014. NoSQL graph-based OLAP analysis. In Proceedings of the KDIR. SciTePress, 217–224.
  43. Surajit Chaudhuri, Benoît Dageville, and Guy M. Lohman. 2004. Self-managing technology in database management systems. In Proceedings of the VLDB. 1243.
  44. Surajit Chaudhuri, Arnd Christian König, and Vivek R. Narasayya. 2004. SQLCM: A continuous monitoring framework for relational database engines. In Proceedings of the ICDE. IEEE, 473–484.
  45. Surajit Chaudhuri and Vivek R. Narasayya. 1997. An efficient cost-driven index selection tool for microsoft SQL server. In Proceedings of the VLDB. 146–155.
  46. Surajit Chaudhuri and Vivek R. Narasayya. 1998. AutoAdmin ’what-if’ index analysis utility. In Proceedings of the SIGMOD. ACM,367–378. · DOI
  47. Surajit Chaudhuri and Vivek R. Narasayya. 2007. Self-tuning database systems: A decade of progress. In Proceedings of the VLDB. ACM, 3–14.
  48. Surajit Chaudhuri and Gerhard Weikum. 2018. Self-management technology in databases. In Proceedings of the Encyclopedia of Database Systems. Springer.
  49. Surajit Chaudhuri and Gerhard Weikum. 2006. Foundations of automated database tuning. In Proceedings of the ICDE. 104.
  50. Artem Chebotko, Andrey Kashlev, and Shiyong Lu. 2015. A big data modeling methodology for apache cassandra. In Proceedings of the BigData Congress. IEEE Computer Society, 238–245.
  51. Max Chevalier, Mohammed El Malki, Arlind Kopliku, Olivier Teste, and Ronan Tournier. 2015. Implementation of multidimensional databases in column-oriented NoSQL systems. In Proceedings of the ADBIS. Springer, 79–91.
  52. Max Chevalier, Mohammed El Malki, Arlind Kopliku, Olivier Teste, and Ronan Tournier. 2015. Implementation of multidimensional databases with document-oriented NoSQL. In Proceedings of the DaWaK(LNCS, Vol. 9263). Springer, 379–390.
  53. Max Chevalier, Mohammed El Malki, Arlind Kopliku, Olivier Teste, and Ronan Tournier. 2015. Implementing multidimensional data warehouses into NoSQL. In Proceedings of the ICEIS. SciTePress, 172–183.
  54. Max Chevalier, Mohammed El Malki, Arlind Kopliku, Olivier Teste, and Ronan Tournier. 2016. Document-oriented models for data warehouses - NoSQL document-oriented for data warehouses. In Proceedings of the ICEIS. SciTePress, 142–149.
  55. Alberto Hernández Chillón, Diego Sevilla Ruiz, Jesus García Molina, and Severino Feliciano Morales. 2019. A model-driven approach to generate schemas for object-document mappers. Ieee Access 7 (2019), 59126–59142. · DOI
  56. Ramtjander Choenni. 1995. On the Automation of Physical Database Design.Ph. D. Dissertation. Univ. Twente.
  57. Sunil Choenni, Henk Blanken, and Thiel Chang. 1993. Index selection in relational databases. In Proceedings of the ICCI. IEEE, 491–496.
  58. Sunil Choenni, Henk M Blanken, and Thiel Chang. 1993. On the automation of physical database design. In Proceedings of the 1993 ACM/SIGAPP Symposium on Applied Computing: States of the art and Practice. 358–367. · DOI
  59. Sunil Choenni, Henk Wagterveld, Henk M. Blanken, and Thiel Chang. 1995. TOPYDE: A tool for physical database design. In Proceedings of the International Conference on Database and Expert Systems Applications. Springer, 502–511. · DOI
  60. Mohamed L. Chouder, Stefano Rizzi, and Rachid Chalal. 2019. EXODuS: Exploratory OLAP over document stores. Inf. Syst. 79 (2019), 44–57. · DOI
  61. Isabelle Comyn-Wattiau and Jacky Akoka. 2017. Model driven reverse engineering of NoSQL property graph databases: The case of Neo4j. In Proceedings of the BigData. IEEE, 453–458.
  62. Pavel Čontoš and Martin Svoboda. 2020. JSON schema inference approaches. In Proceedings of the ER. Springer, 173–183.
  63. Christopher E. Dabrowski, David K. Jefferson, John V. Carlis, and Salvatore T. March. 1989. Integrating a knowledge-based component into a physical database design system. Inf. Manag. 17, 2 (1989), 71–86. · DOI
  64. Benoît Dageville, Dinesh Das, Karl Dias, Khaled Yagoub, Mohamed Zaït, and Mohamed Ziauddin. 2004. Automatic SQL tuning in oracle 10g. In Proceedings of the VLDB. 1098–1109.
  65. Gwendal Daniel, Abel Gómez, and Jordi Cabot. 2019. UMLto[No]SQL: Mapping conceptual schemas to heterogeneous datastores. In Proceedings of the RCIS. IEEE, 1–13.
  66. Gwendal Daniel, Gerson Sunyé, and Jordi Cabot. 2016. UMLtoGraphDB: Mapping conceptual schemas to graph databases. In Proceedings of the ER. Springer, 430–444.
  67. Sudipto Das, Miroslav Grbic, Igor Ilic, Isidora Jovandic, Andrija Jovanovic, Vivek R. Narasayya, Miodrag Radulovic, Maja Stikic, Gaoxiang Xu, and Surajit Chaudhuri. 2019. Automatically indexing millions of databases in microsoft azure SQL database. In Proceedings of the SIGMOD. ACM, 666–679.
  68. Debabrata Dash Neoklis Polyzotis and Anastasia Ailamaki. 2011. Cophy: A scalable portable and interactive index advisor for large workloads. Proc. VLDB Endow. 4 6 (2011) 362–372. · DOI
  69. Ali Davoudian, Liu Chen, and Mengchi Liu. 2018. A survey on NoSQL stores. ACM Computing Surveys 51, 2 (2018), 1–43. · DOI
  70. Alfonso de la Vega, Diego García-Saiz, Carlos Blanco, Marta E. Zorrilla, and Pablo Sánchez. 2018. Mortadelo: A model-driven framework for NoSQL database design. In Proceedings of the MEDI. Springer, 41–57.
  71. Claudio de Lima and Ronaldo dos Santos Mello. 2015. A workload-driven logical design approach for NoSQL document databases. In Proceedings of the iiWAS. ACM, 73:1–73:10.
  72. Khaled Dehdouh, Fadila Bentayeb, Omar Boussaid, and Nadia Kabachi. 2015. Using the column oriented NoSQL model for implementing big data warehouses. In Proceedings of the PDPTA’15. CSREA Press, 469–475.
  73. Francesco Di Tria, Ezio Lefons, and Filippo Tangorra. 2014. Design process for big data warehouses. In Proceedings of the 2014 International Conference on Data Science and Advanced Analytics. IEEE, 512–518. · DOI
  74. Markus Dreseler, Jan Kossmann, Martin Boissier, Stefan Klauck, Matthias Uflacker, and Hasso Plattner. 2019. Hyrise re-engineered: An extensible database system for research in relational in-memory data management. In Proceedings of the EDBT. 313–324.
  75. Jennie Duggan, Aaron J. Elmore, Michael Stonebraker, Magdalena Balazinska, Bill Howe, Jeremy Kepner, Sam Madden, David Maier, Tim Mattson, and Stanley B. Zdonik. 2015. The BigDAWG polystore system. SIGMOD Rec. 44, 2 (2015), 11–16. · DOI
  76. Gabriel Campero Durand, Marcus Pinnecke, Rufat Piriyev, Mahmoud Mohsen, David Broneske, Gunter Saake, Maya S. Sekeran, Fabián Rodriguez, and Laxmi Balami. 2018. GridFormation: Towards self-driven online data partitioning using reinforcement learning. In Proceedings of the aiDM@SIGMOD. ACM, 1:1–1:7.
  77. Said Elnaffar, Wendy Powley, Darcy Benoit, and Pat Martin. 2003. Today’s DBMSs: How autonomic are they. In Proceedings of the DEXA Workshops IEEE, 651–655. https://ieeexplore.ieee.org/abstract/document/1232095/
  78. Bernd-Juergen Falkowski. 1992. Comments on an optimal set of indices for a relational database. IEEE Transactions on Software Engineering 18, 2 (1992), 168. · DOI
  79. Mina H. Farid, Alexandra Roatis, Ihab F. Ilyas, Hella-Franziska Hoffmann, and Xu Chu. 2016. CLAMS: Bringing quality to data lakes. In Proceedings of the SIGMOD. ACM, 2089–2092. · DOI
  80. Yishai A. Feldman and Jacob Reouven. 2003. A knowledge-based approach for index selection in relational databases. Expert Systems with Applications 25, 1 (2003), 15–37. · DOI
  81. Schkolnick Finkelstein, Mario Schkolnick, and Paolo Tiberio. 1988. Physical database design for relational databases. ACM Transactions on Database Systems 13, 1 (1988), 91–128. · DOI
  82. Martin R. Frank, Edward R. Omiecinski, and Shamkant B. Navathe. 1992. Adaptive and automated index selection in RDBMS. In Proceedings of the International Conference on Extending Database Technology. Springer, 277–292.
  83. Angelo Augusto Frozza, Eduardo Dias Defreyn, and Ronaldo dos Santos Mello. 2021. An approach for schema extraction of NoSQL columnar databases: The HBase case study. J. Inf. Data Manag. 12, 5 (2021), 384–395.
  84. Angelo Augusto Frozza, Ronaldo dos Santos Mello, and Felipe de Souza da Costa. 2018. An approach for schema extraction of JSON and extended JSON document collections. In Proceedings of the IRI. IEEE, 356–363.
  85. Angelo Augusto Frozza, Salomão Rodrigues Jacinto, and Ronaldo dos Santos Mello. 2020. An approach for schema extraction of NoSQL graph databases. In Proceedings of the IRI. IEEE, 271–278.
  86. Enrico Gallinucci, Matteo Golfarelli, and Stefano Rizzi. 2019. Approximate OLAP of document-oriented databases: A variety-aware approach. Inf. Syst. 85 (2019), 114–130. · DOI
  87. Christian Garcia-Arellano, Sam Lightstone, Guy M. Lohman, Volker Markl, and Adam J. Storm. 2006. Autonomic features of the IBM DB2 universal database for linux, UNIX, and windows. IEEE Trans. Syst. Man Cybern. Syst. 36, 3 (2006), 365–376. · DOI
  88. Michael Gibas, Guadalupe Canahuate, and Hakan Ferhatosmanoglu. 2008. Online index recommendations for high-dimensional databases using query workloads. IEEE Trans. Knowl. Data Eng. 20, 2 (2008), 246–260. · DOI
  89. Maxime Gobert, Loup Meurice, and Anthony Cleve. 2021. Conceptual modeling of hybrid polystores. In Proceedings of the ER. Springer, 113–122.
  90. Goetz Graefe, Felix Halim, Stratos Idreos, Harumi Kuno, Stefan Manegold, and Bernhard Seeger. 2014. Transactional support for adaptive indexing. The VLDB Journal 23, 2 (2014), 303–328. · DOI
  91. Goetz Graefe, Stratos Idreos, Harumi A. Kuno, and Stefan Manegold. 2010. Benchmarking adaptive indexing. In Proceedings of the TPCTC(LNCS, Vol. 6417). Springer, 169–184.
  92. Goetz Graefe and Harumi Kuno. 2010. Adaptive indexing for relational keys. In Proceedings of the ICDEW. IEEE, 69–74.
  93. Goetz Graefe and Harumi A. Kuno. 2010. Self-selecting, self-tuning, incrementally optimized indexes. In Proceedings of the EDBT(ACM International Conference Proceeding Series). ACM, 371–381.
  94. Katarina Grolinger and Miriam AM Capretz. 2012. Autonomic database management: State of the art and future trends. In Proceedings of the CATA. 276–281. https://ir.lib.uwo.ca/electricalpub/23/
  95. TI Gündem. 1999. Near optimal multiple choice index selection for relational databases. Computers & Mathematics with Applications 37, 2 (1999), 111–120. · DOI
  96. Himanshu Gupta. 1997. Selection of views to materialize in a data warehouse. In Proceedings of the ICDT. Springer, 98–112.
  97. Himanshu Gupta, Venky Harinarayan, Anand Rajaraman, and Jeffrey D. Ullman. 1997. Index selection for OLAP. In Proceedings of the ICDE. IEEE, 208–219.
  98. Himanshu Gupta and Inderpal Singh Mumick. 2005. Selection of views to materialize in a data warehouse. IEEE Transactions on Knowledge and Data Engineering 17, 1 (2005), 24–43. · DOI
  99. Rihan Hai, Christoph Quix, and Dan Wang. 2019. Relaxed functional dependency discovery in heterogeneous data lakes. In Proceedings of the ER(LNCS, Vol. 11788). Springer, 225–239.
  100. Felix Halim, Stratos Idreos, Panagiotis Karras, and Roland H. C. Yap. 2012. Stochastic database cracking: Towards robust adaptive indexing in main-memory column-stores. Proc. VLDB Endow. 5, 6 (2012), 502–513. · DOI
  101. Hamdi Ben Hamadou, Enrico Gallinucci, and Matteo Golfarelli. 2019. Answering GPSJ queries in a polystore: A dataspace-based approach. In Proceedings of the ER(LNCS, Vol. 11788). Springer, 189–203.
  102. Michael Hammer and Arvola Chan. 1976. Index selection in a self-adaptive data base management system. In Proceedings of the SIGMOD. 1–8.
  103. Michael Hammer and Bahram Niamir. 1979. A heuristic approach to attribute partitioning. In Proceedings of the SIGMOD. 93–101.
  104. Shady Hamouda and Zurinahni Zainol. 2017. Document-oriented data schema for relational database migration to NoSQL. In Proceedings of the Innovate-Data. IEEE, 43–50.
  105. Venky Harinarayan, Anand Rajaraman, and Jeffrey D. Ullman. 1996. Implementing data cubes efficiently. In Proceedings of the SIGMOD. ACM Press, 205–216. · DOI
  106. Olaf Hartig and Jan Hidders. 2019. Defining schemas for property graphs by using the GraphQL schema definition language. In Proceedings of the GRADES/NDA@SIGMOD/PODS. ACM, 6:1–6:11.
  107. Michael Hatzopoulos and J. Kollias. 1985. On the selection of a reduced set of indexes. Comput. J. 28, 4 (1985), 406–408. · DOI
  108. Michael Hatzopoulos and John G. Kollias. 1984. On the optimal selection of multilist database structures. IEEE Transactions on Software Engineering 10, 6 (1984), 681–687. · DOI
  109. Victor Herrero, Alberto Abelló, and Oscar Romero. 2016. NOSQL design for analytical workloads: Variability matters. In Proceedings of the ER(LNCS, Vol. 9974). 50–64.
  110. Pedro Holanda, Mark Raasveldt, Stefan Manegold, and Hannes Mühleisen. 2019. Progressive indexes: Indexing for interactive data analysis. Proceedings of the VLDB Endowment 12, 13 (2019), 2366–2378. · DOI
  111. Marc Holze. 2012. Self-Management Concepts for Relational Database Systems. Ph. D. Dissertation. University of Hamburg.
  112. Marc Holze and Norbert Ritter. 2011. System models for goal-driven self-management in autonomic databases. Data & Knowledge Engineering 70, 8 (2011), 685–701. · DOI
  113. Stratos Idreos, Martin L. Kersten, and Stefan Manegold. 2007. Database cracking. In Proceedings of the CIDR. 68–78. www.cidrdb.org.
  114. Stratos Idreos, Martin L. Kersten, and Stefan Manegold. 2007. Updating a cracked database. In Proceedings of the SIGMOD. ACM, 413–424.
  115. Stratos Idreos, Stefan Manegold, Harumi Kuno, and Goetz Graefe. 2011. Merging what’s cracked, cracking what’s merged: Adaptive indexing in main-memory column-stores. Proceedings of the VLDB Endowment 4, 9 (2011), 586–597. · DOI
  116. Abdullahi Abubakar Imam, Shuib Basri, Rohiza Ahmad, Amirudin A. Wahab, María T. González-Aparicio, Luiz Fernando Capretz, Ammar K. Alazzawi, and Abdullateef O. Balogun. 2020. Dsp: Schema design for non-relational applications. Symmetry 12, 11 (2020), 1799. · DOI
  117. Abdullahi Abubakar Imam, Shuib Basri, Rohiza Ahmad, Junzu Watada, and María T. González-Aparicio. 2018. Automatic schema suggestion model for NoSQL document-stores databases. Journal of Big Data 5, 1 (2018), 1–17.
  118. Abdullahi Abubakar Imam, Shuib Basri, Rohiza Ahmad, Junzo Watada, María Teresa González Aparicio, and Malek Ahmad Almomani. 2018. Data modeling guidelines for NoSQL document-store databases. International Journal of Advanced Computer Science and Applications, 9, 10 (2018), 544–555.
  119. Maggie Yuet Lin Ip. 1981. An Approximation Algorithm for the Index Selection Problem. University of Regina.
  120. Maggie Y. L. Ip, Lawrence V. Saxton, and Vijay V. Raghavan. 1983. On the selection of an optimal set of indexes. IEEE Transactions on Software Engineering 9, 2 (1983), 135–143.
  121. Javier Luis Cánovas Izquierdo and Jordi Cabot. 2016. JSONDiscoverer: Visualizing the schema lurking behind JSON documents. Knowledge-Based Systems 103 (2016), 52–55. · DOI
  122. Alekh Jindal and Jens Dittrich. 2011. Relax and let the database do the partitioning online. In Proceedings of the BIRTE(Lecture Notes in Business Information Processing, Vol. 126). Springer, 65–80. · DOI
  123. Marcos Jota, Marlene Goncalves, and Ritces Parra. 2019. A physical design strategy on a nosql dbms. In Proceedings of the Data Science. CRC Press, 69–93. · DOI
  124. Donghe Kang, Ruochen Jiang, and Spyros Blanas. 2021. Jigsaw: A data storage and query processing engine for irregular table partitioning. In Proceedings of the SIGMOD. 898–911.
  125. Karamjit Kaur and Rinkle Rani. 2013. Modeling and querying data in NoSQL databases. In Proceedings of the BigData. IEEE, 1–7.
  126. Hideaki Kimura, George Huo, Alexander Rasin, Samuel Madden, and Stanley B. Zdonik. 2010. CORADD: Correlation aware database designer for materialized views and indexes. Proc. VLDB Endow. 3, 1 (2010), 1103–1113. · DOI
  127. Hideaki Kimura, Vivek R. Narasayya, and Manoj Syamala. 2011. Compression aware physical database design. PVLDB 4, 10 (2011), 657–668.
  128. WF King. 1974. On the Selection of Indices for a File. Research report RJ 1341. IBM, San Jose, CA.
  129. Barbara Kitchenham, Pearl Brereton, David Budgen, Mark Turner, John Bailey, and Stephen Linkman. 2009. Systematic literature reviews in software engineering–a systematic literature review. Inf. Softw. Technol. 51, 1 (2009), 7–15. · DOI · Paper page
  130. B. Kitchenham and S. Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. Technical report Ver. 2.3. School of Computer Science and Mathematics Keele University Keele U.K. 57 pages. · DOI
  131. Meike Klettke, Uta Störl, and Stefanie Scherzinger. 2015. Schema extraction and structural outlier detection for JSON-based NoSQL data stores. In Proceedings of the BTW(LNI, Vol. P-241). GI, 425–444.
  132. Boyan Kolev, Patrick Valduriez, Carlyna Bondiombouy, Ricardo Jiménez-Peris, Raquel Pau, and José Pereira. 2016. CloudMdsQL: Querying heterogeneous cloud data stores with a common language. Distributed and Parallel Databases 34, 4 (2016), 463–503. · DOI
  133. N. Korla. 2013. Cassandra data modeling-practical considerations@Netflix. Retrieved October 22, 2019 from http://www.slideshare.net/nkorla1share/cass-summit-3
  134. Jan Kossmann, Stefan Halfpap, Marcel Jankrift, and Rainer Schlosser. 2020. Magic mirror in my hand, which is the best in the land? An experimental evaluation of index selection algorithms. Proc. VLDB Endow. 13, 11 (2020), 2382–2395. · DOI
  135. Jan Kossmann and Rainer Schlosser. 2019. A framework for self-managing database systems. In Proceedings of the ICDEW. IEEE, 100–106.
  136. Jan Kossmann and Rainer Schlosser. 2020. Self-driving database systems: A conceptual approach. Distributed and Parallel Databases 38, 4 (2020), 795–817. · DOI
  137. Jozef Kratica, Ivana Ljubić, and Dušan Tošić. 2003. A genetic algorithm for the index selection problem. In Workshops on Applications of Evolutionary Computation. Springer, 280–290.
  138. Darl Kuhn, Sam R. Alapati, and Bill Padfield. 2012. Sql access advisor. In Proceedings of the Expert Indexing in Oracle Database 11g. Springer, 233–248. · DOI
  139. Wilburt Juan Labio, Dallan Quass, and Brad Adelberg. 1997. Physical database design for data warehouses. In Proceedings of the ICDE. IEEE, 277–288.
  140. Hai Lan, Zhifeng Bao, and Yuwei Peng. 2020. An index advisor using deep reinforcement learning. In Proceedings of the CIKM. 2105–2108.
  141. Hanâ Lbath, Angela Bonifati, and Russ Harmer. 2021. Schema inference for property graphs. In Proceedings of the EDBT. 499–504.
  142. Éric Leclercq, Annabelle Gillet, Thierry Grison, and Marinette Savonnet. 2019. Polystore and tensor data model for logical data independence and impedance mismatch in big data analytics. Trans. Large Scale Data Knowl. Centered Syst. 42 (2019), 51–90.
  143. Viktor Leis, Andrey Gubichev, Atanas Mirchev, Peter Boncz, Alfons Kemper, and Thomas Neumann. 2015. How good are query optimizers, really? Proceedings of the VLDB Endowment 9, 3 (2015), 204–215. · DOI
  144. Chongxin Li. 2010. Transforming relational database into HBase: A case study. In Proceedings of the ICSESS. IEEE, 683–687.
  145. Feifei Li. 2019. Cloud-native database systems at alibaba: Opportunities and challenges. Proceedings of the VLDB Endowment 12, 12 (2019), 2263–2272. · DOI
  146. Guoliang Li, Xuanhe Zhou, Ji Sun, Xiang Yu, Yue Han, Lianyuan Jin, Wenbo Li, Tianqing Wang, and Shifu Li. 2021. opengauss: An autonomous database system. Proceedings of the VLDB Endowment 14, 12 (2021), 3028–3042. · DOI
  147. Liangzhe Li and Le Gruenwald. 2013. Self-managing online partitioner for databases (SMOPD): A vertical database partitioning system with a fully automatic online approach. In Proceedings of the IDEAS. ACM, 168–173.
  148. Xiang Li, Zhiyi Ma, and Hongjie Chen. 2014. QODM: A query-oriented data modeling approach for NoSQL databases. In Proceedings of the 2014 IEEE Workshop on Advanced Research and Technology in Industry Applications. IEEE, 338–345.
  149. Yan Li, Ping Gu, and Chao Zhang. 2014. Transforming UML class diagrams into HBase based on meta-model. In Proceedings of the 2014 International Conference on Information Science, Electronics and Electrical Engineering. IEEE, 720–724.
  150. Xi Liang Aaron J. Elmore and Sanjay Krishnan. 2019. Opportunistic view materialization with deep reinforcement learning. CoRR abs/1903.01363 (2019). · arXiv
  151. Sam Lightstone and Bishwaranjan Bhattacharjee. 2004. Automated design of multidimensional clustering tables for relational databases. In Proceedings of the VLDB. 1170–1181.
  152. Sam S. Lightstone, Toby J. Teorey, and Tom Nadeau. 2010. Physical Database Design: The Database Professional’s Guide to Exploiting Indexes, Views, Storage, and More. Morgan Kaufmann.
  153. JH Liou and S. Bing Yao. 1977. Multi-dimensional clustering for data base organizations. Inf. Syst. 2, 4 (1977), 187–198. · DOI
  154. Zhen Hua Liu and Dieter Gawlick. 2015. Management of flexible schema data in RDBMSs - opportunities and limitations for NoSQL -. In Proceedings of the CIDR. www.cidrdb.org.
  155. Jiaheng Lu and Irena Holubová. 2019. Multi-model databases: A new journey to handle the variety of data. ACM Computing Surveys 52, 3 (2019), 1–38.
  156. Lin Ma, Dana Van Aken, Ahmed Hefny, Gustavo Mezerhane, Andrew Pavlo, and Geoffrey J. Gordon. 2018. Query-based workload forecasting for self-driving database management systems. In Proceedings of the SIGMOD. ACM, 631–645.
  157. Dario Maio, Claudio Sartori, and Maria Rita Scalas. 1987. A modular user-oriented decision support for physical database design. Decision Support Systems 3, 2 (1987), 155–163. · DOI
  158. Jihane Mali, Faten Atigui, Ahmed Azough, and Nicolas Travers. 2020. ModelDrivenGuide: An approach for implementing NoSQL schemas. In Proceedings of the DEXA(LNCS, Vol. 12391). Springer, 141–151.
  159. Volker Markl, Frank Ramsak, and Rudolf Bayer. 1999. Improving OLAP performance by multidimensional hierarchical clustering. In Proceedings of the IDEAS. IEEE Computer Society, 165–177.
  160. Abdul Mateen, Basit Raza, Muhammad Sher, Mian Muhammad Awais, and Tauqeer Hussain. 2010. Evolution of autonomic database management systems. In Proceedings of the ICCAE. IEEE, 33–37.
  161. Ines Ben Messaoud, Refka Ben Ali, and Jamel Feki. 2017. From document warehouse to column-oriented NoSQL document warehouse. In Proceedings of the ICSOFT. SciTePress, 85–94.
  162. Ines Ben Messaoud, Abdulrahman A. Alshdadi, and Jamel Feki. 2021. Building a document-oriented warehouse using NoSQL. Int. J. Oper. Res. Inf. Syst. 12, 2 (2021), 33–54. · DOI
  163. Michael J. Mior. 2018. Physical Design for Non-relational Data Systems. Ph. D. Dissertation. University of Waterloo.
  164. Michael J. Mior, Kenneth Salem, Ashraf Aboulnaga, and Rui Liu. 2017. NoSE: Schema design for NoSQL applications. IEEE Trans. Knowl. Data Eng. 29, 10 (2017), 2275–2289. · DOI
  165. Chuang-Hue Moh, Ee-Peng Lim, and Wee-Keong Ng. 2000. DTD-miner: A tool for mining DTD from XML documents. In Proceedings of the WECWIS. IEEE, 144–151.
  166. Maryam Mozaffari, Eslam Nazemi, and Amir-Masoud Eftekhari-Moghadam. 2020. Feedback control loop design for workload change detection in self-tuning NoSQL wide column stores. Expert Syst. Appl. 142 (2020), 112973.
  167. Maryam Mozaffari, Eslam Nazemi, and Amir-Masoud Eftekhari-Moghadam. 2021. CONST: Continuous online NoSQL schema tuning. Softw. Pract. Exp. 51, 5 (2021), 1147–1169. · DOI
  168. Pablo D. Muñoz-Sánchez, Carlos Javier Fernández Candel, Jesús García Molina, and Diego Sevilla Ruiz. 2020. Managing physical schemas in MongoDB stores. In Proceedings of the ER (Workshops). Springer, 162–172.
  169. Shamkant B. Navathe, Stefano Ceri, Gio Wiederhold, and Jinglie Dou. 1984. Vertical partitioning algorithms for database design. ACM Trans. Database Syst. 9, 4 (1984), 680–710. · DOI
  170. Shamkant B. Navathe and Minyoung Ra. 1989. Vertical partitioning for database design: A graphical algorithm. In Proceedings of the SIGMOD. ACM,440–450.
  171. Rimma Nehme and Nicolas Bruno. 2011. Automated partitioning design in parallel database systems. In Proceedings of the SIGMOD. 1137–1148.
  172. Priscilla Neuhaus, Julia Couto, Jonatas Wehrmann, Duncan Dubugras Alcoba Ruiz, and Felipe Meneguzzi. 2019. GADIS: A genetic algorithm for database index selection (S). In Proceedings of the SEKE. KSI, 39–54.
  173. Viviana Noguera and Daniel Lucrédio. 2019. Implementing a classic ER algebra to automatically generate complex queries for document-oriented databases. In Proceedings of the SBCARS. ACM, 43–52. · DOI
  174. Harley Vera Olivera, Maristela Holanda, Valeria Guimarâes, Fernanda Hondo, and Wagner Boaventura. 2015. Data modeling for NoSQL document-oriented databases. In Proceedings of the SIMBig. CEUR-WS.org, 129–135.
  175. Rafik Ouanouki, Alain April, Alain Abran, Abraham Gomez, and Jean-Marc Desharnais. 2017. Toward building RDB to HBase conversion rules. Journal of Big Data 4, 1 (2017), 1–21.
  176. Gabriel Paludo Licks, Julia Colleoni Couto, Priscilla de Fátima Miehe, Renata De Paris, Duncan Dubugras Ruiz, and Felipe Meneguzzi. 2020. SMARTIX: A database indexing agent based on reinforcement learning. Applied Intelligence 50, 8 (2020), 2575–2588. · DOI
  177. Stratos Papadomanolakis and Anastassia Ailamaki. 2007. An integer linear programming approach to database design. In Proceedings of the ICDE Workshops. IEEE Computer Society, 442–449.
  178. Stratos Papadomanolakis, Debabrata Dash, and Anastassia Ailamaki. 2007. Efficient use of the query optimizer for automated database design. In Proceedings of the VLDB. ACM, 1093–1104.
  179. Thorsten Papenbrock and Felix Naumann. 2016. A hybrid approach to functional dependency discovery. In Proceedings of the SIGMOD. ACM, 821–833. · DOI
  180. Patel, J.2012. Cassandra data modeling best practices. Retrieved October 22, 2019. from http://ebaytechblog.com/?p=1308
  181. Andrew Pavlo, Gustavo Angulo, Joy Arulraj, Haibin Lin, Jiexi Lin, Lin Ma, Prashanth Menon, Todd C. Mowry, Matthew Perron, Ian Quah, Siddharth Santurkar, Anthony Tomasic, Skye Toor, Dana Van Aken, Ziqi Wang, Yingjun Wu, Ran Xian, and Tieying Zhang. 2017. Self-driving database management systems. In Proceedings of the CIDR. 1.
  182. Andy Pavlo, Matthew Butrovich, Lin Ma, Prashanth Menon, Wan Shen Lim, Dana Van Aken, and William Zhang. 2021. Make your database system dream of electric sheep: Towards self-driving operation. Proc. VLDB Endow. 14, 12 (2021), 3211–3221. · DOI
  183. Andrew Pavlo, Carlo Curino, and Stanley B. Zdonik. 2012. Skew-aware automatic database partitioning in shared-nothing, parallel OLTP systems. In Proceedings of the SIGMOD. ACM, 61–72. · DOI
  184. Wendel Góes Pedrozo, Júlio César Nievola, and Deborah Carvalho Ribeiro. 2018. An adaptive approach for index tuning with learning classifier systems on hybrid storage environments. In Proceedings of the HAIS. Springer, 716–729.
  185. Gregory Piatetsky-Shapiro. 1983. The optimal selection of secondary indices is NP-complete. ACM SIGMOD Record 13, 2 (1983), 72–75. · DOI
  186. Holger Pirk, Eleni Petraki, Stratos Idreos, Stefan Manegold, and Martin L. Kersten. 2014. Database cracking: Fancy scan, not poor man’s sort!. In Proceedings of the DaMoN. ACM, 4:1–4:8.
  187. Nataliya Prokoshyna, Jaroslaw Szlichta, Fei Chiang, Renée J. Miller, and Divesh Srivastava. 2015. Combining quantitative and logical data cleaning. Proc. VLDB Endow. 9, 4 (2015), 300–311. · DOI
  188. Jun Rao, Chun Zhang, Nimrod Megiddo, and Guy M. Lohman. 2002. Automating physical database design in a parallel database. In Proceedings of the SIGMOD. ACM, 558–569.
  189. Alexander Rasin and Stanley B. Zdonik. 2013. An automatic physical design tool for clustered column-stores. In Proceedings of the EDBT. ACM, 203–214.
  190. Keven Richly, Rainer Schlosser, and Martin Boissier. 2021. Joint index, sorting, and compression optimization for memory-efficient spatio-temporal data management. In Proceedings of the ICDE. IEEE, 1901–1906.
  191. Noa Roy-Hubara and Arnon Sturm. 2020. Design methods for the new database era: A systematic literature review. Software and Systems Modeling 19, 2 (2020), 297–312. · DOI
  192. Steve Rozen and Dennis E. Shasha. 1991. A framework for automating physical database design. In Proceedings of the VLDB. 401–411.
  193. Diego Sevilla Ruiz, Severino Feliciano Morales, and Jesús García Molina. 2015. Inferring versioned schemas from NoSQL databases and its applications. In Proceedings of the ER(LNCS, Vol. 9381). Springer, 467–480.
  194. Zahra Sadri, Le Gruenwald, and Eleazar Leal. 2020. Online index selection using deep reinforcement learning for a cluster database. In Proceedings of the ICDEW. IEEE, 158–161.
  195. Kai-Uwe Sattler, Ingolf Geist, and Eike Schallehn. 2003. QUIET: Continuous query-driven index tuning. In Proceedings of the VLDB. 1129–1132.
  196. Lucas C. Scabora, Jaqueline Joice Brito, Ricardo Rodrigues Ciferri, and Cristina Dutra de Aguiar Ciferri. 2016. Physical data warehouse design on NoSQL databases - OLAP query processing over HBase. In Proceedings of the ICEIS. SciTePress, 111–118.
  197. Sebastian Schelter, Dustin Lange, Philipp Schmidt, Meltem Celikel, Felix Bießmann, and Andreas Grafberger. 2018. Automating large-scale data quality verification. Proc. VLDB Endow. 11, 12 (2018), 1781–1794. · DOI
  198. Mario Schkolnick. 1975. The optimal selection of secondary indices for files. Inf. Syst. 1, 4 (1975), 141–146. · DOI
  199. Rainer Schlosser, Jan Kossmann, and Martin Boissier. 2019. Efficient scalable multi-attribute index selection using recursive strategies. In Proceedings of the ICDE. IEEE, 1238–1249.
  200. Karl Schnaitter, Serge Abiteboul, Tova Milo, and Neoklis Polyzotis. 2006. Colt: Continuous on-line tuning. In Proceedings of the SIGMOD. 793–795.

200 of 233 shown

Cited by

Sorted by citations

See all 17

Metadata

Authors
Mozaffari, M., Dignös, A., Gamper, J., & Störl, U.
Affiliations
  • Free University of Bozen-Bolzano (IT)
  • FernUniversität in Hagen (DE)
ORCID
Venue
ACM Computing Surveys
Publisher
Association for Computing Machinery (ACM)
Published
2024-06-29
Volume
56
Issue
11
Pages
1-37
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
DOI
10.1145/3665323
OpenAlex
W4397022312
Cited by
17
References
0
Citations by year
2026: 12 · 2025: 4 · 2024: 1
FWCI
0.99
Type
journal article
Language
en
Open access
Licence
Locations
  • ACM Computing Surveys (publishedVersion, cc-by)
  • Open Research (University of Surrey) (submittedVersion, cc-by)
Funders
  • National Recovery and Resilience Plan
  • Italian Ministry of University and Research
  • European Union-NextGenerationEU (PE00000003)
  • Italian Ministry of University and Research, CUP (I33C22006890001)
Topics
  • Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
  • Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
  • Physical Sciences › Computer Science › Information Systems › Data Management and Algorithms
Keywords
NoSQL databases, relational databases, database performance tuning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Self-tuning Database Systems: A Systematic Literature Review of Automatic Database Schema Design and Tuning. https://app.cochat.ai/papers/10.1145/3665323
The paper
Mozaffari, M., Dignös, A., Gamper, J., & Störl, U. (2024). Self-tuning Database Systems: A Systematic Literature Review of Automatic Database Schema Design and Tuning. ACM Computing Surveys. https://doi.org/10.1145/3665323