Cloud Query Processing with Reinforcement Learning-based Multi-Objective Re-optimization - Irisa Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Cloud Query Processing with Reinforcement Learning-based Multi-Objective Re-optimization

Chenxiao Wang
  • Fonction : Auteur
  • PersonId : 1090052
Eleazar Leal
  • Fonction : Auteur
  • PersonId : 1066710

Résumé

Query processing on cloud database systems is a challenging problem due to the dynamic cloud environment. The configuration and utilization of the distributed hardware used to process queries change continuously. A query optimizer aims to generate query execution plans (QEPs) that are optimal meet user requirements. In order to achieve such QEPs under dynamic environments, performing query re-optimizations during query execution has been proposed in the literature. In cloud database systems, besides query execution time, users also consider the monetary cost to be paid to the cloud provider for executing queries. Thus, such query re-optimizations are multi-objective optimizations which take both time and monetary costs into consideration. However, traditional re-optimization requires accurate cost estimations, and obtaining these estimations adds overhead to the system, and thus causes negative impacts on query performance. To fill this gap, in this paper, we introduce ReOptRL, a novel query processing algorithm based on deep reinforcement learning. It bootstraps a QEP generated by an existing query optimizer and dynamically changes the QEP during the query execution. It also keeps learning from incoming queries to build a more accurate optimization model. In this algorithm, the QEP of a query is adjusted based on the recent performance of the same query so that the algorithm does not rely on cost estimations. Our experiments show that the proposed algorithm performs better than existing query optimization algorithms in terms of query execution time and query execution monetary costs..
Fichier principal
Vignette du fichier
medi2021_paper31_carmer-ready.pdf (594.12 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03522314 , version 1 (12-01-2022)

Identifiants

  • HAL Id : hal-03522314 , version 1

Citer

Chenxiao Wang, Le Gruenwald, Laurent d'Orazio, Eleazar Leal. Cloud Query Processing with Reinforcement Learning-based Multi-Objective Re-optimization. International Conference on Model & Data Engineering (MEDI), Jun 2021, Tallinn, Estonia. ⟨hal-03522314⟩
52 Consultations
131 Téléchargements

Partager

Gmail Facebook X LinkedIn More