Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Future Internet

QRLIT: Quantum Reinforcement Learning for Database Index Tuning

Diogo Barbosa, Le Gruenwald, Laurent d’Orazio, Jorge Bernardino

Published Nov 22, 2024• 13 citations
Publisher

Abstract

Selecting indexes capable of reducing the cost of query processing in database systems is a challenging task, especially in large-scale applications. Quantum computing has been investigated with promising results in areas related to database management, such as query optimization, transaction scheduling, and index tuning. Promising results have also been seen when reinforcement learning is applied for database tuning in classical computing. However, there is no existing research with implementation details and experiment results for index tuning that takes advantage of both quantum computing and reinforcement learning. This paper proposes a new algorithm called QRLIT that uses the power of quantum computing and reinforcement learning for database index tuning. Experiments using the database TPC-H benchmark show that QRLIT exhibits superior performance and a faster convergence compared to its classical counterpart.

DOI
10.3390/fi16120439

Related papers

A Divergent Index Tuning Advisor Using Quantum Machine Learning for Distributed Databases

Sam Bird, Le Gruenwald, Sven Groppe

Automatic index selection is a critical task for optimising query performance in distributed database systems. This problem is NP-hard, and existing approaches based on heuristic methods or optimisation problems struggle to generate good recommendations within a reasonable timeframe for large-scale database applications. While using classical deep reinforcement learning with Deep Q-Networks (DQN) has shown promise, its scalability in high-dimensional state spaces remains a challenge. In this paper, we explore the application of hybrid quantum-classical deep reinforcement learning, specifically a Quantum Deep Q-Network (Q-DQN), to the divergent index tuning problem. Using the TPC-H benchmark on a varying number of database replicas, we compare the performance of classical divergent index tuning against a hybrid quantum-classical algorithm using a Q-DQN implemented on the IBM Qiskit Aer simulator. We find that the hybrid quantum-classical algorithm exhibits remarkably higher sample efficiency, converging in significantly fewer action steps while maintaining a comparable query execution time. Overall, our findings suggest that variational quantum circuits provide an effective representation for deep reinforcement learning, achieving faster policy convergence, and that when appropriately configured, this improved sample efficiency can be obtained without loss in query execution performance.

IEEE International Conference on Data Engineering Workshops (ICDEW)•May 4, 2026•0 citations

Optimization of Reinforcement Learning Using Quantum Computation

Roopa Ravish, Nischal R. Bhat, N. Nandakumar +3 more

Exploring the convergence of quantum computing and machine learning, this paper delves into Quantum Reinforcement Learning (QRL) with a specific focus on Variational Quantum Circuits (VQC). Alongside a comprehensive examination of the field, the study presents a concrete implementation of QRL tailored to foundational gym environments. Leveraging principles from Quantum Computing, experiments reveal QRL’s potential in enhancing reinforcement learning tasks within these environments, showcasing notable space optimization for RL models. Quantitative results indicate a reduction in the number of trainable parameters by up to 90% when compared to classical approaches, significantly improving efficiency, mainly due to quantum principles of superposition and entanglement. This highlights the promising implications of integrating quantum computing techniques to address challenges and advance capabilities in fundamental reinforcement learning scenarios. Furthermore, the study discusses the adaptability of QRL algorithms to diverse problem domains, suggesting their potential for scalability and applicability beyond simple environments. Such versatility underscores the robustness and practical relevance of QRL methodologies in real-world scenarios, positioning them as valuable tools for tackling complex reinforcement learning challenges.

IEEE Access•Jan 1, 2024•12 citations

Quantum Machine Learning for Ultra-Fast Query Execution in High-Dimensional SQL Data Systems

Raghavender Maddali -

The new Quantum Machine Learning (QML) paradigm for highly efficient query execution in high-dimensional SQL data systems and Conventional database query execution is plagued by performance bottlenecks because of the explosive nature of structured data and intricate query optimization issues. The new QML-based methodology uses quantum algorithms to accelerate query processing by exploiting parallel computation, quantum-aided indexing, and probabilistic data access. With the incorporation of quantum-enhanced optimization methods, the framework achieves remarkable query execution time reduction, enhanced system scalability, and increased efficiency in managing relational databases at scale. The work compares the framework's performance against traditional SQL query optimizers and shows better performance in terms of execution speed, accuracy in retrieving data, and utilization of computational resources. The results also point to the promise of QML in revolutionizing DBMS and bringing in next-generation data analytics solutions.

International Journal of Leading Research Publication.•Apr 9, 2022•2 citations

Quantum Reinforcement Learning for Effective Join Order Optimization to Reduce Time Complexity

Durai Arumugam S S L, Omprakash G, Radhakrishnan S +1 more

Huge-scale identity management systems, for instance, India's Central Identities Data Repository (CIDR), pose unprecedented demands on carrying out sophisticated join operations for mission-sensitive applications, for instance, Know Your Customer (KYC) verification, Permanent Account Number (PAN) linkage, and recipient verification processes. State-of-the-art optimization schemes largely use cost-based and rule-based techniques that exhibit drastic performance degradation at high-concurrent workloads and dynamically changing query patterns. The current work outlines a novel artificial intelligence paradigm that exploits Quantum Reinforcement Learning (QRL) principles for optimized join order selection and optimization. The approach capitalizes on the native properties of quantum computing, i.e., parallelism and superposition, for automatically discovering near-optimal join execution sequences. Our experimental work on a massive number of benchmark datasets establishes superior scalability properties and 25%-35% savings in execution efficiency over traditional optimization schemes. The paradigm positions QRL as a revolutionary solution for distributed database systems, particularly those for hosting country-scale identity management systems, for instance, Aadhaar-linked infrastructures.

International Conference on Intelligent Cyber Physical Systems and Internet of Things (ICoICI)•Sep 1, 2026•0 citations

Quantum Reinforcement Learning with Quantum World Model

Peigen Zeng, Ying He, Fei Richard Yu +1 more

Quantum reinforcement learning (QRL) can outperform classical reinforcement learning (RL) by utilizing quantum parallel theory and quantum phenomena such as superposition and entanglement. Although some excellent work has been done on QRL, most existing works either fail to show the exponential advantage of quantum computation over classical computation in terms of performance or are too demanding on quantum devices. In this paper, we provide a novel perspective on combining quantum computing and RL with faster convergence speed and relatively relaxed demands on quantum devices. Specifically, we propose a method to construct a world model with quantum circuit that allows it to interact in a quantum way. In addition, we use Grover's algorithm to efficiently extract high-value information from the quantum world model. Extensive simulation results show that the proposed method can have superior performance compared to classical RL algorithms.

Globecom•Dec 4, 2023•2 citations

Quantum Reinforcement Learning: Principles and Research Progress

Yuxuan Zhao, Kuntuo Zhu

Quantum reinforcement learning (QRL) is a burgeoning area that lies at the convergence of quantum computing and machine learning. Based on the characteristics of quantum superposition and quantum entanglement, quantum reinforcement learning can achieve some quantum advantages on existing noisy intermediate-scale quantum devices compared to traditional reinforcement learning. Within the field of information systems, reinforcement learning techniques have been extensively explored for applications including intelligent decision support mechanisms, resource distribution strategies, and system enhancement under conditions of uncertainty. This paper analyzes the fundamental principles of quantum reinforcement learning and introduces research work and progress in related areas. This study examines the foundational concepts underlying quantum reinforcement learning and provides an overview of notable algorithmic strategies documented in contemporary research.

International Conference on Innovation Management and Information Systems (ICIMIS)•Mar 27, 2026•0 citations
Selecting indexes capable of reducing the cost of query processing in database systems is a challenging task, especially in large-scale applications. Quantum computing has been investigated with promising results in areas related to database management, such as query optimization, transaction scheduling, and index tuning. Promising results have also been seen when reinforcement learning is applied for database tuning in classical computing. However, there is no existing research with implementation details and experiment results for index tuning that takes advantage of both quantum computing and reinforcement learning. This paper proposes a new algorithm called QRLIT that uses the power of quantum computing and reinforcement learning for database index tuning. Experiments using the database TPC-H benchmark show that QRLIT exhibits superior performance and a faster convergence compared to its classical counterpart.
Automatic index selection is a critical task for optimising query performance in distributed database systems. This problem is NP-hard, and existing approaches based on heuristic methods or optimisation problems struggle to generate good recommendations within a reasonable timeframe for large-scale database applications. While using classical deep reinforcement learning with Deep Q-Networks (DQN) has shown promise, its scalability in high-dimensional state spaces remains a challenge. In this paper, we explore the application of hybrid quantum-classical deep reinforcement learning, specifically a Quantum Deep Q-Network (Q-DQN), to the divergent index tuning problem. Using the TPC-H benchmark on a varying number of database replicas, we compare the performance of classical divergent index tuning against a hybrid quantum-classical algorithm using a Q-DQN implemented on the IBM Qiskit Aer simulator. We find that the hybrid quantum-classical algorithm exhibits remarkably higher sample efficiency, converging in significantly fewer action steps while maintaining a comparable query execution time. Overall, our findings suggest that variational quantum circuits provide an effective representation for deep reinforcement learning, achieving faster policy convergence, and that when appropriately configured, this improved sample efficiency can be obtained without loss in query execution performance.
Exploring the convergence of quantum computing and machine learning, this paper delves into Quantum Reinforcement Learning (QRL) with a specific focus on Variational Quantum Circuits (VQC). Alongside a comprehensive examination of the field, the study presents a concrete implementation of QRL tailored to foundational gym environments. Leveraging principles from Quantum Computing, experiments reveal QRL’s potential in enhancing reinforcement learning tasks within these environments, showcasing notable space optimization for RL models. Quantitative results indicate a reduction in the number of trainable parameters by up to 90% when compared to classical approaches, significantly improving efficiency, mainly due to quantum principles of superposition and entanglement. This highlights the promising implications of integrating quantum computing techniques to address challenges and advance capabilities in fundamental reinforcement learning scenarios. Furthermore, the study discusses the adaptability of QRL algorithms to diverse problem domains, suggesting their potential for scalability and applicability beyond simple environments. Such versatility underscores the robustness and practical relevance of QRL methodologies in real-world scenarios, positioning them as valuable tools for tackling complex reinforcement learning challenges.
The new Quantum Machine Learning (QML) paradigm for highly efficient query execution in high-dimensional SQL data systems and Conventional database query execution is plagued by performance bottlenecks because of the explosive nature of structured data and intricate query optimization issues. The new QML-based methodology uses quantum algorithms to accelerate query processing by exploiting parallel computation, quantum-aided indexing, and probabilistic data access. With the incorporation of quantum-enhanced optimization methods, the framework achieves remarkable query execution time reduction, enhanced system scalability, and increased efficiency in managing relational databases at scale. The work compares the framework's performance against traditional SQL query optimizers and shows better performance in terms of execution speed, accuracy in retrieving data, and utilization of computational resources. The results also point to the promise of QML in revolutionizing DBMS and bringing in next-generation data analytics solutions.
Huge-scale identity management systems, for instance, India's Central Identities Data Repository (CIDR), pose unprecedented demands on carrying out sophisticated join operations for mission-sensitive applications, for instance, Know Your Customer (KYC) verification, Permanent Account Number (PAN) linkage, and recipient verification processes. State-of-the-art optimization schemes largely use cost-based and rule-based techniques that exhibit drastic performance degradation at high-concurrent workloads and dynamically changing query patterns. The current work outlines a novel artificial intelligence paradigm that exploits Quantum Reinforcement Learning (QRL) principles for optimized join order selection and optimization. The approach capitalizes on the native properties of quantum computing, i.e., parallelism and superposition, for automatically discovering near-optimal join execution sequences. Our experimental work on a massive number of benchmark datasets establishes superior scalability properties and 25%-35% savings in execution efficiency over traditional optimization schemes. The paradigm positions QRL as a revolutionary solution for distributed database systems, particularly those for hosting country-scale identity management systems, for instance, Aadhaar-linked infrastructures.
Quantum reinforcement learning (QRL) can outperform classical reinforcement learning (RL) by utilizing quantum parallel theory and quantum phenomena such as superposition and entanglement. Although some excellent work has been done on QRL, most existing works either fail to show the exponential advantage of quantum computation over classical computation in terms of performance or are too demanding on quantum devices. In this paper, we provide a novel perspective on combining quantum computing and RL with faster convergence speed and relatively relaxed demands on quantum devices. Specifically, we propose a method to construct a world model with quantum circuit that allows it to interact in a quantum way. In addition, we use Grover's algorithm to efficiently extract high-value information from the quantum world model. Extensive simulation results show that the proposed method can have superior performance compared to classical RL algorithms.
Quantum reinforcement learning (QRL) is a burgeoning area that lies at the convergence of quantum computing and machine learning. Based on the characteristics of quantum superposition and quantum entanglement, quantum reinforcement learning can achieve some quantum advantages on existing noisy intermediate-scale quantum devices compared to traditional reinforcement learning. Within the field of information systems, reinforcement learning techniques have been extensively explored for applications including intelligent decision support mechanisms, resource distribution strategies, and system enhancement under conditions of uncertainty. This paper analyzes the fundamental principles of quantum reinforcement learning and introduces research work and progress in related areas. This study examines the foundational concepts underlying quantum reinforcement learning and provides an overview of notable algorithmic strategies documented in contemporary research.