Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2504.13041

QI-MPC: A Hybrid Quantum-Inspired Model Predictive Control for Learning Optimal Policies

Muhammad Al-Zafar Khan, Jamal Nazzal Al-Karaki

Published Apr 17, 2025• 1 citation
arXivHTMLPDF

Abstract

In this paper, we present Quantum-Inspired Model Predictive Control (QIMPC), an approach that uses Variational Quantum Circuits (VQCs) to learn control polices in MPC problems. The viability of the approach is tested in five experiments: A target-tracking control strategy, energy-efficient building climate control, autonomous vehicular dynamics, the simple pendulum, and the compound pendulum. Three safety guarantees were established for the approach, and the experiments gave the motivation for two important theoretical results that, in essence, identify systems for which the approach works best.

DOI
10.48550/arxiv.2504.13041

Related papers

A Model Predictive Control-Inspired Quantum Algorithm

Dominic Messina, Alicia B. Magann, Mohan Sarovar +1 more

We introduce a new hybrid quantum-classical algorithm inspired by an advanced control strategy known as model predictive control (MPC). This algorithm unifies the optimization-based design of variational quantum algorithms (VQAs) with the feedback-based design of feedback-based quantum algorithms (FQAs). Variational circuit parameters are optimized using a layer-wise receding horizon strategy, where observable measurements after every layer initialize a classically simulated dynamic model used to predict quantum state evolution and optimize over future parameterized gates. This hybrid algorithm can be used for applications such as ground state preparation and approximate combinatorial optimization, and presents an ideal use case for the integration of quantum computers with high-performance computing, where the latter resource can be used to increase the scale and efficiency of the predictions critical to MPC. We show through mathematical proof and numerical evidence that the MPC-based algorithm can be guaranteed to at least match the performance of FQAs. Through simulations on Max-Cut problems and a two-dimensional transverse-field Ising model, we demonstrate that relaxed implementations of the MPC-based algorithm can also provide improved performance in practice compared to an FQA.

quant-pharXiv:2607.24992•Jul 29, 2026•0 citations

Lyapunov-Aware Quantum-Inspired Reinforcement Learning for Continuous-Time Vehicle Control: A Feasibility Study

Nutkritta Kraipatthanapong, Natthaphat Thathong, Pannita Suksawas +4 more

This paper presents a novel Lyapunov-Based Quantum Reinforcement Learning (LQRL) framework that integrates quantum policy optimization with Lyapunov stability analysis for continuous-time vehicle control. The proposed approach combines the representational power of variational quantum circuits (VQCs) with a stability-aware policy gradient mechanism to ensure asymptotic convergence and safe decision-making under dynamic environments. The vehicle longitudinal control problem was formulated as a continuous-state reinforcement learning task, where the quantum policy network generates control actions subject to Lyapunov stability constraints. Simulation experiments were conducted in a closed-loop adaptive cruise control scenario using a quantum-inspired policy trained under stability feedback. The results demonstrate that the LQRL framework successfully embeds Lyapunov stability verification into quantum policy learning, enabling interpretable and stability-aware control performance. Although transient overshoot and Lyapunov divergence were observed under aggressive acceleration, the system maintained bounded state evolution, validating the feasibility of integrating safety guarantees within quantum reinforcement learning architectures. The proposed framework provides a foundational step toward provably safe quantum control in autonomous systems and hybrid quantum-classical optimization domains.

arXiv:2510.18852•Oct 21, 2025•1 citation

Model predictive quantum control: a modular approach for efficient and robust quantum optimal control

Eya Guizani, Julian Berberich

Abstract Model predictive control (MPC) is one of the most successful modern control methods. It relies on repeatedly solving a finite-horizon optimal control problem and applying the beginning piece of the optimal input. In this paper, we develop a modular framework for improving efficiency and robustness of quantum optimal control (QOC) via MPC. We first provide a tutorial introduction to basic concepts of MPC from a QOC perspective. We then present multiple MPC schemes, ranging from simple approaches to more sophisticated schemes which admit stability guarantees. This yields a modular framework which can be used 1) to improve efficiency of open-loop QOC and 2) to improve robustness of closed-loop quantum control by incorporating feedback. We demonstrate these benefits with numerical results, where we benchmark the proposed methods against competing approaches.

arXiv:2509.05167•New Journal of Physics•Oct 1, 2026•2 citations

Quantum-Inspired Reinforcement Learning for Quantum Control

Haixu Yu, Xudong Zhao, Chunlin Chen

Reinforcement learning (RL) is considered a powerful technology with the potential to revolutionize quantum control. However, the application effectiveness of traditional RL is often limited by some insurmountable experimental conditions. Thus, developing new RL algorithms that can efficiently manipulate the quantum system dynamics is a crucial task. Prior research has shown that incorporating quantum mechanical properties into RL can improve learning performance. In this article, we consider the quantum control problem where only the target state can be accurately identified and introduce a quantum-inspired RL (QiRL) method. In particular, we propose a quantum-inspired exploration strategy to replace a commonly used$\epsilon $-greedy strategy, as well as a quantum-inspired reward scheme to incentivize the learning agent. Numerical results on three quantum system control problems, i.e., one-qubit closed quantum system, two-level open quantum system, and many-qubit closed quantum system, verify the effectiveness of QiRL. Comparison results show that the proposed QiRL outperforms existing RL algorithms (deep Q-network and proximal policy optimization) in terms of stability and efficiency for solving quantum control problems.

IEEE Transactions on Control Systems Technology•Aug 14, 2024•15 citations

Real-Time Quantum-Inspired Nonlinear Model Predictive Control via Quantum Singular Value Transformation for Autonomous Systems

Khotsofalang Nqhoaki, Terry Wilding

The deployment of Nonlinear Model Predictive Control (NMPC) in safety-critical autonomous systems is fundamentally constrained by the computational intractability of solving non-convex optimization problems within strict real-time deadlines. While quantum computing offers theoretical speedups, the lack of fault-tolerant hardware necessitates the development of quantum-inspired classical algorithms. This paper presents a novel NMPC framework based on the Quantum Singular Value Transformation (QSVT), which leverages Chebyshev polynomial approximation and matrix sketching to accelerate the solution of receding-horizon control problems. A comprehensive theoretical complexity analysis demonstrates reduction from the cubic complexity of classical Sequential Quadratic Programming (SQP) to near-linear complexity dependent on sketch dimensions. The proposed QSVT-NMPC is rigorously benchmarked against classical NMPC, Sliding Mode Control (SMC), and a suite of quantum-inspired variants including Simulated Quantum Annealing, Variational Quantum Circuits, and Random Fourier Features on the canonical inverted pendulum system. Experimental results validate that the optimized QSVT-NMPC achieves a median settling time of 3.0 seconds, outperforming other quantum-inspired methods and offering a superior tradeoff between control stability and computational latency compared to classical approaches. Statistical analysis using ANOVA$(F(7,232)=42.3, p<0.001)$confirms significant performance advantages. The algorithm demonstrates 65% improvement over its unoptimized form, maintains sub-8ms computation latency, shows robust performance under ±20% mass perturbation (6.7% degradation), and reduces memory footprint by 75%, establishing it as the first viable candidate for embedded implementation of advanced predictive control in next-generation autonomous systems.

•Oct 1, 2026•0 citations

Advanced Quantum Control With Ensemble Reinforcement Learning: A Case Study on the XY Spin Chain

Farshad Rahimi Ghashghaei, Nebrase Elmrabit, Ayyaz-Ul-Haq Qureshi +2 more

This research presents an ensemble Reinforcement Learning (RL) approach that combines Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) algorithms to tackle quantum control problems. This research aims to use the complementary strengths of DQN and PPO algorithms to develop robust and adaptive control policies for noisy and uncertain quantum systems. We comprehensively analyse the proposed ensemble learning, including algorithmic details, implementation specifics, and experimental results. Through extensive experimentation and evaluation, we demonstrate the effectiveness of the ensemble approach in learning control strategies for manipulating quantum systems towards a random target state. The results highlight the potential of ensemble RL techniques in addressing the challenges of quantum control tasks, such as system noise and dynamics. By integrating multiple RL agents within an ensemble framework, We aim to advance current developments in quantum control and create a new path for the development of adaptive control systems for quantum systems. The performance of the ensemble model is assessed against Gradient Ascent Pulse Engineering (GRAPE) and robust Model Predictive Control (MPC) to demonstrate its efficiency in highly challenging and noisy environments.

IEEE Access•Jan 1, 2025•3 citations
In this paper, we present Quantum-Inspired Model Predictive Control (QIMPC), an approach that uses Variational Quantum Circuits (VQCs) to learn control polices in MPC problems. The viability of the approach is tested in five experiments: A target-tracking control strategy, energy-efficient building climate control, autonomous vehicular dynamics, the simple pendulum, and the compound pendulum. Three safety guarantees were established for the approach, and the experiments gave the motivation for two important theoretical results that, in essence, identify systems for which the approach works best.
We introduce a new hybrid quantum-classical algorithm inspired by an advanced control strategy known as model predictive control (MPC). This algorithm unifies the optimization-based design of variational quantum algorithms (VQAs) with the feedback-based design of feedback-based quantum algorithms (FQAs). Variational circuit parameters are optimized using a layer-wise receding horizon strategy, where observable measurements after every layer initialize a classically simulated dynamic model used to predict quantum state evolution and optimize over future parameterized gates. This hybrid algorithm can be used for applications such as ground state preparation and approximate combinatorial optimization, and presents an ideal use case for the integration of quantum computers with high-performance computing, where the latter resource can be used to increase the scale and efficiency of the predictions critical to MPC. We show through mathematical proof and numerical evidence that the MPC-based algorithm can be guaranteed to at least match the performance of FQAs. Through simulations on Max-Cut problems and a two-dimensional transverse-field Ising model, we demonstrate that relaxed implementations of the MPC-based algorithm can also provide improved performance in practice compared to an FQA.
This paper presents a novel Lyapunov-Based Quantum Reinforcement Learning (LQRL) framework that integrates quantum policy optimization with Lyapunov stability analysis for continuous-time vehicle control. The proposed approach combines the representational power of variational quantum circuits (VQCs) with a stability-aware policy gradient mechanism to ensure asymptotic convergence and safe decision-making under dynamic environments. The vehicle longitudinal control problem was formulated as a continuous-state reinforcement learning task, where the quantum policy network generates control actions subject to Lyapunov stability constraints. Simulation experiments were conducted in a closed-loop adaptive cruise control scenario using a quantum-inspired policy trained under stability feedback. The results demonstrate that the LQRL framework successfully embeds Lyapunov stability verification into quantum policy learning, enabling interpretable and stability-aware control performance. Although transient overshoot and Lyapunov divergence were observed under aggressive acceleration, the system maintained bounded state evolution, validating the feasibility of integrating safety guarantees within quantum reinforcement learning architectures. The proposed framework provides a foundational step toward provably safe quantum control in autonomous systems and hybrid quantum-classical optimization domains.
Abstract Model predictive control (MPC) is one of the most successful modern control methods. It relies on repeatedly solving a finite-horizon optimal control problem and applying the beginning piece of the optimal input. In this paper, we develop a modular framework for improving efficiency and robustness of quantum optimal control (QOC) via MPC. We first provide a tutorial introduction to basic concepts of MPC from a QOC perspective. We then present multiple MPC schemes, ranging from simple approaches to more sophisticated schemes which admit stability guarantees. This yields a modular framework which can be used 1) to improve efficiency of open-loop QOC and 2) to improve robustness of closed-loop quantum control by incorporating feedback. We demonstrate these benefits with numerical results, where we benchmark the proposed methods against competing approaches.
Reinforcement learning (RL) is considered a powerful technology with the potential to revolutionize quantum control. However, the application effectiveness of traditional RL is often limited by some insurmountable experimental conditions. Thus, developing new RL algorithms that can efficiently manipulate the quantum system dynamics is a crucial task. Prior research has shown that incorporating quantum mechanical properties into RL can improve learning performance. In this article, we consider the quantum control problem where only the target state can be accurately identified and introduce a quantum-inspired RL (QiRL) method. In particular, we propose a quantum-inspired exploration strategy to replace a commonly used$\epsilon $-greedy strategy, as well as a quantum-inspired reward scheme to incentivize the learning agent. Numerical results on three quantum system control problems, i.e., one-qubit closed quantum system, two-level open quantum system, and many-qubit closed quantum system, verify the effectiveness of QiRL. Comparison results show that the proposed QiRL outperforms existing RL algorithms (deep Q-network and proximal policy optimization) in terms of stability and efficiency for solving quantum control problems.
The deployment of Nonlinear Model Predictive Control (NMPC) in safety-critical autonomous systems is fundamentally constrained by the computational intractability of solving non-convex optimization problems within strict real-time deadlines. While quantum computing offers theoretical speedups, the lack of fault-tolerant hardware necessitates the development of quantum-inspired classical algorithms. This paper presents a novel NMPC framework based on the Quantum Singular Value Transformation (QSVT), which leverages Chebyshev polynomial approximation and matrix sketching to accelerate the solution of receding-horizon control problems. A comprehensive theoretical complexity analysis demonstrates reduction from the cubic complexity of classical Sequential Quadratic Programming (SQP) to near-linear complexity dependent on sketch dimensions. The proposed QSVT-NMPC is rigorously benchmarked against classical NMPC, Sliding Mode Control (SMC), and a suite of quantum-inspired variants including Simulated Quantum Annealing, Variational Quantum Circuits, and Random Fourier Features on the canonical inverted pendulum system. Experimental results validate that the optimized QSVT-NMPC achieves a median settling time of 3.0 seconds, outperforming other quantum-inspired methods and offering a superior tradeoff between control stability and computational latency compared to classical approaches. Statistical analysis using ANOVA(F(7,232)=42.3,p<0.001)(F(7,232)=42.3, p<0.001)(F(7,232)=42.3,p<0.001)confirms significant performance advantages. The algorithm demonstrates 65% improvement over its unoptimized form, maintains sub-8ms computation latency, shows robust performance under ±20% mass perturbation (6.7% degradation), and reduces memory footprint by 75%, establishing it as the first viable candidate for embedded implementation of advanced predictive control in next-generation autonomous systems.
This research presents an ensemble Reinforcement Learning (RL) approach that combines Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) algorithms to tackle quantum control problems. This research aims to use the complementary strengths of DQN and PPO algorithms to develop robust and adaptive control policies for noisy and uncertain quantum systems. We comprehensively analyse the proposed ensemble learning, including algorithmic details, implementation specifics, and experimental results. Through extensive experimentation and evaluation, we demonstrate the effectiveness of the ensemble approach in learning control strategies for manipulating quantum systems towards a random target state. The results highlight the potential of ensemble RL techniques in addressing the challenges of quantum control tasks, such as system noise and dynamics. By integrating multiple RL agents within an ensemble framework, We aim to advance current developments in quantum control and create a new path for the development of adaptive control systems for quantum systems. The performance of the ensemble model is assessed against Gradient Ascent Pulse Engineering (GRAPE) and robust Model Predictive Control (MPC) to demonstrate its efficiency in highly challenging and noisy environments.