Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2510.18852

Lyapunov-Aware Quantum-Inspired Reinforcement Learning for Continuous-Time Vehicle Control: A Feasibility Study

Nutkritta Kraipatthanapong, Natthaphat Thathong, Pannita Suksawas, Thanunnut Klunklin, Kritin Vongthonglua, Krit Attahakul, Aueaphum Aueawatthanaphisut

Published Oct 21, 2025• 1 citation
arXivHTMLPDF

Abstract

This paper presents a novel Lyapunov-Based Quantum Reinforcement Learning (LQRL) framework that integrates quantum policy optimization with Lyapunov stability analysis for continuous-time vehicle control. The proposed approach combines the representational power of variational quantum circuits (VQCs) with a stability-aware policy gradient mechanism to ensure asymptotic convergence and safe decision-making under dynamic environments. The vehicle longitudinal control problem was formulated as a continuous-state reinforcement learning task, where the quantum policy network generates control actions subject to Lyapunov stability constraints. Simulation experiments were conducted in a closed-loop adaptive cruise control scenario using a quantum-inspired policy trained under stability feedback. The results demonstrate that the LQRL framework successfully embeds Lyapunov stability verification into quantum policy learning, enabling interpretable and stability-aware control performance. Although transient overshoot and Lyapunov divergence were observed under aggressive acceleration, the system maintained bounded state evolution, validating the feasibility of integrating safety guarantees within quantum reinforcement learning architectures. The proposed framework provides a foundational step toward provably safe quantum control in autonomous systems and hybrid quantum-classical optimization domains.

DOI
10.48550/arxiv.2510.18852

Related papers

Compute-Constrained Variational Quantum Reinforcement Learning for Energy-Aware Autonomous Uav Navigation in Dynamic Environments

Muhammad Rashid Majeed, Peiyun Zhang, P.G. Balis +3 more

Applying quantum-improved reinforcement learning to autonomous UAV systems is inherently faced with the challenge of limited energy and computing resources onboard, especially in dynamic and wind-turbulent scenarios. To overcome this problem, we present a compute-adaptive quantum-classical control approach that executes quantum policies within tight runtime budgets while maintaining navigation performance and safety. The approach presents a two-policy paradigm that combines a high-capacity variational quantum policy with a lightweight classical proxy policy, both managed by a learned budget controller that modulates quantum policy usage in real time via a skip probability. The approach is trained using the PPO algorithm on a stochastic 3D UAV navigation task and shows that the proposed scheduler effectively tracks a target quantum budget, increasing the training-time skip probability from about 0.35 to close to 1.0 while maintaining compute-adaptive fluctuations in quantum usage between .0.1 and 1.0, depending on the episode complexity. Notably, learning is stable even under high environmental stochasticity, with episodic rewards ranging from about -700 to -100, and the moving average of the last 50 episodes converges and remains within -300 to -340 over more than 6,000 training episodes, demonstrating stable convergence with compute-aware switching. In addition, the trajectory rollouts validate the effectiveness of obstacle-aware navigation towards the goal in 3D space, with smooth energy consumption curves that gradually decrease from normalised energy 1.0 to around 0.73 before termination, without mid-trajectory energy spikes. Failure mode analysis aggregated across months also shows that the most common failure cause is boundary violation, at around 77%, followed by energy depletion at 18%, and collisions at 5%, which are realistic safety and energy trade-offs rather than instability. Finally, experiments in generalisation across months show strong peak robustness, with best-case success rates at around 0.95, 0.97, and 0.90 under different wind regimes, although final policy performance shows sensitivity. In conclusion, the above experiments demonstrate that quantum reinforcement learning can be stabilised and deployed within computational constraints, with clear scope for improving boundary violations and generalisation under extreme environmental uncertainty.

International Conference on Electronics Technology (ICET)•May 1, 2026•0 citations

Application of Quantum Reinforcement Learning in Autonomous Unmanned Aerial Vehicle Navigation

Veljko Perić, Milan Živković

An intelligent adaptation technique is necessary due to the complexity and unpredictability of the air space, and autonomous unmanned aerial vehicle (UAV) navigation uses quantum reinforcement learning (QRL) as an advanced control mechanism. This work suggests quantum-inspired encoding and optimization algorithms for policy learning in order to overcome the shortcomings in efficiency and scalability of conventional and deep reinforcement learning approaches. The technique employs quantum-parametric policy optimization on a hybrid quantum-classical architecture after forming UAV navigation as a Markov Decision Process and adding quantum amplitude encoding. Dynamic obstacle and random wind disturbance experiments will be carried out in a high-fidelity 3D simulation environment. QRL has decreased energy usage by up to 17% and increased the top classical RL baseline's convergence speed by 40%. Even in inclement weather, the success rate remains around 95%, and the minimum obstacle clearance never falls below 1.8 meters. Analysis shows that QRL yields safer, more robust and sample-efficient policies that are better at generalizing to unseen maps and disturbance-heavy environments. Based on the above results, the technical feasibility and engineering value of quantum-enhanced learning algorithms for robust UAV autonomous navigation have been demonstrated; thus, they can serve as a model for future intelligent aerial decision systems.

Journal of Applied Automation Technologies•Dec 13, 2025•0 citations

Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems

Jagjit Singh Dhatterwal, Sandeep Kumar, Shilpa Choudhary

The integration of Quantum-Inspired Reinforcement Learning (QiRL) into Edge-Driven CyberPhysical Systems (CPS) presents a transformative approach to enhance real-time decision-making in distributed environments. While classical reinforcement learning (RL) struggles with scalability and computational complexity in edge-CPS, quantum-inspired Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems algorithms leverage superposition and entanglement principles to optimize policy exploration and convergence. This paper proposes a novel QiRL framework that combines quantum-inspired optimization with deep RL, enabling efficient resource allocation and adaptive control in latency-sensitive applications (e.g., smart grids, autonomous drones). We formalize the mathematical foundations of QiRL, design a hybrid neural-quantum architecture for edge deployment, and evaluate its performance under dynamic CPS constraints. Simulations on IoT-based case studies demonstrate $\mathbf{2 0}-\mathbf{3 5 \%}$ faster convergence and $\mathbf{1 5 \%}$ higher energy efficiency compared to classical Deep Q-Networks (DQN). Key challenges, such as quantum noise simulation and edge-hardware limitations, are discussed to guide future research. This work bridges quantum computing principles with edge intelligence, offering a scalable pathway for nextgeneration CPS.

International Conference on Mobile Networks and Wireless Communications (ICMNWC)•Dec 10, 2025•0 citations

Continuous Quantum Reinforcement Learning for Robot Navigation

Theodora-Augustina Drăgan, Alexander Künzner, Robert Wille +1 more

One of the multiple facets of quantum reinforcement learning (QRL) is enhancing reinforcement learning (RL) algorithms with quantum submodules, namely with variational quantum circuits (VQC) as function approx-imators. QRL solutions are empirically proven to require fewer training iterations or adjustable parameters than their classical counterparts, but are usually restricted to applications that have a discrete action space and thus limited industrial relevance. We propose a hybrid quantum-classical (HQC) deep deterministic policy gradient (DDPG) approach for a robot to navigate through a maze using continuous states, continuous actions and using local observations from the robot’s LiDAR sensors. We show that this HQC method can lead to models of comparable test results to the neural network (NN)-based DDPG algorithm, that need around 200 times fewer weights. We also study the scalability of our solution with respect to the number of VQC layers and qubits, and find that in general results improve as the layer and qubit counts increase. The best rewards among all similarly sized HQC and classical DDPG methods correspond to a VQC of 8 qubits and 5 layers with no other NN. This work is another step towards continuous QRL, where literature has been sparse.

International Conference on Agents and Artificial Intelligence (ICAART)•Jan 1, 2025•1 citation

Quantum-Inspired Optimization for Reinforcement Learning Policy Gradient Methods

Jincheng Zhang

Reinforcement learning (RL) policy gradient methods, while effective, frequently encounter challenges related to instability and the sensitivity of their performance to the learning rate hyperparameter. This work introduces a novel approach leveraging quantum-inspired optimization techniques to address these issues. Specifically, we propose a quantum-inspired learning rate scheduler designed to dynamically adapt the update step size during policy gradient training. This scheduler, rooted in principles of quantum measurement and superposition, aims to provide a more robust and efficient learning process. The core claim of this paper is that the integration of this quantum-inspired learning rate scheduler significantly improves the stability and convergence speed of policy gradient methods. We present a theoretical framework and explore the potential of this approach, demonstrating its promise for enhancing RL performance. The proposed method offers a new direction in RL optimization, potentially bridging the gap between classical and quantum-inspired approaches.

•Sep 7, 2026•0 citations

HQN-RL: Hybrid Quantum-Neuromorphic Reinforcement Learning for Adaptive Intelligent Control of Automated Vehicles

Mazyar Taghavi, Javad Vahidi

This paper presents a hybrid quantum neuromorphic reinforcement learning framework for adaptive intelligent control of automated vehicles operating in uncertain and heterogeneous environments. The proposed architecture integrates quantum sampling for exploration with neuromorphic computing for real-time, energy-efficient policy execution, enabling rapid convergence and robust behavior under nonstationary driving conditions. A unified theoretical analysis is provided, covering hybrid optimization convergence, controller stability, and computational complexity. The framework is evaluated through largescale simulations, quantum hardware experiments, neuromorphic processor deployment, and a sim-to-real study involving five autonomous vehicles tested in a controlled environment at the Intelligent Knowledge City research facility in Isfahan, Iran. Results demonstrate improved sample efficiency, reduced energy consumption, and enhanced robustness compared with classical reinforcement learning baselines. Furthermore, the hybrid design maintains real-time feasibility and scalability, showing promise for next-generation autonomous driving systems requiring adaptive decision-making under limited computational resources. All source code and implementation details for reproduction and further research are publicly available in the project repository.

•Dec 19, 2025•0 citations
This paper presents a novel Lyapunov-Based Quantum Reinforcement Learning (LQRL) framework that integrates quantum policy optimization with Lyapunov stability analysis for continuous-time vehicle control. The proposed approach combines the representational power of variational quantum circuits (VQCs) with a stability-aware policy gradient mechanism to ensure asymptotic convergence and safe decision-making under dynamic environments. The vehicle longitudinal control problem was formulated as a continuous-state reinforcement learning task, where the quantum policy network generates control actions subject to Lyapunov stability constraints. Simulation experiments were conducted in a closed-loop adaptive cruise control scenario using a quantum-inspired policy trained under stability feedback. The results demonstrate that the LQRL framework successfully embeds Lyapunov stability verification into quantum policy learning, enabling interpretable and stability-aware control performance. Although transient overshoot and Lyapunov divergence were observed under aggressive acceleration, the system maintained bounded state evolution, validating the feasibility of integrating safety guarantees within quantum reinforcement learning architectures. The proposed framework provides a foundational step toward provably safe quantum control in autonomous systems and hybrid quantum-classical optimization domains.
Applying quantum-improved reinforcement learning to autonomous UAV systems is inherently faced with the challenge of limited energy and computing resources onboard, especially in dynamic and wind-turbulent scenarios. To overcome this problem, we present a compute-adaptive quantum-classical control approach that executes quantum policies within tight runtime budgets while maintaining navigation performance and safety. The approach presents a two-policy paradigm that combines a high-capacity variational quantum policy with a lightweight classical proxy policy, both managed by a learned budget controller that modulates quantum policy usage in real time via a skip probability. The approach is trained using the PPO algorithm on a stochastic 3D UAV navigation task and shows that the proposed scheduler effectively tracks a target quantum budget, increasing the training-time skip probability from about 0.35 to close to 1.0 while maintaining compute-adaptive fluctuations in quantum usage between .0.1 and 1.0, depending on the episode complexity. Notably, learning is stable even under high environmental stochasticity, with episodic rewards ranging from about -700 to -100, and the moving average of the last 50 episodes converges and remains within -300 to -340 over more than 6,000 training episodes, demonstrating stable convergence with compute-aware switching. In addition, the trajectory rollouts validate the effectiveness of obstacle-aware navigation towards the goal in 3D space, with smooth energy consumption curves that gradually decrease from normalised energy 1.0 to around 0.73 before termination, without mid-trajectory energy spikes. Failure mode analysis aggregated across months also shows that the most common failure cause is boundary violation, at around 77%, followed by energy depletion at 18%, and collisions at 5%, which are realistic safety and energy trade-offs rather than instability. Finally, experiments in generalisation across months show strong peak robustness, with best-case success rates at around 0.95, 0.97, and 0.90 under different wind regimes, although final policy performance shows sensitivity. In conclusion, the above experiments demonstrate that quantum reinforcement learning can be stabilised and deployed within computational constraints, with clear scope for improving boundary violations and generalisation under extreme environmental uncertainty.
An intelligent adaptation technique is necessary due to the complexity and unpredictability of the air space, and autonomous unmanned aerial vehicle (UAV) navigation uses quantum reinforcement learning (QRL) as an advanced control mechanism. This work suggests quantum-inspired encoding and optimization algorithms for policy learning in order to overcome the shortcomings in efficiency and scalability of conventional and deep reinforcement learning approaches. The technique employs quantum-parametric policy optimization on a hybrid quantum-classical architecture after forming UAV navigation as a Markov Decision Process and adding quantum amplitude encoding. Dynamic obstacle and random wind disturbance experiments will be carried out in a high-fidelity 3D simulation environment. QRL has decreased energy usage by up to 17% and increased the top classical RL baseline's convergence speed by 40%. Even in inclement weather, the success rate remains around 95%, and the minimum obstacle clearance never falls below 1.8 meters. Analysis shows that QRL yields safer, more robust and sample-efficient policies that are better at generalizing to unseen maps and disturbance-heavy environments. Based on the above results, the technical feasibility and engineering value of quantum-enhanced learning algorithms for robust UAV autonomous navigation have been demonstrated; thus, they can serve as a model for future intelligent aerial decision systems.
The integration of Quantum-Inspired Reinforcement Learning (QiRL) into Edge-Driven CyberPhysical Systems (CPS) presents a transformative approach to enhance real-time decision-making in distributed environments. While classical reinforcement learning (RL) struggles with scalability and computational complexity in edge-CPS, quantum-inspired Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems algorithms leverage superposition and entanglement principles to optimize policy exploration and convergence. This paper proposes a novel QiRL framework that combines quantum-inspired optimization with deep RL, enabling efficient resource allocation and adaptive control in latency-sensitive applications (e.g., smart grids, autonomous drones). We formalize the mathematical foundations of QiRL, design a hybrid neural-quantum architecture for edge deployment, and evaluate its performance under dynamic CPS constraints. Simulations on IoT-based case studies demonstrate 20−35%\mathbf{2 0}-\mathbf{3 5 \%}20−35% faster convergence and 15%\mathbf{1 5 \%}15% higher energy efficiency compared to classical Deep Q-Networks (DQN). Key challenges, such as quantum noise simulation and edge-hardware limitations, are discussed to guide future research. This work bridges quantum computing principles with edge intelligence, offering a scalable pathway for nextgeneration CPS.
One of the multiple facets of quantum reinforcement learning (QRL) is enhancing reinforcement learning (RL) algorithms with quantum submodules, namely with variational quantum circuits (VQC) as function approx-imators. QRL solutions are empirically proven to require fewer training iterations or adjustable parameters than their classical counterparts, but are usually restricted to applications that have a discrete action space and thus limited industrial relevance. We propose a hybrid quantum-classical (HQC) deep deterministic policy gradient (DDPG) approach for a robot to navigate through a maze using continuous states, continuous actions and using local observations from the robot’s LiDAR sensors. We show that this HQC method can lead to models of comparable test results to the neural network (NN)-based DDPG algorithm, that need around 200 times fewer weights. We also study the scalability of our solution with respect to the number of VQC layers and qubits, and find that in general results improve as the layer and qubit counts increase. The best rewards among all similarly sized HQC and classical DDPG methods correspond to a VQC of 8 qubits and 5 layers with no other NN. This work is another step towards continuous QRL, where literature has been sparse.
Reinforcement learning (RL) policy gradient methods, while effective, frequently encounter challenges related to instability and the sensitivity of their performance to the learning rate hyperparameter. This work introduces a novel approach leveraging quantum-inspired optimization techniques to address these issues. Specifically, we propose a quantum-inspired learning rate scheduler designed to dynamically adapt the update step size during policy gradient training. This scheduler, rooted in principles of quantum measurement and superposition, aims to provide a more robust and efficient learning process. The core claim of this paper is that the integration of this quantum-inspired learning rate scheduler significantly improves the stability and convergence speed of policy gradient methods. We present a theoretical framework and explore the potential of this approach, demonstrating its promise for enhancing RL performance. The proposed method offers a new direction in RL optimization, potentially bridging the gap between classical and quantum-inspired approaches.
This paper presents a hybrid quantum neuromorphic reinforcement learning framework for adaptive intelligent control of automated vehicles operating in uncertain and heterogeneous environments. The proposed architecture integrates quantum sampling for exploration with neuromorphic computing for real-time, energy-efficient policy execution, enabling rapid convergence and robust behavior under nonstationary driving conditions. A unified theoretical analysis is provided, covering hybrid optimization convergence, controller stability, and computational complexity. The framework is evaluated through largescale simulations, quantum hardware experiments, neuromorphic processor deployment, and a sim-to-real study involving five autonomous vehicles tested in a controlled environment at the Intelligent Knowledge City research facility in Isfahan, Iran. Results demonstrate improved sample efficiency, reduced energy consumption, and enhanced robustness compared with classical reinforcement learning baselines. Furthermore, the hybrid design maintains real-time feasibility and scalability, showing promise for next-generation autonomous driving systems requiring adaptive decision-making under limited computational resources. All source code and implementation details for reproduction and further research are publicly available in the project repository.