Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

International Conference on Electronics Technology (ICET)

Compute-Constrained Variational Quantum Reinforcement Learning for Energy-Aware Autonomous Uav Navigation in Dynamic Environments

Muhammad Rashid Majeed, Peiyun Zhang, P.G. Balis, Mst Jannatul Kobra, Owahedur Rahman, Zamadder Md Iqbal Hossain

Published May 1, 2026• 0 citations
Publisher

Abstract

Applying quantum-improved reinforcement learning to autonomous UAV systems is inherently faced with the challenge of limited energy and computing resources onboard, especially in dynamic and wind-turbulent scenarios. To overcome this problem, we present a compute-adaptive quantum-classical control approach that executes quantum policies within tight runtime budgets while maintaining navigation performance and safety. The approach presents a two-policy paradigm that combines a high-capacity variational quantum policy with a lightweight classical proxy policy, both managed by a learned budget controller that modulates quantum policy usage in real time via a skip probability. The approach is trained using the PPO algorithm on a stochastic 3D UAV navigation task and shows that the proposed scheduler effectively tracks a target quantum budget, increasing the training-time skip probability from about 0.35 to close to 1.0 while maintaining compute-adaptive fluctuations in quantum usage between .0.1 and 1.0, depending on the episode complexity. Notably, learning is stable even under high environmental stochasticity, with episodic rewards ranging from about -700 to -100, and the moving average of the last 50 episodes converges and remains within -300 to -340 over more than 6,000 training episodes, demonstrating stable convergence with compute-aware switching. In addition, the trajectory rollouts validate the effectiveness of obstacle-aware navigation towards the goal in 3D space, with smooth energy consumption curves that gradually decrease from normalised energy 1.0 to around 0.73 before termination, without mid-trajectory energy spikes. Failure mode analysis aggregated across months also shows that the most common failure cause is boundary violation, at around 77%, followed by energy depletion at 18%, and collisions at 5%, which are realistic safety and energy trade-offs rather than instability. Finally, experiments in generalisation across months show strong peak robustness, with best-case success rates at around 0.95, 0.97, and 0.90 under different wind regimes, although final policy performance shows sensitivity. In conclusion, the above experiments demonstrate that quantum reinforcement learning can be stabilised and deployed within computational constraints, with clear scope for improving boundary violations and generalisation under extreme environmental uncertainty.

DOI
10.1109/icet69987.2026.11659283

Related papers

Application of Quantum Reinforcement Learning in Autonomous Unmanned Aerial Vehicle Navigation

Veljko Perić, Milan Živković

An intelligent adaptation technique is necessary due to the complexity and unpredictability of the air space, and autonomous unmanned aerial vehicle (UAV) navigation uses quantum reinforcement learning (QRL) as an advanced control mechanism. This work suggests quantum-inspired encoding and optimization algorithms for policy learning in order to overcome the shortcomings in efficiency and scalability of conventional and deep reinforcement learning approaches. The technique employs quantum-parametric policy optimization on a hybrid quantum-classical architecture after forming UAV navigation as a Markov Decision Process and adding quantum amplitude encoding. Dynamic obstacle and random wind disturbance experiments will be carried out in a high-fidelity 3D simulation environment. QRL has decreased energy usage by up to 17% and increased the top classical RL baseline's convergence speed by 40%. Even in inclement weather, the success rate remains around 95%, and the minimum obstacle clearance never falls below 1.8 meters. Analysis shows that QRL yields safer, more robust and sample-efficient policies that are better at generalizing to unseen maps and disturbance-heavy environments. Based on the above results, the technical feasibility and engineering value of quantum-enhanced learning algorithms for robust UAV autonomous navigation have been demonstrated; thus, they can serve as a model for future intelligent aerial decision systems.

Journal of Applied Automation Technologies•Dec 13, 2025•0 citations

Lyapunov-Aware Quantum-Inspired Reinforcement Learning for Continuous-Time Vehicle Control: A Feasibility Study

Nutkritta Kraipatthanapong, Natthaphat Thathong, Pannita Suksawas +4 more

This paper presents a novel Lyapunov-Based Quantum Reinforcement Learning (LQRL) framework that integrates quantum policy optimization with Lyapunov stability analysis for continuous-time vehicle control. The proposed approach combines the representational power of variational quantum circuits (VQCs) with a stability-aware policy gradient mechanism to ensure asymptotic convergence and safe decision-making under dynamic environments. The vehicle longitudinal control problem was formulated as a continuous-state reinforcement learning task, where the quantum policy network generates control actions subject to Lyapunov stability constraints. Simulation experiments were conducted in a closed-loop adaptive cruise control scenario using a quantum-inspired policy trained under stability feedback. The results demonstrate that the LQRL framework successfully embeds Lyapunov stability verification into quantum policy learning, enabling interpretable and stability-aware control performance. Although transient overshoot and Lyapunov divergence were observed under aggressive acceleration, the system maintained bounded state evolution, validating the feasibility of integrating safety guarantees within quantum reinforcement learning architectures. The proposed framework provides a foundational step toward provably safe quantum control in autonomous systems and hybrid quantum-classical optimization domains.

arXiv:2510.18852•Oct 21, 2025•1 citation

Quantum-Enhanced Hybrid Reinforcement Learning Framework for Dynamic Path Planning in Autonomous Systems

Tomar, Sahil, Shamshe Alam, Sandeep Kumar +1 more

In this paper, a novel quantum classical hybrid framework is proposed that synergizes quantum with Classical Reinforcement Learning. By leveraging the inherent parallelism of quantum computing, the proposed approach generates robust Q tables and specialized turn cost estimations, which are then integrated with a classical Reinforcement Learning pipeline. The Classical Quantum fusion results in rapid convergence of training, reducing the training time significantly and improved adaptability in scenarios featuring static, dynamic, and moving obstacles. Simulator based evaluations demonstrate significant enhancements in path efficiency, trajectory smoothness, and mission success rates, underscoring the potential of framework for real time, autonomous navigation in complex and unpredictable environments. Furthermore, the proposed framework was tested beyond simulations on practical scenarios, including real world map data such as the IIT Delhi campus, reinforcing its potential for real time, autonomous navigation in complex and unpredictable environments.

arXiv:2504.20660•Apr 29, 2025•4 citations

Quantum-Enhanced Reinforcement Learning for Adaptive Decision-Making in Dynamic Environments

Priyanka Singh, Sonam Dubey

Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.

•Aug 1, 2026•0 citations

Quantum Reinforcement Learning for UAV-Enhanced Next-Generation Wireless Communications

Annisa Anggun Puspitasari, Byung Moo Lee

The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.

IEEE Communications Surveys & Tutorials•Nov 14, 2025•6 citations

Adaptive V16: Cost-Aware Reinforcement Learning Control for Robust NISQ Variational Optimization

Kondamudi Sivaparvathi, Cheppali Prabhavathi

Variational quantum algorithms (VQAs) are promising for near-term noisy intermediate-scale quantum (NISQ) devices, but their performance is often limited by device noise, finite-shot uncertainty, and nonstationary behavior that destabilize optimization. This paper proposes a cost-aware closed-loop hybrid framework (Adaptive V16) that augments a standard VQA loop with an online decision policy to adapt measurement effort and mitigation actions during execution. At each iteration, the controller uses runtime signals such as objective progress and uncertainty to select an action comprising the shot budget, mitigation mode, and step-scaling factor, explicitly trading solution improvement against resource overhead under a fixed budget. Experimental evaluation on a representative molecular Hamiltonian optimization task shows that Adaptive V16 achieves a lower final energy than a static VQE baseline and reduces the absolute error from 0.1391 to 0.0657. The controller’s decision module also demonstrates strong predictive performance with 0.9700 accuracy, 0.9595 F1-score, and 0.9951 ROC–AUC, indicating reliable adaptive behavior across thresholds. These results suggest that policy-driven adaptation can improve robustness and budget efficiency for hybrid quantum–classical optimization in realistic NISQ settings.

International Conference on Knowledge Engineering and Communication Systems (ICKECS)•Apr 24, 2026•0 citations
Applying quantum-improved reinforcement learning to autonomous UAV systems is inherently faced with the challenge of limited energy and computing resources onboard, especially in dynamic and wind-turbulent scenarios. To overcome this problem, we present a compute-adaptive quantum-classical control approach that executes quantum policies within tight runtime budgets while maintaining navigation performance and safety. The approach presents a two-policy paradigm that combines a high-capacity variational quantum policy with a lightweight classical proxy policy, both managed by a learned budget controller that modulates quantum policy usage in real time via a skip probability. The approach is trained using the PPO algorithm on a stochastic 3D UAV navigation task and shows that the proposed scheduler effectively tracks a target quantum budget, increasing the training-time skip probability from about 0.35 to close to 1.0 while maintaining compute-adaptive fluctuations in quantum usage between .0.1 and 1.0, depending on the episode complexity. Notably, learning is stable even under high environmental stochasticity, with episodic rewards ranging from about -700 to -100, and the moving average of the last 50 episodes converges and remains within -300 to -340 over more than 6,000 training episodes, demonstrating stable convergence with compute-aware switching. In addition, the trajectory rollouts validate the effectiveness of obstacle-aware navigation towards the goal in 3D space, with smooth energy consumption curves that gradually decrease from normalised energy 1.0 to around 0.73 before termination, without mid-trajectory energy spikes. Failure mode analysis aggregated across months also shows that the most common failure cause is boundary violation, at around 77%, followed by energy depletion at 18%, and collisions at 5%, which are realistic safety and energy trade-offs rather than instability. Finally, experiments in generalisation across months show strong peak robustness, with best-case success rates at around 0.95, 0.97, and 0.90 under different wind regimes, although final policy performance shows sensitivity. In conclusion, the above experiments demonstrate that quantum reinforcement learning can be stabilised and deployed within computational constraints, with clear scope for improving boundary violations and generalisation under extreme environmental uncertainty.
An intelligent adaptation technique is necessary due to the complexity and unpredictability of the air space, and autonomous unmanned aerial vehicle (UAV) navigation uses quantum reinforcement learning (QRL) as an advanced control mechanism. This work suggests quantum-inspired encoding and optimization algorithms for policy learning in order to overcome the shortcomings in efficiency and scalability of conventional and deep reinforcement learning approaches. The technique employs quantum-parametric policy optimization on a hybrid quantum-classical architecture after forming UAV navigation as a Markov Decision Process and adding quantum amplitude encoding. Dynamic obstacle and random wind disturbance experiments will be carried out in a high-fidelity 3D simulation environment. QRL has decreased energy usage by up to 17% and increased the top classical RL baseline's convergence speed by 40%. Even in inclement weather, the success rate remains around 95%, and the minimum obstacle clearance never falls below 1.8 meters. Analysis shows that QRL yields safer, more robust and sample-efficient policies that are better at generalizing to unseen maps and disturbance-heavy environments. Based on the above results, the technical feasibility and engineering value of quantum-enhanced learning algorithms for robust UAV autonomous navigation have been demonstrated; thus, they can serve as a model for future intelligent aerial decision systems.
This paper presents a novel Lyapunov-Based Quantum Reinforcement Learning (LQRL) framework that integrates quantum policy optimization with Lyapunov stability analysis for continuous-time vehicle control. The proposed approach combines the representational power of variational quantum circuits (VQCs) with a stability-aware policy gradient mechanism to ensure asymptotic convergence and safe decision-making under dynamic environments. The vehicle longitudinal control problem was formulated as a continuous-state reinforcement learning task, where the quantum policy network generates control actions subject to Lyapunov stability constraints. Simulation experiments were conducted in a closed-loop adaptive cruise control scenario using a quantum-inspired policy trained under stability feedback. The results demonstrate that the LQRL framework successfully embeds Lyapunov stability verification into quantum policy learning, enabling interpretable and stability-aware control performance. Although transient overshoot and Lyapunov divergence were observed under aggressive acceleration, the system maintained bounded state evolution, validating the feasibility of integrating safety guarantees within quantum reinforcement learning architectures. The proposed framework provides a foundational step toward provably safe quantum control in autonomous systems and hybrid quantum-classical optimization domains.
In this paper, a novel quantum classical hybrid framework is proposed that synergizes quantum with Classical Reinforcement Learning. By leveraging the inherent parallelism of quantum computing, the proposed approach generates robust Q tables and specialized turn cost estimations, which are then integrated with a classical Reinforcement Learning pipeline. The Classical Quantum fusion results in rapid convergence of training, reducing the training time significantly and improved adaptability in scenarios featuring static, dynamic, and moving obstacles. Simulator based evaluations demonstrate significant enhancements in path efficiency, trajectory smoothness, and mission success rates, underscoring the potential of framework for real time, autonomous navigation in complex and unpredictable environments. Furthermore, the proposed framework was tested beyond simulations on practical scenarios, including real world map data such as the IIT Delhi campus, reinforcing its potential for real time, autonomous navigation in complex and unpredictable environments.
Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.
The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.
Variational quantum algorithms (VQAs) are promising for near-term noisy intermediate-scale quantum (NISQ) devices, but their performance is often limited by device noise, finite-shot uncertainty, and nonstationary behavior that destabilize optimization. This paper proposes a cost-aware closed-loop hybrid framework (Adaptive V16) that augments a standard VQA loop with an online decision policy to adapt measurement effort and mitigation actions during execution. At each iteration, the controller uses runtime signals such as objective progress and uncertainty to select an action comprising the shot budget, mitigation mode, and step-scaling factor, explicitly trading solution improvement against resource overhead under a fixed budget. Experimental evaluation on a representative molecular Hamiltonian optimization task shows that Adaptive V16 achieves a lower final energy than a static VQE baseline and reduces the absolute error from 0.1391 to 0.0657. The controller’s decision module also demonstrates strong predictive performance with 0.9700 accuracy, 0.9595 F1-score, and 0.9951 ROC–AUC, indicating reliable adaptive behavior across thresholds. These results suggest that policy-driven adaptation can improve robustness and budget efficiency for hybrid quantum–classical optimization in realistic NISQ settings.