Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Journal of Applied Automation Technologies

Application of Quantum Reinforcement Learning in Autonomous Unmanned Aerial Vehicle Navigation

Veljko Perić, Milan Živković

Published Dec 13, 2025• 0 citations
Publisher

Abstract

An intelligent adaptation technique is necessary due to the complexity and unpredictability of the air space, and autonomous unmanned aerial vehicle (UAV) navigation uses quantum reinforcement learning (QRL) as an advanced control mechanism. This work suggests quantum-inspired encoding and optimization algorithms for policy learning in order to overcome the shortcomings in efficiency and scalability of conventional and deep reinforcement learning approaches. The technique employs quantum-parametric policy optimization on a hybrid quantum-classical architecture after forming UAV navigation as a Markov Decision Process and adding quantum amplitude encoding. Dynamic obstacle and random wind disturbance experiments will be carried out in a high-fidelity 3D simulation environment. QRL has decreased energy usage by up to 17% and increased the top classical RL baseline's convergence speed by 40%. Even in inclement weather, the success rate remains around 95%, and the minimum obstacle clearance never falls below 1.8 meters. Analysis shows that QRL yields safer, more robust and sample-efficient policies that are better at generalizing to unseen maps and disturbance-heavy environments. Based on the above results, the technical feasibility and engineering value of quantum-enhanced learning algorithms for robust UAV autonomous navigation have been demonstrated; thus, they can serve as a model for future intelligent aerial decision systems.

DOI
10.64972/jaat.2025v3.240p44e:604-617

Related papers

Quantum Reinforcement Learning for UAV-Enhanced Next-Generation Wireless Communications

Annisa Anggun Puspitasari, Byung Moo Lee

The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.

IEEE Communications Surveys & Tutorials•Nov 14, 2025•6 citations

Quantum-Enhanced Reinforcement Learning (QRL) for Robotics

Jincheng Zhang

This paper explores the application of Quantum-Enhanced Reinforcement Learning (QRL) to robotics, aiming to accelerate learning speeds and enable more intelligent decision-making in complex environments. Traditional reinforcement learning algorithms often struggle with scalability and convergence, particularly when dealing with high-dimensional state spaces and complex environments. Quantum computing offers the potential to overcome these limitations by leveraging quantum mechanics to perform computations that are intractable for classical computers. We propose a novel QRL framework that utilizes quantum-enhanced reinforcement learning to improve exploration, adaptation, and overall performance. The core mechanism involves employing quantum circuits to represent and manipulate the state space, facilitating more efficient learning and potentially uncovering novel strategies. This research investigates the feasibility and potential impact of QRL on robotic control, focusing on scenarios requiring rapid adaptation and robust decision-making in dynamic environments. We present preliminary results demonstrating the efficacy of our approach in a simulated robotic task involving navigation and obstacle avoidance.

•Sep 3, 2026•0 citations

Compute-Constrained Variational Quantum Reinforcement Learning for Energy-Aware Autonomous Uav Navigation in Dynamic Environments

Muhammad Rashid Majeed, Peiyun Zhang, P.G. Balis +3 more

Applying quantum-improved reinforcement learning to autonomous UAV systems is inherently faced with the challenge of limited energy and computing resources onboard, especially in dynamic and wind-turbulent scenarios. To overcome this problem, we present a compute-adaptive quantum-classical control approach that executes quantum policies within tight runtime budgets while maintaining navigation performance and safety. The approach presents a two-policy paradigm that combines a high-capacity variational quantum policy with a lightweight classical proxy policy, both managed by a learned budget controller that modulates quantum policy usage in real time via a skip probability. The approach is trained using the PPO algorithm on a stochastic 3D UAV navigation task and shows that the proposed scheduler effectively tracks a target quantum budget, increasing the training-time skip probability from about 0.35 to close to 1.0 while maintaining compute-adaptive fluctuations in quantum usage between .0.1 and 1.0, depending on the episode complexity. Notably, learning is stable even under high environmental stochasticity, with episodic rewards ranging from about -700 to -100, and the moving average of the last 50 episodes converges and remains within -300 to -340 over more than 6,000 training episodes, demonstrating stable convergence with compute-aware switching. In addition, the trajectory rollouts validate the effectiveness of obstacle-aware navigation towards the goal in 3D space, with smooth energy consumption curves that gradually decrease from normalised energy 1.0 to around 0.73 before termination, without mid-trajectory energy spikes. Failure mode analysis aggregated across months also shows that the most common failure cause is boundary violation, at around 77%, followed by energy depletion at 18%, and collisions at 5%, which are realistic safety and energy trade-offs rather than instability. Finally, experiments in generalisation across months show strong peak robustness, with best-case success rates at around 0.95, 0.97, and 0.90 under different wind regimes, although final policy performance shows sensitivity. In conclusion, the above experiments demonstrate that quantum reinforcement learning can be stabilised and deployed within computational constraints, with clear scope for improving boundary violations and generalisation under extreme environmental uncertainty.

International Conference on Electronics Technology (ICET)•May 1, 2026•0 citations

Survey Paper on Quantum Deep Reinforcement Learning for Robot Navigation Tasks

Shruti Doiphode, Prof. Mukul Jagtap

Abstract: Quantum deep reinforcement learning is an integration of the principles of quantum computing with deep reinforcement learning in an effort to advance robot navigation tasks. Due to the explosion of the state and action spaces, traditionally DRL methods are limited in scalability and efficiency. QDRL, however, uses quantum superposition and entanglement for more efficient processing of big amounts of information-it enables robots to learn optimal policies for navigating complex environments. We introduce here a new QDRL framework in which quantum neural networks encode policy functions and value estimates. We demonstrate how quantum circuits can take advantage of multi-dimensional state representations in order to strengthen the power of a robot in changing its environment over time. Benchmark experiments on navigation tasks reflect phenomenal acceleration in learning performance along with better decision-making accuracy compared to classical DRL methods. We then consider integrating such quantum algorithms, as Grover's search, to improve exploration strategies in sparse reward settings. The experiments show that QDRL speeds up convergence rates and provides robots with the possibility to react more rapidly to unexpected obstacles. It discusses new applications for quantum computing of autonomous systems, potentially applied to robotics, autonomous vehicles, and other environments which require complex decision making. Some lines of work in the future are optimization of the resources needed for quantum computers and hybrid architectures for the resolution of classical problems in navigation

International Journal for Research in Applied Science and Engineering Technology•Oct 18, 2024•0 citations

Path Planning for Autonomous Robots using Quantum Reinforcement Learning

L. Tharun, .Swetha Shailaja, G. Aswitha +1 more

ABSTRACT-This research work focuses on the application of Quantum Reinforcement Learning (QRL) to improve path planning for autonomous robots. Traditional path planning techniques are prone to failure in handling the complexity of uncertain and dynamic environments, but QRL leverages the power of quantum computing to exploit the principles of superposition and parallelism to improve decision-making and optimization processes. By integrating QRL with existing reinforcement learning techniques, the proposed technique quickens the pace of learning processes and improves the quality of path planning to enable robots to navigate around obstacles more effectively with shorter travel time and lower energy costs. Simulation results show that QRL outperforms traditional techniques in convergence speed and optimality of path solutions and offers a promising solution for practical autonomous navigation. Keywords: Dynamic Environment, Path Planning, Autonomous Navigation, Obstacles avoidance.

INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT•Feb 26, 2026•0 citations

Quantum-Enhanced Reinforcement Learning for Adaptive Decision-Making in Dynamic Environments

Priyanka Singh, Sonam Dubey

Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.

•Aug 1, 2026•0 citations
An intelligent adaptation technique is necessary due to the complexity and unpredictability of the air space, and autonomous unmanned aerial vehicle (UAV) navigation uses quantum reinforcement learning (QRL) as an advanced control mechanism. This work suggests quantum-inspired encoding and optimization algorithms for policy learning in order to overcome the shortcomings in efficiency and scalability of conventional and deep reinforcement learning approaches. The technique employs quantum-parametric policy optimization on a hybrid quantum-classical architecture after forming UAV navigation as a Markov Decision Process and adding quantum amplitude encoding. Dynamic obstacle and random wind disturbance experiments will be carried out in a high-fidelity 3D simulation environment. QRL has decreased energy usage by up to 17% and increased the top classical RL baseline's convergence speed by 40%. Even in inclement weather, the success rate remains around 95%, and the minimum obstacle clearance never falls below 1.8 meters. Analysis shows that QRL yields safer, more robust and sample-efficient policies that are better at generalizing to unseen maps and disturbance-heavy environments. Based on the above results, the technical feasibility and engineering value of quantum-enhanced learning algorithms for robust UAV autonomous navigation have been demonstrated; thus, they can serve as a model for future intelligent aerial decision systems.
The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.
This paper explores the application of Quantum-Enhanced Reinforcement Learning (QRL) to robotics, aiming to accelerate learning speeds and enable more intelligent decision-making in complex environments. Traditional reinforcement learning algorithms often struggle with scalability and convergence, particularly when dealing with high-dimensional state spaces and complex environments. Quantum computing offers the potential to overcome these limitations by leveraging quantum mechanics to perform computations that are intractable for classical computers. We propose a novel QRL framework that utilizes quantum-enhanced reinforcement learning to improve exploration, adaptation, and overall performance. The core mechanism involves employing quantum circuits to represent and manipulate the state space, facilitating more efficient learning and potentially uncovering novel strategies. This research investigates the feasibility and potential impact of QRL on robotic control, focusing on scenarios requiring rapid adaptation and robust decision-making in dynamic environments. We present preliminary results demonstrating the efficacy of our approach in a simulated robotic task involving navigation and obstacle avoidance.
Applying quantum-improved reinforcement learning to autonomous UAV systems is inherently faced with the challenge of limited energy and computing resources onboard, especially in dynamic and wind-turbulent scenarios. To overcome this problem, we present a compute-adaptive quantum-classical control approach that executes quantum policies within tight runtime budgets while maintaining navigation performance and safety. The approach presents a two-policy paradigm that combines a high-capacity variational quantum policy with a lightweight classical proxy policy, both managed by a learned budget controller that modulates quantum policy usage in real time via a skip probability. The approach is trained using the PPO algorithm on a stochastic 3D UAV navigation task and shows that the proposed scheduler effectively tracks a target quantum budget, increasing the training-time skip probability from about 0.35 to close to 1.0 while maintaining compute-adaptive fluctuations in quantum usage between .0.1 and 1.0, depending on the episode complexity. Notably, learning is stable even under high environmental stochasticity, with episodic rewards ranging from about -700 to -100, and the moving average of the last 50 episodes converges and remains within -300 to -340 over more than 6,000 training episodes, demonstrating stable convergence with compute-aware switching. In addition, the trajectory rollouts validate the effectiveness of obstacle-aware navigation towards the goal in 3D space, with smooth energy consumption curves that gradually decrease from normalised energy 1.0 to around 0.73 before termination, without mid-trajectory energy spikes. Failure mode analysis aggregated across months also shows that the most common failure cause is boundary violation, at around 77%, followed by energy depletion at 18%, and collisions at 5%, which are realistic safety and energy trade-offs rather than instability. Finally, experiments in generalisation across months show strong peak robustness, with best-case success rates at around 0.95, 0.97, and 0.90 under different wind regimes, although final policy performance shows sensitivity. In conclusion, the above experiments demonstrate that quantum reinforcement learning can be stabilised and deployed within computational constraints, with clear scope for improving boundary violations and generalisation under extreme environmental uncertainty.
Abstract: Quantum deep reinforcement learning is an integration of the principles of quantum computing with deep reinforcement learning in an effort to advance robot navigation tasks. Due to the explosion of the state and action spaces, traditionally DRL methods are limited in scalability and efficiency. QDRL, however, uses quantum superposition and entanglement for more efficient processing of big amounts of information-it enables robots to learn optimal policies for navigating complex environments. We introduce here a new QDRL framework in which quantum neural networks encode policy functions and value estimates. We demonstrate how quantum circuits can take advantage of multi-dimensional state representations in order to strengthen the power of a robot in changing its environment over time. Benchmark experiments on navigation tasks reflect phenomenal acceleration in learning performance along with better decision-making accuracy compared to classical DRL methods. We then consider integrating such quantum algorithms, as Grover's search, to improve exploration strategies in sparse reward settings. The experiments show that QDRL speeds up convergence rates and provides robots with the possibility to react more rapidly to unexpected obstacles. It discusses new applications for quantum computing of autonomous systems, potentially applied to robotics, autonomous vehicles, and other environments which require complex decision making. Some lines of work in the future are optimization of the resources needed for quantum computers and hybrid architectures for the resolution of classical problems in navigation
ABSTRACT-This research work focuses on the application of Quantum Reinforcement Learning (QRL) to improve path planning for autonomous robots. Traditional path planning techniques are prone to failure in handling the complexity of uncertain and dynamic environments, but QRL leverages the power of quantum computing to exploit the principles of superposition and parallelism to improve decision-making and optimization processes. By integrating QRL with existing reinforcement learning techniques, the proposed technique quickens the pace of learning processes and improves the quality of path planning to enable robots to navigate around obstacles more effectively with shorter travel time and lower energy costs. Simulation results show that QRL outperforms traditional techniques in convergence speed and optimality of path solutions and offers a promising solution for practical autonomous navigation. Keywords: Dynamic Environment, Path Planning, Autonomous Navigation, Obstacles avoidance.
Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.