Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

HQN-RL: Hybrid Quantum-Neuromorphic Reinforcement Learning for Adaptive Intelligent Control of Automated Vehicles

Mazyar Taghavi, Javad Vahidi

Published Dec 19, 2025• 0 citations
Publisher

Abstract

This paper presents a hybrid quantum neuromorphic reinforcement learning framework for adaptive intelligent control of automated vehicles operating in uncertain and heterogeneous environments. The proposed architecture integrates quantum sampling for exploration with neuromorphic computing for real-time, energy-efficient policy execution, enabling rapid convergence and robust behavior under nonstationary driving conditions. A unified theoretical analysis is provided, covering hybrid optimization convergence, controller stability, and computational complexity. The framework is evaluated through largescale simulations, quantum hardware experiments, neuromorphic processor deployment, and a sim-to-real study involving five autonomous vehicles tested in a controlled environment at the Intelligent Knowledge City research facility in Isfahan, Iran. Results demonstrate improved sample efficiency, reduced energy consumption, and enhanced robustness compared with classical reinforcement learning baselines. Furthermore, the hybrid design maintains real-time feasibility and scalability, showing promise for next-generation autonomous driving systems requiring adaptive decision-making under limited computational resources. All source code and implementation details for reproduction and further research are publicly available in the project repository.

DOI
10.36227/techrxiv.176617710.05274660/v1

Related papers

Empowering Autonomous Decision-Making Through Quantum Reinforcement Learning and Cognitive Neuromorphic Frameworks

Balasubramani R, Vidyadevi G. Biradar

The concept of Agentic AI, which focuses on empowering autonomous systems with human-like decision-making capabilities, has gained substantial attention in recent years. By leveraging advanced reinforcement learning (RL) techniques and cognitive frameworks, Agentic AI aims to enable machines to make complex decisions in dynamic environments with minimal human intervention. This paper introduces Agentic AI, a novel approach that combines Quantum Reinforcement Learning (QRL) and Cognitive Neuromorphic Frameworks to empower autonomous decision-making in complex environments. The proposed model leverages quantum computing principles to accelerate learning in reinforcement-based systems, while cognitive neuromorphic frameworks enhance adaptability and real-time decision-making by mimicking human brain functionality. The integration of QRL allows for faster convergence in learning algorithms, improving decision accuracy by 25% and reducing training time by 40%. Cognitive neuromorphic architectures offer enhanced scalability and resilience in dynamic environments, resulting in a 35% improvement in system robustness during testing. Simulations in autonomous navigation and robotic control show that Agentic AI achieves 20% more efficient task execution compared to traditional AI models. These values underscore the potential of the proposed system to revolutionize autonomous systems, providing a robust foundation for decision-making across a range of applications.

International Conference on Mobile Networks and Wireless Communications (ICMNWC)•Dec 4, 2024•5 citations

Synergizing Quantum and Neuromorphic Architectures for Scalable, Energy-Efficient, and Adaptive Artificial Intelligence Models in IoT Systems

Pankaj Mudholkar, Megha Mudholkar, Amjad Ali Syed +3 more

As artificial intelligence is increasingly employed in edge and IoT environments, the need for architectures that combine high fidelity with low energy consumption is urgent. Though neuromorphic and quantum computing methods are powerful in their own right, they typically require tradeoffs between scalability, latency and control granularity. This research explores the nexus of that tradeoff, which discusses a Hybrid Quantum–Neuromorphic Framework (HQNF) that models dynamic conditional redistribution of computational load with adaptive control and reinforcement learning. Existing frameworks tend to address the quantum and neuromorphic layers as a siloed module, with no inherent intelligent decision-making layer to balance uncertainty (reasoning), energy consumption, and output accuracy in real-time. HQNF overcomes these separated operations with a proposed three-tier architecture, enabling reasoning support for high and continuous uncertain states and mechanics to intelligently decide based on observational feedback from knowledge projection.

Advances in computational intelligence and robotics book series•Mar 4, 2026•0 citations

Quantum-Enhanced Reinforcement Learning for Adaptive Decision-Making in Dynamic Environments

Priyanka Singh, Sonam Dubey

Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.

•Aug 1, 2026•0 citations

Autonomous Quantum System Design Using Reinforcement Learning and Evolutionary Strategies

Thirunavukarasu, Elanchezhian, Mohamed Ashraf +1 more

The design of autonomous quantum systems constitutes an entirely new paradigm for next-generation computing by having machine intelligence do the engineering work to build and optimise successful quantum architectures. We address the problem of self-optimizing quantum systems that perform adaptive control, circuit synthesis and decision making in both accurate and uncertain controllable environments via a two-pronged approach: Reinforcement Learning (RL) together with Evolutionary Strategies (ES). In this work, we find that reinforcement learning provides a general framework for sequential decision-making, where agents learn optimal policies from reward signals by interacting with quantum environments. Evolutionary strategies, which are based on ideas from biological evolution, provide an alternative to RL by performing global optimization of quantum circuit parameters and architectures using the standard canonical processes of mutation, selection and recombination. Recent developments in quantum technologies show, again, that machine learning tools (ML), especially RL can be very useful to optimize unavailable closed blow-ups related with quantity functions. Moreover, evolutionary optimization based hybrids with RL have demonstrated better performance on the complex multi-objective quantum problems due to balanced exploitation and exploration. In this paper, we provide an overview of a versatile framework for autonomous quantum system design that showcases example algorithmic architectures, hybrid machine learning models and real world applications in areas such as quantum control, quantum circuit synthesis and energy optimization. In addition, we discuss well-known obstacles such as the scalability problem, the noise sensitivity issue, barren plateaus of quantum optimization and computational complexity. Comparisons to traditional methods show that reinforcement learning (RL) when combined with evolutionary strategies enables a significant improvement in efficiency, adaptability, and robustness for quantum system design as supported by experimental studies and case analyses. Future research directions are then discussed, including quantum-native learning algorithms, multi-agent quantum reinforcement learning and hardware-aware optimization techniques

International Journal of Quantum Computing and Artificial Intelligence (IJQCAI)•Mar 29, 2026•0 citations

Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems

Jagjit Singh Dhatterwal, Sandeep Kumar, Shilpa Choudhary

The integration of Quantum-Inspired Reinforcement Learning (QiRL) into Edge-Driven CyberPhysical Systems (CPS) presents a transformative approach to enhance real-time decision-making in distributed environments. While classical reinforcement learning (RL) struggles with scalability and computational complexity in edge-CPS, quantum-inspired Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems algorithms leverage superposition and entanglement principles to optimize policy exploration and convergence. This paper proposes a novel QiRL framework that combines quantum-inspired optimization with deep RL, enabling efficient resource allocation and adaptive control in latency-sensitive applications (e.g., smart grids, autonomous drones). We formalize the mathematical foundations of QiRL, design a hybrid neural-quantum architecture for edge deployment, and evaluate its performance under dynamic CPS constraints. Simulations on IoT-based case studies demonstrate $\mathbf{2 0}-\mathbf{3 5 \%}$ faster convergence and $\mathbf{1 5 \%}$ higher energy efficiency compared to classical Deep Q-Networks (DQN). Key challenges, such as quantum noise simulation and edge-hardware limitations, are discussed to guide future research. This work bridges quantum computing principles with edge intelligence, offering a scalable pathway for nextgeneration CPS.

International Conference on Mobile Networks and Wireless Communications (ICMNWC)•Dec 10, 2025•0 citations

Agentic Hybrid Quantum–Neuromorphic AI Architecture With Explainable Reinforcement Learning for Next-Generation Intelligent Systems

Divyanshu Sinha, Udit Mamodiya, Indra Kishor +2 more

Artificial intelligence systems are shifting away to passive prediction systems into architectures that are supposed to rationalize and modify according to their needs as well as explain what they are doing. The current methods tend to maximize the precision at the expense of transparency and long-term flexibility, creating a gap in the systems with both accountable reasoning and learning processes. To solve this, we present an Agentic Hybrid Quantum -Neuromorphic AI system with an Explainable Reinforcement Learning core. It consists of a combination of quantum-assisted exploration, spiking neuromorphic adaptation, interpretable policy optimization to enable the system to adapt computational strategy depending on the dynamics of rewards, confidence, and environmental change. Experiments exhibit enhanced convergence speed, ability to maintain behavior in the case of sudden changes in the environment and a far greater enhancement in explanation coherence than traditional reinforcement learning agents and adaptive immersive systems.

Advances in computational intelligence and robotics book series•Mar 4, 2026•5 citations
This paper presents a hybrid quantum neuromorphic reinforcement learning framework for adaptive intelligent control of automated vehicles operating in uncertain and heterogeneous environments. The proposed architecture integrates quantum sampling for exploration with neuromorphic computing for real-time, energy-efficient policy execution, enabling rapid convergence and robust behavior under nonstationary driving conditions. A unified theoretical analysis is provided, covering hybrid optimization convergence, controller stability, and computational complexity. The framework is evaluated through largescale simulations, quantum hardware experiments, neuromorphic processor deployment, and a sim-to-real study involving five autonomous vehicles tested in a controlled environment at the Intelligent Knowledge City research facility in Isfahan, Iran. Results demonstrate improved sample efficiency, reduced energy consumption, and enhanced robustness compared with classical reinforcement learning baselines. Furthermore, the hybrid design maintains real-time feasibility and scalability, showing promise for next-generation autonomous driving systems requiring adaptive decision-making under limited computational resources. All source code and implementation details for reproduction and further research are publicly available in the project repository.
The concept of Agentic AI, which focuses on empowering autonomous systems with human-like decision-making capabilities, has gained substantial attention in recent years. By leveraging advanced reinforcement learning (RL) techniques and cognitive frameworks, Agentic AI aims to enable machines to make complex decisions in dynamic environments with minimal human intervention. This paper introduces Agentic AI, a novel approach that combines Quantum Reinforcement Learning (QRL) and Cognitive Neuromorphic Frameworks to empower autonomous decision-making in complex environments. The proposed model leverages quantum computing principles to accelerate learning in reinforcement-based systems, while cognitive neuromorphic frameworks enhance adaptability and real-time decision-making by mimicking human brain functionality. The integration of QRL allows for faster convergence in learning algorithms, improving decision accuracy by 25% and reducing training time by 40%. Cognitive neuromorphic architectures offer enhanced scalability and resilience in dynamic environments, resulting in a 35% improvement in system robustness during testing. Simulations in autonomous navigation and robotic control show that Agentic AI achieves 20% more efficient task execution compared to traditional AI models. These values underscore the potential of the proposed system to revolutionize autonomous systems, providing a robust foundation for decision-making across a range of applications.
As artificial intelligence is increasingly employed in edge and IoT environments, the need for architectures that combine high fidelity with low energy consumption is urgent. Though neuromorphic and quantum computing methods are powerful in their own right, they typically require tradeoffs between scalability, latency and control granularity. This research explores the nexus of that tradeoff, which discusses a Hybrid Quantum–Neuromorphic Framework (HQNF) that models dynamic conditional redistribution of computational load with adaptive control and reinforcement learning. Existing frameworks tend to address the quantum and neuromorphic layers as a siloed module, with no inherent intelligent decision-making layer to balance uncertainty (reasoning), energy consumption, and output accuracy in real-time. HQNF overcomes these separated operations with a proposed three-tier architecture, enabling reasoning support for high and continuous uncertain states and mechanics to intelligently decide based on observational feedback from knowledge projection.
Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.
The design of autonomous quantum systems constitutes an entirely new paradigm for next-generation computing by having machine intelligence do the engineering work to build and optimise successful quantum architectures. We address the problem of self-optimizing quantum systems that perform adaptive control, circuit synthesis and decision making in both accurate and uncertain controllable environments via a two-pronged approach: Reinforcement Learning (RL) together with Evolutionary Strategies (ES). In this work, we find that reinforcement learning provides a general framework for sequential decision-making, where agents learn optimal policies from reward signals by interacting with quantum environments. Evolutionary strategies, which are based on ideas from biological evolution, provide an alternative to RL by performing global optimization of quantum circuit parameters and architectures using the standard canonical processes of mutation, selection and recombination. Recent developments in quantum technologies show, again, that machine learning tools (ML), especially RL can be very useful to optimize unavailable closed blow-ups related with quantity functions. Moreover, evolutionary optimization based hybrids with RL have demonstrated better performance on the complex multi-objective quantum problems due to balanced exploitation and exploration. In this paper, we provide an overview of a versatile framework for autonomous quantum system design that showcases example algorithmic architectures, hybrid machine learning models and real world applications in areas such as quantum control, quantum circuit synthesis and energy optimization. In addition, we discuss well-known obstacles such as the scalability problem, the noise sensitivity issue, barren plateaus of quantum optimization and computational complexity. Comparisons to traditional methods show that reinforcement learning (RL) when combined with evolutionary strategies enables a significant improvement in efficiency, adaptability, and robustness for quantum system design as supported by experimental studies and case analyses. Future research directions are then discussed, including quantum-native learning algorithms, multi-agent quantum reinforcement learning and hardware-aware optimization techniques
The integration of Quantum-Inspired Reinforcement Learning (QiRL) into Edge-Driven CyberPhysical Systems (CPS) presents a transformative approach to enhance real-time decision-making in distributed environments. While classical reinforcement learning (RL) struggles with scalability and computational complexity in edge-CPS, quantum-inspired Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems algorithms leverage superposition and entanglement principles to optimize policy exploration and convergence. This paper proposes a novel QiRL framework that combines quantum-inspired optimization with deep RL, enabling efficient resource allocation and adaptive control in latency-sensitive applications (e.g., smart grids, autonomous drones). We formalize the mathematical foundations of QiRL, design a hybrid neural-quantum architecture for edge deployment, and evaluate its performance under dynamic CPS constraints. Simulations on IoT-based case studies demonstrate 20−35%\mathbf{2 0}-\mathbf{3 5 \%}20−35% faster convergence and 15%\mathbf{1 5 \%}15% higher energy efficiency compared to classical Deep Q-Networks (DQN). Key challenges, such as quantum noise simulation and edge-hardware limitations, are discussed to guide future research. This work bridges quantum computing principles with edge intelligence, offering a scalable pathway for nextgeneration CPS.
Artificial intelligence systems are shifting away to passive prediction systems into architectures that are supposed to rationalize and modify according to their needs as well as explain what they are doing. The current methods tend to maximize the precision at the expense of transparency and long-term flexibility, creating a gap in the systems with both accountable reasoning and learning processes. To solve this, we present an Agentic Hybrid Quantum -Neuromorphic AI system with an Explainable Reinforcement Learning core. It consists of a combination of quantum-assisted exploration, spiking neuromorphic adaptation, interpretable policy optimization to enable the system to adapt computational strategy depending on the dynamics of rewards, confidence, and environmental change. Experiments exhibit enhanced convergence speed, ability to maintain behavior in the case of sudden changes in the environment and a far greater enhancement in explanation coherence than traditional reinforcement learning agents and adaptive immersive systems.