Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Dynamic Spectrum Allocation, Hybrid Beamforming, and Sub-THz Channel Tracking in 6G Ultra-Dense Networks: A Comparative Microarchitectural Benchmark of Parameterized Variational Quantum Reinforcement Learning (VQRL) versus Deep Q-Networks (DQN)

Kartik Kothalkar

Published May 22, 2023• 0 citations
Publisher

Abstract

The impending transition to sixth-generation (6G) wireless networks introduces the operational deployment of sub-terahertz and terahertz (sub-THz/THz) frequency bands (0.1 THz to 1.0 THz, specifically the 140 GHz D-Band and 300 GHz transmission windows) to support multi-terabit-per-second (Tbps) data rates and sub-0.1 millisecond Ultra-Reliable Low-Latency Communication (URLLC). However, the physics of THz electromagnetic propagation—characterized by severe atmospheric molecular absorption, extreme free-space path loss, and shadow attenuation from dynamic blockages—demands narrow pencil-beam hybrid beamforming alongside massive Reconfigurable Intelligent Surfaces (RIS). When millions of autonomous vehicles, aerial drones, and mobile devices traverse high-density urban environments, joint real-time spectrum sub-band scheduling, continuous phase-shift tracking, and power allocation induce an NP-hard combinatorial optimization problem scaling exponentially as O(K^N). Classical Deep Reinforcement Learning (DRL) frameworks, such as Deep Q-Networks (DQN) and Soft Actor-Critic (SAC) executing on high-performance host GPUs, suffer from a prohibitive computational inference barrier (requiring 28.5 ms to 74.2 ms per scheduling decision), fundamentally violating the 6G URLLC scheduling budget (<1.0 ms). This paper proposes and rigorously evaluates a Parameterized Variational Quantum Reinforcement Learning (VQRL) framework utilizing quantum state amplitude-phase embedding and parameterized rotation-entanglement quantum circuits (VQC) executed on superconducting NISQ quantum co-processors. By evaluating multi-user allocation policies simultaneously in quantum superposition across a 2^N-dimensional Hilbert space and eliminating multi-cell co-channel interference through inter-tower quantum entanglement, VQRL achieves: • Exponential Latency Reduction: Slashes scheduling execution latency to just 0.078 milliseconds (78 microseconds)—a 365x speedup over GPU-based DQN—comfortably meeting 6G sub-millisecond sub-frame budgets.• Superior Convergence Speed: Achieves a 94.2% reduction in training convergence time (converging within 42 episodes versus 720 episodes for double DQN).• Massive Multi-Terabit Throughput: Delivers an aggregate cell throughput of 1.48 Tbps (a 2.84x improvement over classical DQN baselines) under 3GPP Urban Microcell (UMi) topographies.• High-Mobility Vehicular Beam Tracking: Eliminates 98.6% of vehicular beam-alignment dropouts under 120 km/h mobility through predictive quantum Hamiltonian evolution.• Energy Efficiency: Reduces base station computational energy consumption from 480 Watts to 24 Watts per radio frame. The repository includes the full 31-page primary academic treatise, complete novelty and systems defense dossiers, and full Hindi and Marathi translations.

DOI
10.5281/zenodo.22899172

Related papers

Variational Quantum Rainbow Deep Q-Network for Optimizing Resource Allocation Problem

Truong Thanh Hung Nguyen, Truong Thinh Nguyen, Hung Cao

Resource allocation remains NP-hard due to combinatorial complexity. While deep reinforcement learning (DRL) methods, such as the Rainbow Deep Q-Network (DQN), improve scalability through prioritized replay and distributional heads, classical function approximators limit their representational power. We introduce Variational Quantum Rainbow DQN (VQR-DQN), which integrates ring-topology variational quantum circuits with Rainbow DQN to leverage quantum superposition and entanglement. We frame the human resource allocation problem (HRAP) as a Markov decision process (MDP) with combinatorial action spaces based on officer capabilities, event schedules, and transition times. On four HRAP benchmarks, VQR-DQN achieves 26.8% normalized makespan reduction versus random baselines and outperforms Double DQN and classical Rainbow DQN by 4.9–13.4%. These gains align with theoretical connections between circuit expressibility, entanglement, and policy quality, demonstrating the potential of quantum-enhanced DRL for large-scale resource allocation. Our implementation is available at: https://github.com/Analytics-Everywhere-Lab/qtrl/.

arXiv:2512.05946•ACM Symposium on Applied Computing•Mar 23, 2026•0 citations

Quantum-Enhanced AI Mechanism for Dynamic Antenna Beam Optimization

B. Ramana Kumar, Nagavalli Vegesna, R. Rajitha Jasmine +3 more

This research presents a quantum augmented AI algorithm for dynamic antenna beam optimization deployment for the next generation wireless network by way of Quantum Deep Reinforcement Learning (QDRL), based on the Google's Cirq quantum computing tool. The proposed system uses Quantum Deep Q-Network (Q-DQN) combined with Quantum Approximate Optimization Algorithm (QAOA that is located into the system's architecture in order to determine the computational complexity of massive MIMO beamforming for 6G network. By leveraging the properties of quantum superposition the system is able to simultaneously think about a range of state-action pairs, which helps it to speed up and reduce the complexity of computations in the training process. The framework incorporates Kalman filtering which is used to predict the channel and patterns of quantum interference are used to converge on near optima combinations of beams. Experimental results show the performance with respect to its spectral efficiency and energy consumption to be better than classical approaches to deep reinforcement learning. The system optimizes beamforming patterns without a trade-off to adaptive wireless coverage by utilizing intelligent reflecting surfaces with faster convergence rate in dynamic and High Dimensional Wireless Environment accompanied with a serious reduction in offline training in order to achieve real-time deployment.

•Sep 1, 2026•0 citations

Quantum Deep Q-Network for Intelligent Packet Routing in 6G Heterogeneous Wireless Networks

Tong Xie, Taoyong Li, Xinxin Yuan +1 more

Intelligent packet routing in sixth-generation (6G) heterogeneous wireless networks must contend with stochastic link failures, heterogeneous delay profiles, and the severe memory constraints of edge nodes. We propose a quantum deep Q-network (Q-DQN) that replaces the multi-layer perceptron in a standard DQN agent with a six-qubit variational quantum circuit (VQC) employing ring-topology entanglement and angle embedding. The total trainable parameter count follows the closed-form expression |ϕ|=12L+7n, growing at only seven parameters per additional network node. On a 10-node heterogeneous topology with stochastic link failures, Q-DQN achieves an average end-to-end delay of 54.29±1.72 ms with only 106 parameters, a 49.6× reduction relative to the MLP-based DQN baseline (5258 parameters, 52.89±2.67 ms). A three-seed scalability evaluation across n∈{6,8,10,12} nodes shows that under a limited 200-episode training budget DQN converges more consistently, while Q-DQN matches DQN performance under full 500-episode training at a fraction of the parameter cost. Ablation experiments confirm that local-topology entanglement substantially outperforms full-connection alternatives. These results indicate that VQC-based routing agents can match classical counterparts at a fraction of the parameter cost, providing a path toward ultra-lightweight intelligent routing in 6G edge deployments.

Applied Sciences•Jun 16, 2026•1 citation

Quantum Reinforcement Learning for UAV-Enhanced Next-Generation Wireless Communications

Annisa Anggun Puspitasari, Byung Moo Lee

The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.

IEEE Communications Surveys & Tutorials•Nov 14, 2025•6 citations

Quantum Reinforcement Learning for 6G and Beyond Wireless Networks

Dinh-Hieu Tran, Thai Duong Nguyen, Thanh D. Nguyen +10 more

While 5G is being deployed worldwide, 6G is receiving increasing attention from researchers to meet the growing demand for higher data rates, lower latency, higher density, and seamless communications worldwide. To meet the stringent requirements of 6G wireless communications networks, AI-integrated communications have become an indispensable part of supporting 6G systems with intelligence, automation, and big data training capabilities. However, traditional artificial intelligence (AI) systems are difficult to meet the stringent latency and high throughput requirements of 6G with limited resources. In this article, we summarize, analyze, discuss the potential, and benefits of Quantum Reinforcement Learning (QRL) in 6G. As an example, we show the superiority of QRL in dynamic spectrum access compared to the conventional Deep Reinforcement Learning (DRL) approach. In addition, we provide an overview of what DRL has accomplished in 6G and its challenges and limitations. From there, we introduce QRL and potential research directions that should continue to be of interest in 6G. To the best of our knowledge, this is the first review and vision article on QRL for 6G wireless communication networks.

arXiv:2511.01070•Nov 2, 2025•4 citations

A Survey of Quantum Deep Reinforcement Learning for Resource Allocation in Future Wireless Networks

Ni Made Erma Pratiwi Astiti, Byung Moo Lee

The significant rise in wireless communication, driven by sixth-generation (6G) networks, underscores the urgent need for innovative resource allocation methods to achieve efficiency, scalability, and reliability. This survey explores the integration of Quantum Deep Reinforcement Learning (QDRL) as a strategy to address the challenges posed by dynamic and complex wireless environments. By leveraging quantum computing features such as superposition and entanglement, QDRL enhances computational efficiency and mitigates the scalability limitations of classical and deep reinforcement learning (DRL) in high-dimensional optimization. The study reviews recent QDRL approaches for key resource allocation tasks, including power distribution, user scheduling, and channel assignment, and examines quantum algorithms such as the Quantum Approximate Optimization Algorithm (QAOA) and Quantum Neural Networks (QNN) for improved decision-making in wireless systems. Furthermore, it emphasizes the connection between quantum computing and DRL, highlighting hybrid architectures that balance computational cost, energy efficiency, and scalability. Finally, the survey identifies research gaps and outlines future directions, paving the way for robust QDRL strategies to support next-generation wireless networks.

IEEE Communications Surveys & Tutorials•Nov 28, 2025•16 citations
The impending transition to sixth-generation (6G) wireless networks introduces the operational deployment of sub-terahertz and terahertz (sub-THz/THz) frequency bands (0.1 THz to 1.0 THz, specifically the 140 GHz D-Band and 300 GHz transmission windows) to support multi-terabit-per-second (Tbps) data rates and sub-0.1 millisecond Ultra-Reliable Low-Latency Communication (URLLC). However, the physics of THz electromagnetic propagation—characterized by severe atmospheric molecular absorption, extreme free-space path loss, and shadow attenuation from dynamic blockages—demands narrow pencil-beam hybrid beamforming alongside massive Reconfigurable Intelligent Surfaces (RIS). When millions of autonomous vehicles, aerial drones, and mobile devices traverse high-density urban environments, joint real-time spectrum sub-band scheduling, continuous phase-shift tracking, and power allocation induce an NP-hard combinatorial optimization problem scaling exponentially as O(K^N). Classical Deep Reinforcement Learning (DRL) frameworks, such as Deep Q-Networks (DQN) and Soft Actor-Critic (SAC) executing on high-performance host GPUs, suffer from a prohibitive computational inference barrier (requiring 28.5 ms to 74.2 ms per scheduling decision), fundamentally violating the 6G URLLC scheduling budget (<1.0 ms). This paper proposes and rigorously evaluates a Parameterized Variational Quantum Reinforcement Learning (VQRL) framework utilizing quantum state amplitude-phase embedding and parameterized rotation-entanglement quantum circuits (VQC) executed on superconducting NISQ quantum co-processors. By evaluating multi-user allocation policies simultaneously in quantum superposition across a 2^N-dimensional Hilbert space and eliminating multi-cell co-channel interference through inter-tower quantum entanglement, VQRL achieves: • Exponential Latency Reduction: Slashes scheduling execution latency to just 0.078 milliseconds (78 microseconds)—a 365x speedup over GPU-based DQN—comfortably meeting 6G sub-millisecond sub-frame budgets.• Superior Convergence Speed: Achieves a 94.2% reduction in training convergence time (converging within 42 episodes versus 720 episodes for double DQN).• Massive Multi-Terabit Throughput: Delivers an aggregate cell throughput of 1.48 Tbps (a 2.84x improvement over classical DQN baselines) under 3GPP Urban Microcell (UMi) topographies.• High-Mobility Vehicular Beam Tracking: Eliminates 98.6% of vehicular beam-alignment dropouts under 120 km/h mobility through predictive quantum Hamiltonian evolution.• Energy Efficiency: Reduces base station computational energy consumption from 480 Watts to 24 Watts per radio frame. The repository includes the full 31-page primary academic treatise, complete novelty and systems defense dossiers, and full Hindi and Marathi translations.
Resource allocation remains NP-hard due to combinatorial complexity. While deep reinforcement learning (DRL) methods, such as the Rainbow Deep Q-Network (DQN), improve scalability through prioritized replay and distributional heads, classical function approximators limit their representational power. We introduce Variational Quantum Rainbow DQN (VQR-DQN), which integrates ring-topology variational quantum circuits with Rainbow DQN to leverage quantum superposition and entanglement. We frame the human resource allocation problem (HRAP) as a Markov decision process (MDP) with combinatorial action spaces based on officer capabilities, event schedules, and transition times. On four HRAP benchmarks, VQR-DQN achieves 26.8% normalized makespan reduction versus random baselines and outperforms Double DQN and classical Rainbow DQN by 4.9–13.4%. These gains align with theoretical connections between circuit expressibility, entanglement, and policy quality, demonstrating the potential of quantum-enhanced DRL for large-scale resource allocation. Our implementation is available at: https://github.com/Analytics-Everywhere-Lab/qtrl/.
This research presents a quantum augmented AI algorithm for dynamic antenna beam optimization deployment for the next generation wireless network by way of Quantum Deep Reinforcement Learning (QDRL), based on the Google's Cirq quantum computing tool. The proposed system uses Quantum Deep Q-Network (Q-DQN) combined with Quantum Approximate Optimization Algorithm (QAOA that is located into the system's architecture in order to determine the computational complexity of massive MIMO beamforming for 6G network. By leveraging the properties of quantum superposition the system is able to simultaneously think about a range of state-action pairs, which helps it to speed up and reduce the complexity of computations in the training process. The framework incorporates Kalman filtering which is used to predict the channel and patterns of quantum interference are used to converge on near optima combinations of beams. Experimental results show the performance with respect to its spectral efficiency and energy consumption to be better than classical approaches to deep reinforcement learning. The system optimizes beamforming patterns without a trade-off to adaptive wireless coverage by utilizing intelligent reflecting surfaces with faster convergence rate in dynamic and High Dimensional Wireless Environment accompanied with a serious reduction in offline training in order to achieve real-time deployment.
Intelligent packet routing in sixth-generation (6G) heterogeneous wireless networks must contend with stochastic link failures, heterogeneous delay profiles, and the severe memory constraints of edge nodes. We propose a quantum deep Q-network (Q-DQN) that replaces the multi-layer perceptron in a standard DQN agent with a six-qubit variational quantum circuit (VQC) employing ring-topology entanglement and angle embedding. The total trainable parameter count follows the closed-form expression |ϕ|=12L+7n, growing at only seven parameters per additional network node. On a 10-node heterogeneous topology with stochastic link failures, Q-DQN achieves an average end-to-end delay of 54.29±1.72 ms with only 106 parameters, a 49.6× reduction relative to the MLP-based DQN baseline (5258 parameters, 52.89±2.67 ms). A three-seed scalability evaluation across n∈{6,8,10,12} nodes shows that under a limited 200-episode training budget DQN converges more consistently, while Q-DQN matches DQN performance under full 500-episode training at a fraction of the parameter cost. Ablation experiments confirm that local-topology entanglement substantially outperforms full-connection alternatives. These results indicate that VQC-based routing agents can match classical counterparts at a fraction of the parameter cost, providing a path toward ultra-lightweight intelligent routing in 6G edge deployments.
The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.
While 5G is being deployed worldwide, 6G is receiving increasing attention from researchers to meet the growing demand for higher data rates, lower latency, higher density, and seamless communications worldwide. To meet the stringent requirements of 6G wireless communications networks, AI-integrated communications have become an indispensable part of supporting 6G systems with intelligence, automation, and big data training capabilities. However, traditional artificial intelligence (AI) systems are difficult to meet the stringent latency and high throughput requirements of 6G with limited resources. In this article, we summarize, analyze, discuss the potential, and benefits of Quantum Reinforcement Learning (QRL) in 6G. As an example, we show the superiority of QRL in dynamic spectrum access compared to the conventional Deep Reinforcement Learning (DRL) approach. In addition, we provide an overview of what DRL has accomplished in 6G and its challenges and limitations. From there, we introduce QRL and potential research directions that should continue to be of interest in 6G. To the best of our knowledge, this is the first review and vision article on QRL for 6G wireless communication networks.
The significant rise in wireless communication, driven by sixth-generation (6G) networks, underscores the urgent need for innovative resource allocation methods to achieve efficiency, scalability, and reliability. This survey explores the integration of Quantum Deep Reinforcement Learning (QDRL) as a strategy to address the challenges posed by dynamic and complex wireless environments. By leveraging quantum computing features such as superposition and entanglement, QDRL enhances computational efficiency and mitigates the scalability limitations of classical and deep reinforcement learning (DRL) in high-dimensional optimization. The study reviews recent QDRL approaches for key resource allocation tasks, including power distribution, user scheduling, and channel assignment, and examines quantum algorithms such as the Quantum Approximate Optimization Algorithm (QAOA) and Quantum Neural Networks (QNN) for improved decision-making in wireless systems. Furthermore, it emphasizes the connection between quantum computing and DRL, highlighting hybrid architectures that balance computational cost, energy efficiency, and scalability. Finally, the survey identifies research gaps and outlines future directions, paving the way for robust QDRL strategies to support next-generation wireless networks.