Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

IEEE Transactions on Network Science and Engineering

Quantum Deep Reinforcement Learning for Digital Twin-Enabled 6G Networks and Semantic Communications: Considerations for Adoption and Security

Bhaskara Narottama, Abrar Ul Haq, James Adu Ansere, Nidhi Simmons, Berk Canberk, Simon L. Cotton, Hyundong Shin, Trung Q. Duong

Published Sep 11, 2025• 22 citations
Publisher

Abstract

Recently, quantum deep reinforcement learning (Q-DRL) has started to gain attention as a potential approach for tackling complex challenges in wireless communication systems. In particular, Q-DRL, integrating quantum operations into deep learning models, can effectively handle dynamic environments and process large-scale optimizations. As future wireless networks continue to evolve, greater emphasis is being placed on context and meaning rather than raw data. New paradigms, such as semantic communications (SemComs) are essential to effectively convey meaning between transmitters and receivers. By linking SemComs with Q-DRL, future wireless networks will be capable of large-scale extractions and decoding of meaning, thereby minimizing reliance on complete context sharing between communicating parties. Together with SemComs, digital twins (DTs) have been considered as key enablers for future wireless networks. As virtual replicas of physical networks, they serve an important role in network operation, optimization, and control. In this regard, Q-DRL will also be highly beneficial for DTs in enhancing critical functions such as data management and security. This study offers fresh outlooks on how to leverage Q-DRL for SemComs in future wireless networks, augmented by the use of DTs.

DOI
10.1109/tnse.2025.3609198

Related papers

A Survey of Quantum Deep Reinforcement Learning for Resource Allocation in Future Wireless Networks

Ni Made Erma Pratiwi Astiti, Byung Moo Lee

The significant rise in wireless communication, driven by sixth-generation (6G) networks, underscores the urgent need for innovative resource allocation methods to achieve efficiency, scalability, and reliability. This survey explores the integration of Quantum Deep Reinforcement Learning (QDRL) as a strategy to address the challenges posed by dynamic and complex wireless environments. By leveraging quantum computing features such as superposition and entanglement, QDRL enhances computational efficiency and mitigates the scalability limitations of classical and deep reinforcement learning (DRL) in high-dimensional optimization. The study reviews recent QDRL approaches for key resource allocation tasks, including power distribution, user scheduling, and channel assignment, and examines quantum algorithms such as the Quantum Approximate Optimization Algorithm (QAOA) and Quantum Neural Networks (QNN) for improved decision-making in wireless systems. Furthermore, it emphasizes the connection between quantum computing and DRL, highlighting hybrid architectures that balance computational cost, energy efficiency, and scalability. Finally, the survey identifies research gaps and outlines future directions, paving the way for robust QDRL strategies to support next-generation wireless networks.

IEEE Communications Surveys & Tutorials•Nov 28, 2025•16 citations

Quantum Reinforcement Learning for 6G and Beyond Wireless Networks

Dinh-Hieu Tran, Thai Duong Nguyen, Thanh D. Nguyen +10 more

While 5G is being deployed worldwide, 6G is receiving increasing attention from researchers to meet the growing demand for higher data rates, lower latency, higher density, and seamless communications worldwide. To meet the stringent requirements of 6G wireless communications networks, AI-integrated communications have become an indispensable part of supporting 6G systems with intelligence, automation, and big data training capabilities. However, traditional artificial intelligence (AI) systems are difficult to meet the stringent latency and high throughput requirements of 6G with limited resources. In this article, we summarize, analyze, discuss the potential, and benefits of Quantum Reinforcement Learning (QRL) in 6G. As an example, we show the superiority of QRL in dynamic spectrum access compared to the conventional Deep Reinforcement Learning (DRL) approach. In addition, we provide an overview of what DRL has accomplished in 6G and its challenges and limitations. From there, we introduce QRL and potential research directions that should continue to be of interest in 6G. To the best of our knowledge, this is the first review and vision article on QRL for 6G wireless communication networks.

arXiv:2511.01070•Nov 2, 2025•4 citations

Towards Quantum-Enabled 6G Slicing

Farhad Rezazadeh, Sarang Kahvazadeh, Mohammadreza Mosahebfard

The quantum machine learning (QML) paradigms and their synergies with network slicing can be envisioned to be a disruptive technology on the cusp of entering to era of sixth-generation (6G), where the mobile communication systems are underpinned in the form of advanced tenancy-based digital use-cases to meet different service requirements. To overcome the challenges of massive slices such as handling the increased dynamism, heterogeneity, amount of data, extended training time, and variety of security levels for slice instances, the power of quantum computing pursuing a distributed computation and learning can be deemed as a promising prerequisite. In this intent, we propose a cloud-native federated learning framework based on quantum deep reinforcement learning (QDRL) where distributed decision agents deployed as micro-services at the edge and cloud through Kubernetes infrastructure then are connected dynamically to the radio access network (RAN). Specifically, the decision agents leverage the remold of classical deep reinforcement learning (DRL) algorithm into variational quantum circuits (VQCs) to obtain the optimal cooperative control on slice resources. The initial numerical results show that the proposed federated QDRL (FQDRL) scheme provides comparable performance than benchmark solutions and reveals the quantum advantage in parameter reduction. To the best of our knowledge, this is the first exploratory study considering an FQDRL approach for 6G communication network.

arXiv:2212.11755•Oct 21, 2022•2 citations

Quantum Fusion Learning for 6G Networks With Kolmogorov–Arnold Networks

Usama Inam Paracha, Uman Khalid, Syed Muhammad Abuzar Rizvi +3 more

Driven by the vision of intelligent and adaptive connectivity in the sixth-generation (6G) networks, future wireless systems are expected to support advanced applications such as cognitive resource allocation, semantic communication (SC), and low-latency integrated sensing and communication (ISAC) or digital twins. However, realizing these capabilities requires learning frameworks capable of efficiently modeling complex, high-dimensional, and dynamic communication environments. To address this challenge, we propose a Kolmogorov-Arnold network (KAN)-enhanced quantum fusion learning (QFL) model designed to advance intelligent wireless communication systems. Specifically, we introduce a hybrid quantum-classical (HQC) architecture that integrates parametrized quantum circuits with deep learning (DL) models based on residual networks (ResNets) and shifted window transformers (SwinTs), further augmented with KAN layers. This HQC framework potentially addresses the limitations of conventional DL (ResNets/SwinTs) by accurately modeling nonlinear relationships, capturing high-order dependencies, and flexibly adapting to dynamic wireless environments. We evaluate the proposed QFL framework on three representative 6G tasks: 1) satellite remote-sensing scene classification (RSSCN7 dataset), 2) ISAC beamforming prediction (DeepSense 6G dataset)—which supports cognition-level resource allocation and low-latency ISAC—and 3) generative SC classification (GenSC-6G dataset)—relevant to semantic environment modeling and digital twin updates. Numerical results demonstrate that the designed QFL architecture delivers competitive performance, underscoring its potential for enabling intelligent and secure 6G systems.

IEEE Transactions on Network Science and Engineering•Jan 1, 2026•0 citations

Quantum-Inspired Deep Reinforcement Learning Framework for Secure, Energy-Efficient Resource Optimization in Next-Generation Quantum Communication Networks

Thanuja R, Dr. Jaswant Kumar Khatik, S. Hemajothi +3 more

Quantum communication networks are a revolutionary approach to secure data transmission using quantum mechanics like entanglement and quantum key distribution. Nonetheless, the evolution of the quantum network infrastructure creates substantial problems related to secure data transmission, energy reduction, and efficient management of scarce quantum resources. The inefficiency of traditional approaches that show little flexibility regarding quantum channel dynamics and different traffic patterns leads to low communication efficiency and high operational cost. To address these limitations, this study proposes a Quantum-Inspired Energy-Aware Secure Deep Reinforcement Optimization (QESDRO) framework. The proposed method is combining the quantum-inspired evolutionary optimization with the Deep Reinforcement Learning (DRL) to achieve intelligent routing, adaptive resource allocation, and energy-aware security management in quantum communication networks. Quantuminspired operators is improving global exploration, while the DRL agent is learning optimal routing and scheduling policies, which is based on channel fidelity, energy availability, congestion levels, and security risks. A multi-objective reward mechanism simultaneously maximizes quantum transmission fidelity, minimizes latency and energy consumption, and is strengthening communication resilience against the malicious attacks. Experimental evaluation is showing that QESDRO is achieving 98.9% communication reliability, 97.5% secure routing accuracy, and 96.6% resource utilization efficiency, while it is reducing energy consumption to 52 J and transmission latency to 18 ms when it is compared with the Conventional optimization approaches. These results are confirming the effectiveness of the proposed framework in simultaneously enhancing communication security, operational efficiency, and energy-aware resource management for the next-generation quantum communication networks.

International Conference on Networks, Computers and Communications (ICNCCom)•Jul 1, 2026•0 citations

Quantum Reinforcement Learning for UAV-Enhanced Next-Generation Wireless Communications

Annisa Anggun Puspitasari, Byung Moo Lee

The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.

IEEE Communications Surveys & Tutorials•Nov 14, 2025•6 citations
Recently, quantum deep reinforcement learning (Q-DRL) has started to gain attention as a potential approach for tackling complex challenges in wireless communication systems. In particular, Q-DRL, integrating quantum operations into deep learning models, can effectively handle dynamic environments and process large-scale optimizations. As future wireless networks continue to evolve, greater emphasis is being placed on context and meaning rather than raw data. New paradigms, such as semantic communications (SemComs) are essential to effectively convey meaning between transmitters and receivers. By linking SemComs with Q-DRL, future wireless networks will be capable of large-scale extractions and decoding of meaning, thereby minimizing reliance on complete context sharing between communicating parties. Together with SemComs, digital twins (DTs) have been considered as key enablers for future wireless networks. As virtual replicas of physical networks, they serve an important role in network operation, optimization, and control. In this regard, Q-DRL will also be highly beneficial for DTs in enhancing critical functions such as data management and security. This study offers fresh outlooks on how to leverage Q-DRL for SemComs in future wireless networks, augmented by the use of DTs.
The significant rise in wireless communication, driven by sixth-generation (6G) networks, underscores the urgent need for innovative resource allocation methods to achieve efficiency, scalability, and reliability. This survey explores the integration of Quantum Deep Reinforcement Learning (QDRL) as a strategy to address the challenges posed by dynamic and complex wireless environments. By leveraging quantum computing features such as superposition and entanglement, QDRL enhances computational efficiency and mitigates the scalability limitations of classical and deep reinforcement learning (DRL) in high-dimensional optimization. The study reviews recent QDRL approaches for key resource allocation tasks, including power distribution, user scheduling, and channel assignment, and examines quantum algorithms such as the Quantum Approximate Optimization Algorithm (QAOA) and Quantum Neural Networks (QNN) for improved decision-making in wireless systems. Furthermore, it emphasizes the connection between quantum computing and DRL, highlighting hybrid architectures that balance computational cost, energy efficiency, and scalability. Finally, the survey identifies research gaps and outlines future directions, paving the way for robust QDRL strategies to support next-generation wireless networks.
While 5G is being deployed worldwide, 6G is receiving increasing attention from researchers to meet the growing demand for higher data rates, lower latency, higher density, and seamless communications worldwide. To meet the stringent requirements of 6G wireless communications networks, AI-integrated communications have become an indispensable part of supporting 6G systems with intelligence, automation, and big data training capabilities. However, traditional artificial intelligence (AI) systems are difficult to meet the stringent latency and high throughput requirements of 6G with limited resources. In this article, we summarize, analyze, discuss the potential, and benefits of Quantum Reinforcement Learning (QRL) in 6G. As an example, we show the superiority of QRL in dynamic spectrum access compared to the conventional Deep Reinforcement Learning (DRL) approach. In addition, we provide an overview of what DRL has accomplished in 6G and its challenges and limitations. From there, we introduce QRL and potential research directions that should continue to be of interest in 6G. To the best of our knowledge, this is the first review and vision article on QRL for 6G wireless communication networks.
The quantum machine learning (QML) paradigms and their synergies with network slicing can be envisioned to be a disruptive technology on the cusp of entering to era of sixth-generation (6G), where the mobile communication systems are underpinned in the form of advanced tenancy-based digital use-cases to meet different service requirements. To overcome the challenges of massive slices such as handling the increased dynamism, heterogeneity, amount of data, extended training time, and variety of security levels for slice instances, the power of quantum computing pursuing a distributed computation and learning can be deemed as a promising prerequisite. In this intent, we propose a cloud-native federated learning framework based on quantum deep reinforcement learning (QDRL) where distributed decision agents deployed as micro-services at the edge and cloud through Kubernetes infrastructure then are connected dynamically to the radio access network (RAN). Specifically, the decision agents leverage the remold of classical deep reinforcement learning (DRL) algorithm into variational quantum circuits (VQCs) to obtain the optimal cooperative control on slice resources. The initial numerical results show that the proposed federated QDRL (FQDRL) scheme provides comparable performance than benchmark solutions and reveals the quantum advantage in parameter reduction. To the best of our knowledge, this is the first exploratory study considering an FQDRL approach for 6G communication network.
Driven by the vision of intelligent and adaptive connectivity in the sixth-generation (6G) networks, future wireless systems are expected to support advanced applications such as cognitive resource allocation, semantic communication (SC), and low-latency integrated sensing and communication (ISAC) or digital twins. However, realizing these capabilities requires learning frameworks capable of efficiently modeling complex, high-dimensional, and dynamic communication environments. To address this challenge, we propose a Kolmogorov-Arnold network (KAN)-enhanced quantum fusion learning (QFL) model designed to advance intelligent wireless communication systems. Specifically, we introduce a hybrid quantum-classical (HQC) architecture that integrates parametrized quantum circuits with deep learning (DL) models based on residual networks (ResNets) and shifted window transformers (SwinTs), further augmented with KAN layers. This HQC framework potentially addresses the limitations of conventional DL (ResNets/SwinTs) by accurately modeling nonlinear relationships, capturing high-order dependencies, and flexibly adapting to dynamic wireless environments. We evaluate the proposed QFL framework on three representative 6G tasks: 1) satellite remote-sensing scene classification (RSSCN7 dataset), 2) ISAC beamforming prediction (DeepSense 6G dataset)—which supports cognition-level resource allocation and low-latency ISAC—and 3) generative SC classification (GenSC-6G dataset)—relevant to semantic environment modeling and digital twin updates. Numerical results demonstrate that the designed QFL architecture delivers competitive performance, underscoring its potential for enabling intelligent and secure 6G systems.
Quantum communication networks are a revolutionary approach to secure data transmission using quantum mechanics like entanglement and quantum key distribution. Nonetheless, the evolution of the quantum network infrastructure creates substantial problems related to secure data transmission, energy reduction, and efficient management of scarce quantum resources. The inefficiency of traditional approaches that show little flexibility regarding quantum channel dynamics and different traffic patterns leads to low communication efficiency and high operational cost. To address these limitations, this study proposes a Quantum-Inspired Energy-Aware Secure Deep Reinforcement Optimization (QESDRO) framework. The proposed method is combining the quantum-inspired evolutionary optimization with the Deep Reinforcement Learning (DRL) to achieve intelligent routing, adaptive resource allocation, and energy-aware security management in quantum communication networks. Quantuminspired operators is improving global exploration, while the DRL agent is learning optimal routing and scheduling policies, which is based on channel fidelity, energy availability, congestion levels, and security risks. A multi-objective reward mechanism simultaneously maximizes quantum transmission fidelity, minimizes latency and energy consumption, and is strengthening communication resilience against the malicious attacks. Experimental evaluation is showing that QESDRO is achieving 98.9% communication reliability, 97.5% secure routing accuracy, and 96.6% resource utilization efficiency, while it is reducing energy consumption to 52 J and transmission latency to 18 ms when it is compared with the Conventional optimization approaches. These results are confirming the effectiveness of the proposed framework in simultaneously enhancing communication security, operational efficiency, and energy-aware resource management for the next-generation quantum communication networks.
The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.