Abstract Quantum communication plays a key role in enabling distributed Noisy Intermediate-Scale Quantum (NISQ) systems; however, practical quantum networks are often affected by link fluctuations, limited quantum resources, and entanglement degradation. These factors make reliable routing and scheduling difficult, particularly in large-scale and dynamically changing environments. Classical methods such as Historical Weighted Fidelity Routing (HWFR) and Dynamic Multi-Priority Quantum Scheduling (DMPQS) generally perform well only when network conditions remain stable, and their performance degrades when entanglement success rates vary or relay nodes become congested. A major challenge therefore lies in operating under uncertain and time-varying fidelity conditions. Most existing approaches focus on either routing or scheduling in isolation and do not explicitly consider future fidelity variations, which can lead to inefficient resource usage and increased end-to-end latency. In this work, we propose a Deep Reinforcement Learning-based Quantum Communication Optimization Framework (DRL-QCOF) that jointly addresses routing and scheduling. The framework employs a Bi-LSTM-based Quantum Fidelity Prediction Network (QFPN) to estimate future link fidelity F_"pred" (t)from time-series features including link length, noise coefficient, entanglement success probability, and relay utilization. These predictions are then used by a Deep Reinforcement Learning-based Adaptive Quantum Scheduling Agent (DRAQS-Agent), implemented using an Actor–Critic architecture with a continuous reward formulation, to guide routing and scheduling decisions across distributed nodes. Simulation results indicate that the proposed approach improves the average link fidelity to a maximum of 0.88, compared to 0.78–0.86 achieved by existing methods. The end-to-end latency is reduced from 104 ms to 83 ms, while baseline schemes remain above 110 ms under the same conditions. In addition, the average response time is reduced to approximately 147 ms, resource utilization increases to 71–83%, and the success ratio improves from 93% to 97%, resulting in improved end-to-end reliability. The cumulative reward stabilizes at around 16.0, with convergence observed within 300 training episodes, and the achieved throughput reaches 118–121 entangled pairs per second, confirming the effectiveness of the proposed framework in dynamic NISQ network scenarios.
Abstract Quantum communication plays a key role in enabling distributed Noisy Intermediate-Scale Quantum (NISQ) systems; however, practical quantum networks are often affected by link fluctuations, limited quantum resources, and entanglement degradation. These factors make reliable routing and scheduling difficult, particularly in large-scale and dynamically changing environments. Classical methods such as Historical Weighted Fidelity Routing (HWFR) and Dynamic Multi-Priority Quantum Scheduling (DMPQS) generally perform well only when network conditions remain stable, and their performance degrades when entanglement success rates vary or relay nodes become congested. A major challenge therefore lies in operating under uncertain and time-varying fidelity conditions. Most existing approaches focus on either routing or scheduling in isolation and do not explicitly consider future fidelity variations, which can lead to inefficient resource usage and increased end-to-end latency. In this work, we propose a Deep Reinforcement Learning-based Quantum Communication Optimization Framework (DRL-QCOF) that jointly addresses routing and scheduling. The framework employs a Bi-LSTM-based Quantum Fidelity Prediction Network (QFPN) to estimate future link fidelity F_"pred" (t)from time-series features including link length, noise coefficient, entanglement success probability, and relay utilization. These predictions are then used by a Deep Reinforcement Learning-based Adaptive Quantum Scheduling Agent (DRAQS-Agent), implemented using an Actor–Critic architecture with a continuous reward formulation, to guide routing and scheduling decisions across distributed nodes. Simulation results indicate that the proposed approach improves the average link fidelity to a maximum of 0.88, compared to 0.78–0.86 achieved by existing methods. The end-to-end latency is reduced from 104 ms to 83 ms, while baseline schemes remain above 110 ms under the same conditions. In addition, the average response time is reduced to approximately 147 ms, resource utilization increases to 71–83%, and the success ratio improves from 93% to 97%, resulting in improved end-to-end reliability. The cumulative reward stabilizes at around 16.0, with convergence observed within 300 training episodes, and the achieved throughput reaches 118–121 entangled pairs per second, confirming the effectiveness of the proposed framework in dynamic NISQ network scenarios.
We propose an adaptive quantum routing protocol designed for dynamic network topologies in which link fidelity and availability vary stochastically over time. By introducing a novel Link Stability Metric that integrates predictive fidelity estimation with historical reliability analysis, the protocol can make real-time routing decisions that balance communication quality, latency and quantum resource consumption. The routing problem is formulated as a Markov Decision Process and solved using a deep reinforcement learning (RL) framework, enabling intelligent entanglement path selection and adaptive switching in response to channel degradation. We derive a fundamental bound on achievable end-to-end fidelity in dynamic quantum networks and provide convergence guarantees for the learning-based policy. Extensive simulations on scale-free and random geometric networks demonstrate significant improvements in success probability, fidelity and latency compared with state-of-the-art benchmarks, validating the theoretical analysis and showing the potential of adaptive learning approaches for robust, scalable quantum internetworking.
Quantum computing holds the promise of solving problems difficult for classical computers. However, we are still in the era of Noisy Intermediate-Scale Quantum (NISQ) computers, necessary to establish effective distributed quantum communication protocols to distribute complex quantum computing tasks across different quantum computers for execution. Significant progress has been made in quantum communication technology, particularly in quantum path creation and resource scheduling. The establishment of quantum paths relies on quantum entanglement and quantum relay technologies, achieving long-distance, high-fidelity quantum state transmission through entanglement swapping between multiple relays. However, resources in quantum communication networks are limited and expensive, making efficient resource scheduling strategies crucial for improving overall network efficiency. To address these issues, we design a network protocol that includes the Historical Weighted Fidelity Routing (HWFR) algorithm and the Dynamic Multi-Priority Quantum Scheduling (DMPQS) algorithm to enhance communication reliability across quantum computers. Both algorithms aim to enhance the reliability of quantum links, optimize resource utilization, and adapt to dynamic changes in the links. The former algorithm dynamically selects the optimal path by considering factors such as link length, noise level, entanglement success rate, and quantum relay resource constraints, ensuring high-fidelity and reliable quantum communication. The latter dynamically adjusts request priorities based on the urgency of quantum service requests and fidelity requirements, optimizing resource utilization. Experimental results show that the proposed protocol performs excellently in terms of an average response time of requests and link utilization, effectively improving the utilization efficiency of network resources and the overall performance of the system.
Quantum communication networks are a revolutionary approach to secure data transmission using quantum mechanics like entanglement and quantum key distribution. Nonetheless, the evolution of the quantum network infrastructure creates substantial problems related to secure data transmission, energy reduction, and efficient management of scarce quantum resources. The inefficiency of traditional approaches that show little flexibility regarding quantum channel dynamics and different traffic patterns leads to low communication efficiency and high operational cost. To address these limitations, this study proposes a Quantum-Inspired Energy-Aware Secure Deep Reinforcement Optimization (QESDRO) framework. The proposed method is combining the quantum-inspired evolutionary optimization with the Deep Reinforcement Learning (DRL) to achieve intelligent routing, adaptive resource allocation, and energy-aware security management in quantum communication networks. Quantuminspired operators is improving global exploration, while the DRL agent is learning optimal routing and scheduling policies, which is based on channel fidelity, energy availability, congestion levels, and security risks. A multi-objective reward mechanism simultaneously maximizes quantum transmission fidelity, minimizes latency and energy consumption, and is strengthening communication resilience against the malicious attacks. Experimental evaluation is showing that QESDRO is achieving 98.9% communication reliability, 97.5% secure routing accuracy, and 96.6% resource utilization efficiency, while it is reducing energy consumption to 52 J and transmission latency to 18 ms when it is compared with the Conventional optimization approaches. These results are confirming the effectiveness of the proposed framework in simultaneously enhancing communication security, operational efficiency, and energy-aware resource management for the next-generation quantum communication networks.
With the continuous expansion of quantum communication networks and the increasing diversity of their business types, how to achieve efficient configuration under limited quantum resources has become the key to improving system performance. The quantum resources described in this article mainly include entanglement pairs, quantum bits, and channel capacity. Traditional optimization methods typically rely on precise mathematical models, which are difficult to adapt to dynamically evolving network environments and susceptible to noise interference. Therefore, this study proposes a machine learning based framework for optimizing the allocation of quantum communication resources. This framework integrates deep reinforcement learning and graph neural network technology, enabling collaborative optimization of entanglement allocation, routing selection, and time slice scheduling between nodes. Three typical quantum communication scenarios were constructed and tested in a simulation environment, including static topology, dynamic links, and high noise environments. The proposed method was compared and analyzed with integer linear programming, heuristic greedy algorithms, and rule-based strategies. Experimental data shows that this research method achieved an improvement of approximately 12% to 18% in average fidelity retention, a 15% to 22% increase in resource utilization, and a 20% reduction in latency. This study provides useful reference for the intelligent resource management of large-scale quantum networks in the future.
Abstract Entanglement-based quantum networks require intelligent routing mechanisms that not only maximize fidelity and connectivity but also ensure service differentiation under varying traffic conditions. In this work, we propose a novel QoS-aware traffic modeling and scheduling framework integrated into a reinforcement learning-based quantum routing agent. Unlike prior approaches that assume deterministic or uniform request arrival patterns, our model introduces stochastic and bursty traffic scenarios using Erlang and ON/OFF distributions to emulate realistic quantum workloads. Each entanglement request is assigned a set of QoS attributes, including fidelity requirements, time-to-live constraints, and priority levels. We then extend the reward function of the agent to consider deadline compliance and resource efficiency in addition to fidelity. Through simulation, we compare the proposed method against state-of-the-art baselines, including DQRA and Proactive RL, under both best-effort and QoS-prioritized scheduling modes. Results demonstrate that our approach maintains higher success rates and lower latency for high-priority requests, while preserving entanglement fidelity and efficient resource allocation across varying network loads. This study highlights the importance of integrating QoS mechanisms into quantum routing to support scalable and differentiated quantum services
Efficient and scalable quantum key scheduling remains a critical challenge in trusted-relay Quantum Key Distribution (QKD) networks due to imbalanced key resource utilization, dynamic key consumption, and topology-induced congestion. This paper presents a Q-learning-based adaptive routing framework designed to optimize quantum key delivery in dynamic QKD networks. The model formulates routing as a Markov Decision Process, with a compact state representation that combines the current node, destination node, and discretized key occupancy levels. The reward function is designed to jointly penalize resource imbalance and rapid key depletion while promoting traversal through links with sustainable key generation, guiding the agent toward balanced and congestion-aware decisions. Simulation results demonstrate that the Q-learning scheduler outperforms non-adaptive baseline algorithms, achieving an average distribution time of approximately 100 s compared with 170–590 s for the baseline algorithms, a throughput of 61 keys/s compared with 32–55 keys/s, and a failure ratio limited to 0–0.1, demonstrating superior scalability, congestion resilience, and resource-efficient decision-making in dynamic QKD networks.