This paper addresses the dual challenges of stabilizing entanglement scheduling and maximizing communication fidelity in multi-hop quantum networks under adversarial dynamics. Unlike prior works relying on stationary assumptions or perfect pre-decision knowledge, we consider scenarios where entanglement generation rates and task arrival patterns vary arbitrarily over time, with only bandit feedback available postscheduling. We first propose Q–NSO, achieving stability for quantum networks under arbitrary time-varying entanglement request arrival rates and bandit feedback. Equipped with the key components of Q-NSO, we propose Q-UMO, a learning-based framework towards maximal utility by determining the entanglement request arrivals and quantum link allocation distribution. Integrating adversarial bandit convex optimization, an online learning algorithm, and Lyapunov drift-plus-penalty analysis, theoretical analysis demonstrates that Q-UMO ensures network stability with bounded queue lengths while achieving a sub-linear regret bound against the reference policy. This work provides a robust foundation for scalable quantum internet applications, balancing stability and performance in adversarial environments with limited feedback.
This paper addresses the dual challenges of stabilizing entanglement scheduling and maximizing communication fidelity in multi-hop quantum networks under adversarial dynamics. Unlike prior works relying on stationary assumptions or perfect pre-decision knowledge, we consider scenarios where entanglement generation rates and task arrival patterns vary arbitrarily over time, with only bandit feedback available postscheduling. We first propose Q–NSO, achieving stability for quantum networks under arbitrary time-varying entanglement request arrival rates and bandit feedback. Equipped with the key components of Q-NSO, we propose Q-UMO, a learning-based framework towards maximal utility by determining the entanglement request arrivals and quantum link allocation distribution. Integrating adversarial bandit convex optimization, an online learning algorithm, and Lyapunov drift-plus-penalty analysis, theoretical analysis demonstrates that Q-UMO ensures network stability with bounded queue lengths while achieving a sub-linear regret bound against the reference policy. This work provides a robust foundation for scalable quantum internet applications, balancing stability and performance in adversarial environments with limited feedback.
Quantum Data Networks (QDNs) have emerged as a promising framework in the field of information processing and transmission, harnessing the principles of quantum mechanics. QDNs utilize a quantum teleportation technique through long-distance entanglement connections, encoding data information in quantum bits (qubits). Despite being a cornerstone in various quantum applications, quantum entanglement encounters challenges in establishing connections over extended distances due to probabilistic processes influenced by factors like optical fiber losses. The creation of long-distance entanglement connections between quantum computers involves multiple entanglement links and entanglement swapping techniques through successive quantum nodes, including quantum computers and quantum repeaters, necessitating optimal path selection and qubit allocation. Current research predominantly assumes known success rates of entanglement links between neighboring quantum nodes and overlooks potential network attackers. This paper addresses the online challenge of optimal path selection and qubit allocation, aiming to learn the best strategy for achieving the highest success rate of entanglement connections between two chosen quantum computers without prior knowledge of the success rate and in the presence of a QDN attacker. The proposed approach is based on multi-armed bandits, specifically adversarial group neural bandits, which treat each path as a group and view qubit allocation as arm selection. Our contributions encompass formulating an online adversarial optimization problem, introducing the EXPNeuralUCB bandits algorithm with theoretical performance guarantees, and conducting comprehensive simulations to showcase its superiority over established advanced algorithms.
Abstract Entanglement-based quantum networks require intelligent routing mechanisms that not only maximize fidelity and connectivity but also ensure service differentiation under varying traffic conditions. In this work, we propose a novel QoS-aware traffic modeling and scheduling framework integrated into a reinforcement learning-based quantum routing agent. Unlike prior approaches that assume deterministic or uniform request arrival patterns, our model introduces stochastic and bursty traffic scenarios using Erlang and ON/OFF distributions to emulate realistic quantum workloads. Each entanglement request is assigned a set of QoS attributes, including fidelity requirements, time-to-live constraints, and priority levels. We then extend the reward function of the agent to consider deadline compliance and resource efficiency in addition to fidelity. Through simulation, we compare the proposed method against state-of-the-art baselines, including DQRA and Proactive RL, under both best-effort and QoS-prioritized scheduling modes. Results demonstrate that our approach maintains higher success rates and lower latency for high-priority requests, while preserving entanglement fidelity and efficient resource allocation across varying network loads. This study highlights the importance of integrating QoS mechanisms into quantum routing to support scalable and differentiated quantum services
In this paper, we consider the problem of optimal scheduling for quantum switches with dynamic demand and random entanglement successes. Different from prior results that often focus on (known) fixed entanglement success probabilities, we assume zero prior knowledge about the entanglement success probabilities and allow them to vary from time to time in an adversarial manner. We propose a learning-based algorithm QSSoftMW based on the framework developed in [1], which combines adversarial learning and Lyapunov queue analysis. We show that QSSoftMW is able to automatically adapt to the changing system statistics and ensure quantum switch stability.
Quantum networks must deliver end-to-end entanglement whose fidelity meets application requirements, which typically requires entanglement purification along multi-hop paths. Existing scheduling approaches either purify at the link level or optimize end-to-end fidelity for a static set of requests, and do not capture concurrent requests competing for network resources over time. This paper studies concurrent entanglement purification scheduling in a time-slotted quantum network with heterogeneous links, in which requests compete for link capacity and quantum memories, and each request may be served by multiple parallel paths for increased reliability. We formulate a mixed-integer linear programming (MILP) scheduler that maximizes the number of scheduled requests, with max-min path allocation as a fairness criterion, and develop reinforcement learning (RL) schedulers based on DQN, PPO, and SAC, whose rewards balance request success against Bell-pair consumption. Simulations under varying network load, topologies and target fidelity thresholds show that the RL schedulers achieve the highest success rates, improving on MILP by up to 6% and on Progressive Filling and Greedy heuristics by 16.5% and 19.5% respectively, at the cost of higher Bell pair consumption and the deferral of a small fraction of requests. MILP, in contrast, achieves the highest fairness and the lowest Bell pair consumption in most scenarios.
We propose an adaptive quantum routing protocol designed for dynamic network topologies in which link fidelity and availability vary stochastically over time. By introducing a novel Link Stability Metric that integrates predictive fidelity estimation with historical reliability analysis, the protocol can make real-time routing decisions that balance communication quality, latency and quantum resource consumption. The routing problem is formulated as a Markov Decision Process and solved using a deep reinforcement learning (RL) framework, enabling intelligent entanglement path selection and adaptive switching in response to channel degradation. We derive a fundamental bound on achievable end-to-end fidelity in dynamic quantum networks and provide convergence guarantees for the learning-based policy. Extensive simulations on scale-free and random geometric networks demonstrate significant improvements in success probability, fidelity and latency compared with state-of-the-art benchmarks, validating the theoretical analysis and showing the potential of adaptive learning approaches for robust, scalable quantum internetworking.
We introduce a distributed resource allocation framework for the Quantum Internet that relies on feedback-based, fully decentralized coordination to serve multiple co-existing applications. We develop quantum network control algorithms under the mathematical framework of Quantum Network Utility Maximization (QNUM), where utility functions quantify network performance by mapping entanglement rate and quality into a joint optimization objective. We then introduce QPrimal-Dual, a decentralized, scalable algorithm that solves QNUM by strategically placing network controllers that operate using local state information and limited classical message exchange. We prove global asymptotic stability for concave, separable utility functions, and provide sufficient conditions for local stability for broader non-concave cases. To reduce control overhead and account for quantum memory decoherence, we also propose schemes that locally approximate global quantities and prevent congestion in the network. We evaluate the performance of our approach via simulations in realistic quantum network architectures. Results show that QPrimalDual significantly outperforms baseline allocation strategies, scales with network size, and is robust to latency and decoherence. Our observations suggest that QPrimalDual could be a practical, high-performance foundation for fully distributed resource allocation in quantum networks.