Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2606.14908 · Quantum Science and Technology

Optimizing Entanglement Distillation Policies via Markov Decision Process Formulation

Jigyen Bhavsar, Rajni Bala, Siddhartha Santra

quant-phSubmitted Jun 12, 2026• Announced Jun 16, 2026• 0 citations• Revised Jul 3, 2026 (v2)
v1 · Jun 12, 2026v2 · Jul 3, 2026
arXivHTMLPDF

Abstract

Entanglement distillation is a fundamental operation in quantum information processing used to obtain higher-fidelity entangled pairs from a supply of less entangled quantum states using local operations aided by classical communication (LOCC). In a physically relevant setting, where states with an initial fidelity of $f_0$, probabilistically generated over multiple, $m$, memory pairs distributed between two parties, Alice and Bob, are pairwise distilled, the optimal policy identifies the system-configuration dependent sequence of entanglement generation and distillation operations that need to be performed in order to minimize the expected time to reach some target fidelity $f_T>f_0$. Here, we formulate and systematically analyze this task as a Markov decision problem and using a value iteration algorithm, obtain optimal deterministic policies that minimize the expected waiting time required to reach a target fidelity. Our results show that the expected waiting time under the optimal policy decreases with increasing generation probability $p$ and number of quantum memories $m$ - as expected. In contrast, it exhibits non-monotonic behavior with respect to $f_0$ for a fixed fidelity gap, $(Δf = f_T-f_0)$. While the optimal policy consistently outperforms baseline policies such as the greedy, nested and entanglement pumping policies, its relative advantage is regime-dependent, being determined by the system parameters ($p,f_0,f_T,m$), and exhibits a nontrivial dependence on the fidelity gap $Δf$. Our results highlight the value of formulating entanglement distillation as a Markov decision problem, enabling the systematic design of policies that achieve target fidelity thresholds for quantum information tasks in realistic resource-constrained settings.

Related papers

Optimal Entanglement Distillation Policies for Quantum Switches

Vivek Kumar, Nitish Kumar Chandra, Kaushik P. Seshadreesan +2 more

The quantum switch is a vital component for the development of the quantum internet. In an entanglement distribution network, the function of a quantum switch is to generate elementary entanglement with its clients followed by entanglement swapping to distribute end-to-end entanglement of sufficiently high fidelity between clients. The threshold on entanglement fidelity is any quality of service requirement specified by the clients as dictated by the application they run on the network. We consider a discrete time model for a quantum switch that attempts generation of fresh elementary entanglement with clients in each time step in the form of maximally entangled qubit pairs, or Bell pairs, which succeed probabilistically; the successfully generated Bell pairs are stored in noisy quantum memories until they can be swapped. We focus on establishing the value of entanglement distillation of the stored Bell pairs prior to entanglement swapping in presence of their inevitable aging, i.e., decoherence: For a simple instance of a switch with two clients, an exponential decay of entanglement fidelity, and a wellknown probabilistic but heralded two-to-one distillation protocol, given a threshold end-to-end entanglement fidelity, we use the Markov Decision Processes framework to identify the optimal action policy - to wait, to distill, or to swap that maximizes throughput. We compare the switch's performance under the optimal distillation-enabled policy with that excluding distillation. Simulations of the two policies demonstrate the improvements that are possible in principle via optimal use of distillation with respect to average throughput, average fidelity and jitter of end-to-end entanglement, as functions of fidelity threshold. Our model thus helps capture the role of entanglement distillation in mitigating the effects of decoherence in a quantum switch in an entanglement distribution network, adding to the growing literature on quantum switches.

arXiv:2305.06804•IEEE International Conference on Quantum Computing and Engineering (QCE)•Sep 17, 2023•12 citations

Adaptive Policies for Resource Generation in a Quantum Network

Aksel Tacettin, Qu, Tianchen, Bethany Davies +3 more

Protocols for distributed quantum systems commonly require the simultaneous availability of $n$ entangled states, each with a fidelity above some fixed minimum $F_{\mathrm{app}}$ relative to the target maximally-entangled state. However, the fidelity of entangled states degrades over time while in memory. Entangled states are therefore rendered useless when their fidelity falls below $F_{\mathrm{app}}$. This is problematic when entanglement generation is probabilistic and attempted in a sequential manner, because the expected completion time until $n$ entangled states are available can be large. Motivated by existing entanglement generation schemes, we consider a system where the entanglement generation parameters (the success probability $p$ and fidelity $F$ of the generated entangled state) may be adjusted at each time step. We model the system as a Markov decision process, where the policy dictates which generation parameters $(p,F)$ to use for each attempt. We use dynamic programming to derive optimal policies that minimise the expected time until $n$ entangled states are available with fidelity greater than $F_{\mathrm{app}}$. We observe that the advantage of our optimal policies over the selected baselines increases significantly with $n$. In the parameter regimes explored, which are based closely on current experiments, we find that the optimal policy can provide a speed-up of as much as a factor of twenty over a constant-action policy. In addition, we propose a computationally inexpensive heuristic method to compute policies that perform either optimally or near-optimally in the parameter regimes explored. Our heuristic method can be used to find high-performing policies in parameter regimes where finding an optimal policy is intractable.

arXiv:2509.17576•Sep 22, 2025•1 citation

Entanglement Distillation and Swapping Scheduling in Quantum Repeaters with Noisy Memories

Siddharth Chander, Xinan Chen, Allen Zang

Entanglement distillation and entanglement swapping have been extensively studied assuming perfect quantum memories. However, near-term quantum networks will be fundamentally limited by quantum memories with a finite coherence time, resulting in complex choices for the timing and ordering of these operations. In this work, we study entanglement distillation and entanglement swapping at the level of the elementary building blocks of noisy quantum repeater networks, with the goal of elucidating the fundamental tradeoffs induced by memory decoherence. First, we focus on a minimal one-hop setting, where we analytically compare ``distill-as-soon-as-possible'' and ``distill-as-late-as-possible'' strategies against a baseline strategy that simply discards the older entangled state. We find that in the low memory coherence time regime, discarding the older entangled state achieves higher expected output fidelity, while in the high coherence time regime, delaying distillation until the end achieves the highest expected output fidelity and, over most of the deadline range, the highest weighted coherent information, at the expense of a lower success probability. We then extend our analysis to two-hop repeater chains using Monte Carlo simulation. In this setting, we find that the highest weighted coherent information is achieved by strategies that defer distillation to the end of the time window, with \textsf{Distill-ALAP-then-Swap-ALAP} and \textsf{Swap-ASAP-then-Distill-ALAP} leading at different operating points, while \textsf{Discard-Oldest-then-Swap} never reaches positive weighted coherent information in any regime tested. Together, these results clarify how decoherence reshapes the optimal operation timing in quantum networks and provide instructive insights into the link-level principles that govern larger-scale architectures.

quant-pharXiv:2607.24557•Jul 28, 2026•0 citations

Advantages of Global Entanglement-Distillation Policies in Quantum Repeater Chains

Iftach Yakar, Michael Ben-Or

Quantum repeaters are essential for achieving long-distance quantum communication due to photon loss, which grows exponentially with the channel distance. Current quantum repeater generations use entanglement distillation protocols, where the decision of when to perform distillation depends on either local or global knowledge. Recent approaches for quantum repeaters, such as Mantri et al. (arXiv:2409.06152), consider using deterministic local decision policies for entanglement distillation. We ask whether global deterministic policies outperform local ones in terms of communication rate. We simulate equidistant repeater chains, assisted by two-way classical communication, and compare local and global policies for distillation decisions, spanning large distances and varying network and hardware parameters. Our findings show that global deterministic policies consistently outperform these local ones, and in some cases, determine whether secret communication is possible. For large repeater chains ($N>512$), global policies improve SKR by two orders of magnitude. These results suggest that local distillation decisions in quantum repeater chains may not be optimal, and may inform future protocol design.

arXiv:2510.06737•Oct 8, 2025•1 citation

Entanglement distillation in color center quantum networks: evaluating algorithmic thresholds

Alessio Belshi

Achieving high-fidelity state distribution across quantum networks requires mitigating the effects of local hardware imperfections. While purification methods such as entanglement distillation provide a pathway toward higher-fidelity entangled states, they also introduce additional processing latency, exposing stored qubits to memory dephasing. In this work, we present a quantitative framework to model the performance of different distillation sequences under realistic color-center hardware constraints. Our results reveal a hardware-dependent latency floor, beyond which the accumulated errors associated with memory storage and local processing offset the fidelity gains provided by additional purification. This allows us to identify the parameter regimes in which multi-round distillation improves the network performance and those in which its overhead becomes detrimental. Using an optimistic near-term combination of state-of-the-art hardware parameters, we predict Bell-state fidelities above 95% and GHZ-state fidelities exceeding 90%, while maintaining an operational generation rate of approximately 1 Hz. These results indicate that entanglement distillation can already provide high-quality distributed resources in a regime relevant to quantum communication and distributed sensing. Finally, we investigate a more ambitious long-term hardware scenario and identify the combination of memory, gate, readout and spin-photon interface parameters required to achieve Bell and GHZ fidelities of 99.9% and 99.0%, respectively, while maintaining generation rates above 1 Hz. These results outline a possible hardware route toward the high-fidelity network resources required by future fault-tolerant quantum-network architectures, rather than constituting a demonstration of fault-tolerant operation itself.

•Oct 29, 2026•0 citations

On the design and analysis of near-term quantum network protocols using Markov decision processes

Sumeet Khatri

The quantum internet is one of the frontiers of quantum information science. It will revolutionize the way we communicate and do other tasks, and it will allow for tasks that are not possible using the current, classical internet. The backbone of a quantum internet is entanglement distributed globally in order to allow for such novel applications to be performed over long distances. Experimental progress is currently being made to realize quantum networks on a small scale, but much theoretical work is still needed in order to understand how best to distribute entanglement, especially with the limitations of near-term quantum technologies taken into account. This work provides an initial step toward this goal. In this work, we lay out a theory of near-term quantum networks based on Markov decision processes (MDPs), and we show that MDPs provide a precise and systematic mathematical framework to model protocols for near-term quantum networks that is agnostic to the specific implementation platform. We start by simplifying the MDP for elementary links introduced in prior work and by providing new results on policies for elementary links in the steady-state (infinite-time) limit. Then, we show how the elementary link MDP can be used to analyze a complete quantum network protocol. We then provide an extension of the MDP formalism to two elementary links. Here, as new results, we derive linear programing relaxations that allow us to obtain optimal steady-state policies with respect to the expected fidelity and waiting time of the end-to-end link.

arXiv:2207.03403•AVS Quantum Science•Sep 1, 2022•20 citations
Entanglement distillation is a fundamental operation in quantum information processing used to obtain higher-fidelity entangled pairs from a supply of less entangled quantum states using local operations aided by classical communication (LOCC). In a physically relevant setting, where states with an initial fidelity of f0f_0f0​, probabilistically generated over multiple, mmm, memory pairs distributed between two parties, Alice and Bob, are pairwise distilled, the optimal policy identifies the system-configuration dependent sequence of entanglement generation and distillation operations that need to be performed in order to minimize the expected time to reach some target fidelity fT>f0f_T>f_0fT​>f0​. Here, we formulate and systematically analyze this task as a Markov decision problem and using a value iteration algorithm, obtain optimal deterministic policies that minimize the expected waiting time required to reach a target fidelity. Our results show that the expected waiting time under the optimal policy decreases with increasing generation probability ppp and number of quantum memories mmm - as expected. In contrast, it exhibits non-monotonic behavior with respect to f0f_0f0​ for a fixed fidelity gap, (Δf=fT−f0)(Δf = f_T-f_0)(Δf=fT​−f0​). While the optimal policy consistently outperforms baseline policies such as the greedy, nested and entanglement pumping policies, its relative advantage is regime-dependent, being determined by the system parameters (p,f0,fT,mp,f_0,f_T,mp,f0​,fT​,m), and exhibits a nontrivial dependence on the fidelity gap ΔfΔfΔf. Our results highlight the value of formulating entanglement distillation as a Markov decision problem, enabling the systematic design of policies that achieve target fidelity thresholds for quantum information tasks in realistic resource-constrained settings.
The quantum switch is a vital component for the development of the quantum internet. In an entanglement distribution network, the function of a quantum switch is to generate elementary entanglement with its clients followed by entanglement swapping to distribute end-to-end entanglement of sufficiently high fidelity between clients. The threshold on entanglement fidelity is any quality of service requirement specified by the clients as dictated by the application they run on the network. We consider a discrete time model for a quantum switch that attempts generation of fresh elementary entanglement with clients in each time step in the form of maximally entangled qubit pairs, or Bell pairs, which succeed probabilistically; the successfully generated Bell pairs are stored in noisy quantum memories until they can be swapped. We focus on establishing the value of entanglement distillation of the stored Bell pairs prior to entanglement swapping in presence of their inevitable aging, i.e., decoherence: For a simple instance of a switch with two clients, an exponential decay of entanglement fidelity, and a wellknown probabilistic but heralded two-to-one distillation protocol, given a threshold end-to-end entanglement fidelity, we use the Markov Decision Processes framework to identify the optimal action policy - to wait, to distill, or to swap that maximizes throughput. We compare the switch's performance under the optimal distillation-enabled policy with that excluding distillation. Simulations of the two policies demonstrate the improvements that are possible in principle via optimal use of distillation with respect to average throughput, average fidelity and jitter of end-to-end entanglement, as functions of fidelity threshold. Our model thus helps capture the role of entanglement distillation in mitigating the effects of decoherence in a quantum switch in an entanglement distribution network, adding to the growing literature on quantum switches.
Protocols for distributed quantum systems commonly require the simultaneous availability of nnn entangled states, each with a fidelity above some fixed minimum FappF_{\mathrm{app}}Fapp​ relative to the target maximally-entangled state. However, the fidelity of entangled states degrades over time while in memory. Entangled states are therefore rendered useless when their fidelity falls below FappF_{\mathrm{app}}Fapp​. This is problematic when entanglement generation is probabilistic and attempted in a sequential manner, because the expected completion time until nnn entangled states are available can be large. Motivated by existing entanglement generation schemes, we consider a system where the entanglement generation parameters (the success probability ppp and fidelity FFF of the generated entangled state) may be adjusted at each time step. We model the system as a Markov decision process, where the policy dictates which generation parameters (p,F)(p,F)(p,F) to use for each attempt. We use dynamic programming to derive optimal policies that minimise the expected time until nnn entangled states are available with fidelity greater than FappF_{\mathrm{app}}Fapp​. We observe that the advantage of our optimal policies over the selected baselines increases significantly with nnn. In the parameter regimes explored, which are based closely on current experiments, we find that the optimal policy can provide a speed-up of as much as a factor of twenty over a constant-action policy. In addition, we propose a computationally inexpensive heuristic method to compute policies that perform either optimally or near-optimally in the parameter regimes explored. Our heuristic method can be used to find high-performing policies in parameter regimes where finding an optimal policy is intractable.
Entanglement distillation and entanglement swapping have been extensively studied assuming perfect quantum memories. However, near-term quantum networks will be fundamentally limited by quantum memories with a finite coherence time, resulting in complex choices for the timing and ordering of these operations. In this work, we study entanglement distillation and entanglement swapping at the level of the elementary building blocks of noisy quantum repeater networks, with the goal of elucidating the fundamental tradeoffs induced by memory decoherence. First, we focus on a minimal one-hop setting, where we analytically compare ``distill-as-soon-as-possible'' and ``distill-as-late-as-possible'' strategies against a baseline strategy that simply discards the older entangled state. We find that in the low memory coherence time regime, discarding the older entangled state achieves higher expected output fidelity, while in the high coherence time regime, delaying distillation until the end achieves the highest expected output fidelity and, over most of the deadline range, the highest weighted coherent information, at the expense of a lower success probability. We then extend our analysis to two-hop repeater chains using Monte Carlo simulation. In this setting, we find that the highest weighted coherent information is achieved by strategies that defer distillation to the end of the time window, with \textsf{Distill-ALAP-then-Swap-ALAP} and \textsf{Swap-ASAP-then-Distill-ALAP} leading at different operating points, while \textsf{Discard-Oldest-then-Swap} never reaches positive weighted coherent information in any regime tested. Together, these results clarify how decoherence reshapes the optimal operation timing in quantum networks and provide instructive insights into the link-level principles that govern larger-scale architectures.
Quantum repeaters are essential for achieving long-distance quantum communication due to photon loss, which grows exponentially with the channel distance. Current quantum repeater generations use entanglement distillation protocols, where the decision of when to perform distillation depends on either local or global knowledge. Recent approaches for quantum repeaters, such as Mantri et al. (arXiv:2409.06152), consider using deterministic local decision policies for entanglement distillation. We ask whether global deterministic policies outperform local ones in terms of communication rate. We simulate equidistant repeater chains, assisted by two-way classical communication, and compare local and global policies for distillation decisions, spanning large distances and varying network and hardware parameters. Our findings show that global deterministic policies consistently outperform these local ones, and in some cases, determine whether secret communication is possible. For large repeater chains (N>512N>512N>512), global policies improve SKR by two orders of magnitude. These results suggest that local distillation decisions in quantum repeater chains may not be optimal, and may inform future protocol design.
Achieving high-fidelity state distribution across quantum networks requires mitigating the effects of local hardware imperfections. While purification methods such as entanglement distillation provide a pathway toward higher-fidelity entangled states, they also introduce additional processing latency, exposing stored qubits to memory dephasing. In this work, we present a quantitative framework to model the performance of different distillation sequences under realistic color-center hardware constraints. Our results reveal a hardware-dependent latency floor, beyond which the accumulated errors associated with memory storage and local processing offset the fidelity gains provided by additional purification. This allows us to identify the parameter regimes in which multi-round distillation improves the network performance and those in which its overhead becomes detrimental. Using an optimistic near-term combination of state-of-the-art hardware parameters, we predict Bell-state fidelities above 95% and GHZ-state fidelities exceeding 90%, while maintaining an operational generation rate of approximately 1 Hz. These results indicate that entanglement distillation can already provide high-quality distributed resources in a regime relevant to quantum communication and distributed sensing. Finally, we investigate a more ambitious long-term hardware scenario and identify the combination of memory, gate, readout and spin-photon interface parameters required to achieve Bell and GHZ fidelities of 99.9% and 99.0%, respectively, while maintaining generation rates above 1 Hz. These results outline a possible hardware route toward the high-fidelity network resources required by future fault-tolerant quantum-network architectures, rather than constituting a demonstration of fault-tolerant operation itself.
The quantum internet is one of the frontiers of quantum information science. It will revolutionize the way we communicate and do other tasks, and it will allow for tasks that are not possible using the current, classical internet. The backbone of a quantum internet is entanglement distributed globally in order to allow for such novel applications to be performed over long distances. Experimental progress is currently being made to realize quantum networks on a small scale, but much theoretical work is still needed in order to understand how best to distribute entanglement, especially with the limitations of near-term quantum technologies taken into account. This work provides an initial step toward this goal. In this work, we lay out a theory of near-term quantum networks based on Markov decision processes (MDPs), and we show that MDPs provide a precise and systematic mathematical framework to model protocols for near-term quantum networks that is agnostic to the specific implementation platform. We start by simplifying the MDP for elementary links introduced in prior work and by providing new results on policies for elementary links in the steady-state (infinite-time) limit. Then, we show how the elementary link MDP can be used to analyze a complete quantum network protocol. We then provide an extension of the MDP formalism to two elementary links. Here, as new results, we derive linear programing relaxations that allow us to obtain optimal steady-state policies with respect to the expected fidelity and waiting time of the end-to-end link.