Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2212.11651 · Physical Review Letters

Approximate Autonomous Quantum Error Correction with Reinforcement Learning

Ye‐Xiong Zeng, Zheng-Yang Zhou, Enrico Rinaldi, Clemens Gneiting, Franco Nori

Published Jul 31, 2023• 57 citations
arXivHTMLPDF

Abstract

Autonomous quantum error correction (AQEC) protects logical qubits by engineered dissipation and thus circumvents the necessity of frequent, error-prone measurement-feedback loops. Bosonic code spaces, where single-photon loss represents the dominant source of error, are promising candidates for AQEC due to their flexibility and controllability. While existing proposals have demonstrated the in-principle feasibility of AQEC with bosonic code spaces, these schemes are typically based on the exact implementation of the Knill-Laflamme conditions and thus require the realization of Hamiltonian distances d≥2. Implementing such Hamiltonian distances requires multiple nonlinear interactions and control fields, rendering these schemes experimentally challenging. Here, we propose a bosonic code for approximate AQEC by relaxing the Knill-Laflamme conditions. Using reinforcement learning (RL), we identify the optimal bosonic set of code words (denoted here by RL code), which, surprisingly, is composed of the Fock states |2⟩ and |4⟩. As we show, the RL code, despite its approximate nature, successfully suppresses single-photon loss, reducing it to an effective dephasing process that well surpasses the break-even threshold. It may thus provide a valuable building block toward full error protection. The error-correcting Hamiltonian, which includes ancilla systems that emulate the engineered dissipation, is entirely based on the Hamiltonian distance d=1, significantly reducing model complexity. Single-qubit gates are implemented in the RL code with a maximum distance d_{g}=2.

DOI
10.1103/physrevlett.131.050601

Related papers

Discovering autonomous quantum error correction via deep reinforcement learning

Yue Yin, Tailong Xiao, Xiaoyang Deng +3 more

Quantum error correction is essential for fault-tolerant quantum computing. However, standard methods relying on active measurements may introduce additional errors. Autonomous quantum error correction (AQEC) circumvents this by utilizing engineered dissipation and drives in bosonic systems, but identifying practical encoding remains challenging due to stringent Knill-Laflamme conditions. In this work, we utilize curriculum learning enabled deep reinforcement learning to discover Bosonic codes under approximate AQEC framework to resist both single-photon and double-photon losses. We present an analytical solution of solving the master equation under approximation conditions, which can significantly accelerate the training process of reinforcement learning. The agent first identifies an encoded subspace surpassing the breakeven point through rapid exploration within a constrained evolutionary time-frame, then strategically fine-tunes its policy to sustain this performance advantage over extended temporal horizons. We find that the two-phase trained agent can discover the optimal set of codewords, i.e., the Fock states $\ket{4}$ and $\ket{7}$ considering the effect of both single-photon and double-photon loss. We identify that the discovered code surpasses the breakeven threshold over a longer evolution time and achieve the state-of-art performance. We also analyze the robustness of the code against the phase damping and amplitude damping noise. Our work highlights the potential of curriculum learning enabled deep reinforcement learning in discovering the optimal quantum error correct code especially in early fault-tolerant quantum systems.

quant-pharXiv:2511.12482•Physical Review A•Nov 18, 2025•1 citation

Quantum Techniques in Machine Learning (QTML conference 2023)

Clemens Gneiting

<!--HTML-->Quantum error correction will ultimately empower quantum computers to leverage their full potential. However, substantial device overhead and the need for frequent syndrome measurements, which are themselves error-prone, render the demonstration of logical qubits that significantly surpass break-even still challenging. Autonomous quantum error correction represents a promising alternative, where an engineered environment allows to bypass the syndrome measurements. In this talk, I show how we use reinforcement learning to search for, and find, bosonic code spaces that can surpass break-even under experimentally feasible conditions. Bosonic codes are, for instance, available and utilized in some of the currently most promising and widespread quantum processors based on superconducting qubits. Surprisingly, when we increase the search space by relaxing the constraints on ideal quantum error correction, we find simple and robust code words that significantly surpass break-even while minimizing device overhead. This RL code not only reduces device complexity compared to other proposed encodings, but also outperforms its competitors in terms of its capability to correct errors.

•Jan 1, 2023•0 citations

Implementation-independent sufficient condition of the Knill-Laflamme type for the autonomous protection of logical qudits by strong engineered dissipation

Jae-Mo Lihm, Kyungjoo Noh, Uwe R. Fischer

Autonomous quantum error correction utilizes the engineered coupling of a quantum system to a dissipative ancilla to protect quantum logical states from decoherence. We show that the Knill-Laflamme condition, stating that the environmental error operators should act trivially on a subspace, which then becomes the code subspace, is sufficient for logical qudits to be protected against Markovian noise. It is proven that the error caused by the total Lindbladian evolution in the code subspace can be suppressed up to very long times in the limit of large engineered dissipation, by explicitly deriving how the error scales with both time and engineered dissipation strength. To demonstrate the potential of our approach for applications, we implement our general theory with binomial codes, a class of bosonic error-correcting codes, and outline how they can be implemented in a fully autonomous manner to protect against photon loss in a microwave cavity.

arXiv:1711.02999•Physical Review A•Jul 16, 2018•45 citations

Reinforcement Learning Control of Quantum Error Correction

Volodymyr Sivak, Alexis Morvan, Michael Broughton +296 more

Quantum error correction (QEC) is the primary strategy for protecting a quantum computer from the environment. Its prerequisite is that errors must remain sufficiently rare, which requires perpetually adapting the computer's control parameters to the drifting environment conditions. The current solution to this problem is to terminate the entire quantum computation for recalibration, but it is incompatible with the long runtimes of future quantum algorithms. We address this challenge by unifying calibration with computation. We grant the QEC process a dual role: its error detection events are not only used to correct the logical quantum state, but are also repurposed as a learning signal, teaching a reinforcement learning (RL) agent to continuously steer the control parameters and stabilize the quantum system during computation. We experimentally demonstrate this framework on a Willow superconducting processor, improving the logical stability of the surface code 3.5-fold against injected drift. By synthesizing our full suite of technological advances, we achieve record performance of the surface and color codes, with average logical error per cycle of $7.72(9)\times10^{-4}$ and $8.19(14)\times10^{-3}$ respectively. Numerical simulations of large codes with tens of thousands of control parameters confirm the scalability of our RL framework, revealing an optimization speed that is independent of system size. This work thus enables a new paradigm: a quantum computer that learns from its errors and never stops computing.

quant-pharXiv:2511.08493•Nature•Nov 12, 2025•38 citations

Hardware-efficient autonomous error correction with linear couplers in superconducting circuits

Ziqian Li, Tanay Roy, David Rodríguez Pérez +2 more

Large-scale quantum computers will inevitably need quantum error correction (QEC) to protect information against decoherence. Given that the overhead of such error correction is often formidable, autonomous quantum error correction (AQEC) proposals offer a promising near-term alternative. AQEC schemes work by transforming error states into excitations that can be efficiently removed through engineered dissipation. The recently proposed AQEC scheme by Li , called the Star code, can autonomously correct or suppress all single qubit error channels using two transmons as encoders with a tunable coupler and two lossy resonators as a cooling source. The Star code requires only two-photon interactions and can be realized with linear coupling elements, avoiding experimentally challenging higher-order terms needed in many other AQEC proposals, but needs carefully selected parameters to achieve quadratic improvements in logical states' lifetimes. Here, we theoretically and numerically demonstrate the optimal parameter choices in the Star code. We further discuss adapting the Star code to other planar superconducting circuits, which offers a scalable alternative to single qubits for incorporation in larger quantum computers or error correction codes. Published by the American Physical Society 2024

arXiv:2303.01110•Physical Review Research•Feb 15, 2024•8 citations

Automated Discovery of Autonomous Quantum Error Correction Schemes

Zhaoyou Wang, Taha Rajabzadeh, Nathan Lee +1 more

We can encode a qubit in the energy levels of a quantum system.Relaxation and other dissipation processes lead to decay of the fidelity of this stored information.Is it possible to preserve the quantum information for a longer time by introducing additional drives and dissipation?The existence of autonomous quantum error correcting codes answers this question in the positive.Nonetheless, discovering these codes for a real physical system, i.e., finding the encoding and the associated driving fields and bath couplings, remains a challenge that has required intuition and inspiration to overcome.In this work, we develop and demonstrate a computational approach based on adjoint optimization for discovering autonomous quantum error correcting codes given a Hamiltonian description of a physical system.We implement an optimizer that searches for a logical subspace and control parameters to better preserve quantum information.We demonstrate our method on a system of a harmonic oscillator coupled to a lossy qubit, and find that varying the Hamiltonian distance in Fock space-a proxy for the control hardware complexity-leads to discovery of different and new error correcting schemes.We discover what we call the √ 3 code, realizable with a Hamiltonian distance d = 2, and propose a hardware-efficient implementation based on superconducting circuits.

arXiv:2108.02766•PRX Quantum•Apr 4, 2022•27 citations
Autonomous quantum error correction (AQEC) protects logical qubits by engineered dissipation and thus circumvents the necessity of frequent, error-prone measurement-feedback loops. Bosonic code spaces, where single-photon loss represents the dominant source of error, are promising candidates for AQEC due to their flexibility and controllability. While existing proposals have demonstrated the in-principle feasibility of AQEC with bosonic code spaces, these schemes are typically based on the exact implementation of the Knill-Laflamme conditions and thus require the realization of Hamiltonian distances d≥2. Implementing such Hamiltonian distances requires multiple nonlinear interactions and control fields, rendering these schemes experimentally challenging. Here, we propose a bosonic code for approximate AQEC by relaxing the Knill-Laflamme conditions. Using reinforcement learning (RL), we identify the optimal bosonic set of code words (denoted here by RL code), which, surprisingly, is composed of the Fock states |2⟩ and |4⟩. As we show, the RL code, despite its approximate nature, successfully suppresses single-photon loss, reducing it to an effective dephasing process that well surpasses the break-even threshold. It may thus provide a valuable building block toward full error protection. The error-correcting Hamiltonian, which includes ancilla systems that emulate the engineered dissipation, is entirely based on the Hamiltonian distance d=1, significantly reducing model complexity. Single-qubit gates are implemented in the RL code with a maximum distance d_{g}=2.
Quantum error correction is essential for fault-tolerant quantum computing. However, standard methods relying on active measurements may introduce additional errors. Autonomous quantum error correction (AQEC) circumvents this by utilizing engineered dissipation and drives in bosonic systems, but identifying practical encoding remains challenging due to stringent Knill-Laflamme conditions. In this work, we utilize curriculum learning enabled deep reinforcement learning to discover Bosonic codes under approximate AQEC framework to resist both single-photon and double-photon losses. We present an analytical solution of solving the master equation under approximation conditions, which can significantly accelerate the training process of reinforcement learning. The agent first identifies an encoded subspace surpassing the breakeven point through rapid exploration within a constrained evolutionary time-frame, then strategically fine-tunes its policy to sustain this performance advantage over extended temporal horizons. We find that the two-phase trained agent can discover the optimal set of codewords, i.e., the Fock states ∣4⟩\ket{4}∣4⟩ and ∣7⟩\ket{7}∣7⟩ considering the effect of both single-photon and double-photon loss. We identify that the discovered code surpasses the breakeven threshold over a longer evolution time and achieve the state-of-art performance. We also analyze the robustness of the code against the phase damping and amplitude damping noise. Our work highlights the potential of curriculum learning enabled deep reinforcement learning in discovering the optimal quantum error correct code especially in early fault-tolerant quantum systems.
<!--HTML-->Quantum error correction will ultimately empower quantum computers to leverage their full potential. However, substantial device overhead and the need for frequent syndrome measurements, which are themselves error-prone, render the demonstration of logical qubits that significantly surpass break-even still challenging. Autonomous quantum error correction represents a promising alternative, where an engineered environment allows to bypass the syndrome measurements. In this talk, I show how we use reinforcement learning to search for, and find, bosonic code spaces that can surpass break-even under experimentally feasible conditions. Bosonic codes are, for instance, available and utilized in some of the currently most promising and widespread quantum processors based on superconducting qubits. Surprisingly, when we increase the search space by relaxing the constraints on ideal quantum error correction, we find simple and robust code words that significantly surpass break-even while minimizing device overhead. This RL code not only reduces device complexity compared to other proposed encodings, but also outperforms its competitors in terms of its capability to correct errors.
Autonomous quantum error correction utilizes the engineered coupling of a quantum system to a dissipative ancilla to protect quantum logical states from decoherence. We show that the Knill-Laflamme condition, stating that the environmental error operators should act trivially on a subspace, which then becomes the code subspace, is sufficient for logical qudits to be protected against Markovian noise. It is proven that the error caused by the total Lindbladian evolution in the code subspace can be suppressed up to very long times in the limit of large engineered dissipation, by explicitly deriving how the error scales with both time and engineered dissipation strength. To demonstrate the potential of our approach for applications, we implement our general theory with binomial codes, a class of bosonic error-correcting codes, and outline how they can be implemented in a fully autonomous manner to protect against photon loss in a microwave cavity.
Quantum error correction (QEC) is the primary strategy for protecting a quantum computer from the environment. Its prerequisite is that errors must remain sufficiently rare, which requires perpetually adapting the computer's control parameters to the drifting environment conditions. The current solution to this problem is to terminate the entire quantum computation for recalibration, but it is incompatible with the long runtimes of future quantum algorithms. We address this challenge by unifying calibration with computation. We grant the QEC process a dual role: its error detection events are not only used to correct the logical quantum state, but are also repurposed as a learning signal, teaching a reinforcement learning (RL) agent to continuously steer the control parameters and stabilize the quantum system during computation. We experimentally demonstrate this framework on a Willow superconducting processor, improving the logical stability of the surface code 3.5-fold against injected drift. By synthesizing our full suite of technological advances, we achieve record performance of the surface and color codes, with average logical error per cycle of 7.72(9)×10−47.72(9)\times10^{-4}7.72(9)×10−4 and 8.19(14)×10−38.19(14)\times10^{-3}8.19(14)×10−3 respectively. Numerical simulations of large codes with tens of thousands of control parameters confirm the scalability of our RL framework, revealing an optimization speed that is independent of system size. This work thus enables a new paradigm: a quantum computer that learns from its errors and never stops computing.
Large-scale quantum computers will inevitably need quantum error correction (QEC) to protect information against decoherence. Given that the overhead of such error correction is often formidable, autonomous quantum error correction (AQEC) proposals offer a promising near-term alternative. AQEC schemes work by transforming error states into excitations that can be efficiently removed through engineered dissipation. The recently proposed AQEC scheme by Li , called the Star code, can autonomously correct or suppress all single qubit error channels using two transmons as encoders with a tunable coupler and two lossy resonators as a cooling source. The Star code requires only two-photon interactions and can be realized with linear coupling elements, avoiding experimentally challenging higher-order terms needed in many other AQEC proposals, but needs carefully selected parameters to achieve quadratic improvements in logical states' lifetimes. Here, we theoretically and numerically demonstrate the optimal parameter choices in the Star code. We further discuss adapting the Star code to other planar superconducting circuits, which offers a scalable alternative to single qubits for incorporation in larger quantum computers or error correction codes. Published by the American Physical Society 2024
We can encode a qubit in the energy levels of a quantum system.Relaxation and other dissipation processes lead to decay of the fidelity of this stored information.Is it possible to preserve the quantum information for a longer time by introducing additional drives and dissipation?The existence of autonomous quantum error correcting codes answers this question in the positive.Nonetheless, discovering these codes for a real physical system, i.e., finding the encoding and the associated driving fields and bath couplings, remains a challenge that has required intuition and inspiration to overcome.In this work, we develop and demonstrate a computational approach based on adjoint optimization for discovering autonomous quantum error correcting codes given a Hamiltonian description of a physical system.We implement an optimizer that searches for a logical subspace and control parameters to better preserve quantum information.We demonstrate our method on a system of a harmonic oscillator coupled to a lossy qubit, and find that varying the Hamiltonian distance in Fock space-a proxy for the control hardware complexity-leads to discovery of different and new error correcting schemes.We discover what we call the √ 3 code, realizable with a Hamiltonian distance d = 2, and propose a hardware-efficient implementation based on superconducting circuits.