Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2307.09176 · Physical Review Letters

Detection of Entangled States Supported by Reinforcement Learning

Jiahao Cao, Feng Chen, Qi Liu, Tian-Wei Mao, Wen-Xin Xu, Ling-Na Wu, Li You

Published Aug 14, 2023• 15 citations
arXivHTMLPDF

Abstract

Discrimination of entangled states is an important element of quantum-enhanced metrology. This typically requires low-noise detection technology. Such a challenge can be circumvented by introducing nonlinear readout process. Traditionally, this is realized by reversing the very dynamics that generates the entangled state, which requires a full control over the system evolution. In this Letter, we present nonlinear readout of highly entangled states by employing reinforcement learning to manipulate the spin-mixing dynamics in a spin-1 atomic condensate. The reinforcement learning found results in driving the system toward an unstable fixed point, whereby the (to be sensed) phase perturbation is amplified by the subsequent spin-mixing dynamics. Working with a condensate of 10 900 ^{87}Rb atoms, we achieve a metrological gain of 6.97_{-1.38}^{+1.30} dB beyond the classical precision limit. Our work will open up new possibilities in unlocking the full potential of entanglement caused quantum enhancement in experiments.

DOI
10.1103/physrevlett.131.073201

Related papers

Quantum-Enhanced Sensing Based on Time Reversal of Nonlinear Dynamics

Daniel Linnemann, Helmut Strobel, Wolfgang Muessel +4 more

We experimentally demonstrate a nonlinear detection scheme exploiting time-reversal dynamics that disentangles continuous variable entangled states for feasible readout. Spin-exchange dynamics of Bose-Einstein condensates is used as the nonlinear mechanism which not only generates entangled states but can also be time reversed by controlled phase imprinting. For demonstration of a quantum-enhanced measurement we construct an active atom SU(1,1) interferometer, where entangled state preparation and nonlinear readout both consist of parametric amplification. This scheme is capable of exhausting the quantum resource by detecting solely mean atom numbers. Controlled nonlinear transformations widen the spectrum of useful entangled states for applied quantum technologies.

arXiv:1602.07505•Physical Review Letters•Jun 28, 2016•226 citations

Entanglement engineering of optomechanical systems by reinforcement learning

Lili Ye, Christian Arenz, Joseph M. Lukens +1 more

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

arXiv:2406.04550•APL Machine Learning•Jan 17, 2025•9 citations

Improving the dynamics of quantum sensors with reinforcement learning

Jonas Schuff, Lukas J. Fiderer, Daniel Braun

Abstract Recently proposed quantum-chaotic sensors achieve quantum enhancements in measurement precision by applying nonlinear control pulses to the dynamics of the quantum sensor while using classical initial states that are easy to prepare. Here, we use the cross-entropy method of reinforcement learning (RL) to optimize the strength and position of control pulses. Compared to the quantum-chaotic sensors with periodic control pulses in the presence of superradiant damping, we find that decoherence can be fought even better and measurement precision can be enhanced further by optimizing the control. In some examples, we find enhancements in sensitivity by more than an order of magnitude. By visualizing the evolution of the quantum state, the mechanism exploited by the RL method is identified as a kind of spin-squeezing strategy that is adapted to the superradiant damping.

arXiv:1908.08416•New Journal of Physics•Jan 23, 2020•52 citations

Enhanced qubit readout via reinforcement learning

Aniket Chatterjee, Jonathan Schwinger, Yvonne Y. Gao

Measurement is an essential component of robust and practical quantum computation. For superconducting qubits, the measurement process involves the effective manipulation of the joint qubit-resonator dynamics, and it should ideally provide the highest quality for qubit state discrimination with the shortest readout pulse and resonator reset time. Here, we harness model-free reinforcement learning (RL), together with a tailored training environment, to achieve this multifaceted optimization task. Using the IBM quantum device, we demonstrate that the pulse obtained by the RL agent not only successfully achieves state-of-the-art performance, with an assignment error of ( 4.6 ± 0.4 ) × 10 − 3 , but also executes the readout and the subsequent resonator reset almost three times faster than the system’s default process. Furthermore, the learned waveforms are robust against realistic parameter drifts and follow an intuitive form, making them readily implementable on existing hardware with little computational overhead. Our results provide an effective readout strategy to boost the performance of superconducting quantum processors and demonstrate the value of RL in providing optimal and practical solutions for complex quantum information processing tasks.

arXiv:2412.04053•Physical Review Applied•May 22, 2025•17 citations

Non-Markovian Quantum Control via Model Maximum Likelihood Estimation and Reinforcement Learning

Tanmay Neema, Susmit Jha, Tuhin Sahai

Reinforcement Learning (RL) techniques have been increasingly applied in optimizing control systems. However, their application in quantum systems is hampered by the challenge of performing closed-loop control due to the difficulty in measuring these systems. This often leads to reliance on assumed models, introducing model bias, a problem that is exacerbated in open quantum dynamics where Markovian approximations are not valid. To address these challenges, we propose a novel approach that incorporates the non-Markovian nature of the environment into a low-dimensional effective reservoir. By initially employing a series of measurements as a 'dataset', we utilize machine learning techniques to learn the effective quantum dynamics more efficiently than traditional tomographic methods. Our methodology aims to demonstrates that by integrating reinforcement learning with model learning, it is possible to devise control policies and models that can counteract decoherence in a spin-boson system. This approach may not only mitigates the issues of model bias but also provides a more accurate representation of quantum dynamics, paving the way for more effective quantum control strategies.

arXiv:2402.05084•Feb 7, 2024•3 citations

Enhancing Quantum Metrology by Quantum Resonance Dynamics

Zhixing Zou, Jiangbin Gong, Weitao Chen

Quantum effects in metrology can in principle enhance measurement precision from the so-called standard quantum limit to the Heisenberg limit. Further advancements in quantum metrology largely rely on innovative metrology protocols that can avoid a number of known obstacles, including the challenge of preparing entangled states with sufficient fidelity, the readout noise in measuring highly entangled states, and no-go theorems for quantum metrology under noisy environments. In this Letter, exploiting some peculiar but experimentally feasible dynamical features of a collection of spins with all-to-all time-periodic interactions, we propose a metrology protocol that can circumvent all three mentioned obstacles and yet still make good use of time as a resource for metrology. Specifically, by mapping the dynamics of such a periodically driven spin system to that of a paradigm of quantum chaos but tuned to some high-order quantum resonance, it is shown that a simple SU(2) coherent state can, after evolving to highly entangled states in the ensuing dynamics, be dynamically brought back to the same initial coherent state. The associated quantum Fisher information is found to exhibit quadratic scaling with both the number of spins and the duration of the metrology protocol. The achieved Heisenberg scaling can also largely survive in the presence of Markovian noise. Representing a previously unknown strategy for quantum metrology, the protocol proposed here can be tested on available experimental platforms.

arXiv:2502.01462•Physical Review Letters•May 28, 2025•8 citations
Discrimination of entangled states is an important element of quantum-enhanced metrology. This typically requires low-noise detection technology. Such a challenge can be circumvented by introducing nonlinear readout process. Traditionally, this is realized by reversing the very dynamics that generates the entangled state, which requires a full control over the system evolution. In this Letter, we present nonlinear readout of highly entangled states by employing reinforcement learning to manipulate the spin-mixing dynamics in a spin-1 atomic condensate. The reinforcement learning found results in driving the system toward an unstable fixed point, whereby the (to be sensed) phase perturbation is amplified by the subsequent spin-mixing dynamics. Working with a condensate of 10 900 ^{87}Rb atoms, we achieve a metrological gain of 6.97_{-1.38}^{+1.30} dB beyond the classical precision limit. Our work will open up new possibilities in unlocking the full potential of entanglement caused quantum enhancement in experiments.
We experimentally demonstrate a nonlinear detection scheme exploiting time-reversal dynamics that disentangles continuous variable entangled states for feasible readout. Spin-exchange dynamics of Bose-Einstein condensates is used as the nonlinear mechanism which not only generates entangled states but can also be time reversed by controlled phase imprinting. For demonstration of a quantum-enhanced measurement we construct an active atom SU(1,1) interferometer, where entangled state preparation and nonlinear readout both consist of parametric amplification. This scheme is capable of exhausting the quantum resource by detecting solely mean atom numbers. Controlled nonlinear transformations widen the spectrum of useful entangled states for applied quantum technologies.
Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.
Abstract Recently proposed quantum-chaotic sensors achieve quantum enhancements in measurement precision by applying nonlinear control pulses to the dynamics of the quantum sensor while using classical initial states that are easy to prepare. Here, we use the cross-entropy method of reinforcement learning (RL) to optimize the strength and position of control pulses. Compared to the quantum-chaotic sensors with periodic control pulses in the presence of superradiant damping, we find that decoherence can be fought even better and measurement precision can be enhanced further by optimizing the control. In some examples, we find enhancements in sensitivity by more than an order of magnitude. By visualizing the evolution of the quantum state, the mechanism exploited by the RL method is identified as a kind of spin-squeezing strategy that is adapted to the superradiant damping.
Measurement is an essential component of robust and practical quantum computation. For superconducting qubits, the measurement process involves the effective manipulation of the joint qubit-resonator dynamics, and it should ideally provide the highest quality for qubit state discrimination with the shortest readout pulse and resonator reset time. Here, we harness model-free reinforcement learning (RL), together with a tailored training environment, to achieve this multifaceted optimization task. Using the IBM quantum device, we demonstrate that the pulse obtained by the RL agent not only successfully achieves state-of-the-art performance, with an assignment error of ( 4.6 ± 0.4 ) × 10 − 3 , but also executes the readout and the subsequent resonator reset almost three times faster than the system’s default process. Furthermore, the learned waveforms are robust against realistic parameter drifts and follow an intuitive form, making them readily implementable on existing hardware with little computational overhead. Our results provide an effective readout strategy to boost the performance of superconducting quantum processors and demonstrate the value of RL in providing optimal and practical solutions for complex quantum information processing tasks.
Reinforcement Learning (RL) techniques have been increasingly applied in optimizing control systems. However, their application in quantum systems is hampered by the challenge of performing closed-loop control due to the difficulty in measuring these systems. This often leads to reliance on assumed models, introducing model bias, a problem that is exacerbated in open quantum dynamics where Markovian approximations are not valid. To address these challenges, we propose a novel approach that incorporates the non-Markovian nature of the environment into a low-dimensional effective reservoir. By initially employing a series of measurements as a 'dataset', we utilize machine learning techniques to learn the effective quantum dynamics more efficiently than traditional tomographic methods. Our methodology aims to demonstrates that by integrating reinforcement learning with model learning, it is possible to devise control policies and models that can counteract decoherence in a spin-boson system. This approach may not only mitigates the issues of model bias but also provides a more accurate representation of quantum dynamics, paving the way for more effective quantum control strategies.
Quantum effects in metrology can in principle enhance measurement precision from the so-called standard quantum limit to the Heisenberg limit. Further advancements in quantum metrology largely rely on innovative metrology protocols that can avoid a number of known obstacles, including the challenge of preparing entangled states with sufficient fidelity, the readout noise in measuring highly entangled states, and no-go theorems for quantum metrology under noisy environments. In this Letter, exploiting some peculiar but experimentally feasible dynamical features of a collection of spins with all-to-all time-periodic interactions, we propose a metrology protocol that can circumvent all three mentioned obstacles and yet still make good use of time as a resource for metrology. Specifically, by mapping the dynamics of such a periodically driven spin system to that of a paradigm of quantum chaos but tuned to some high-order quantum resonance, it is shown that a simple SU(2) coherent state can, after evolving to highly entangled states in the ensuing dynamics, be dynamically brought back to the same initial coherent state. The associated quantum Fisher information is found to exhibit quadratic scaling with both the number of spins and the duration of the metrology protocol. The achieved Heisenberg scaling can also largely survive in the presence of Markovian noise. Representing a previously unknown strategy for quantum metrology, the protocol proposed here can be tested on available experimental platforms.