Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2606.13005 · Chinese Physics Letters

Experiment-compatible measurement--feedback quantum state preparation with reinforcement learning

Xiaotian Nie, Tao Zhang, Linghui Chen

quant-phcond-mat.quant-gasSubmitted Jun 11, 2026• Announced Jun 12, 2026• 1 citation
arXivHTMLPDF

Abstract

Ground-state preparation is a critical task in quantum simulation and quantum computing, as it enables the study of correlated phases and the generation of entangled resource states. While measurement--feedback control has emerged as a promising route to state preparation, existing schemes either rely on handcrafted, task-specific policies or are designed using full quantum-state information that is unavailable in real experiments and becomes impractical for large many-body systems. Here we develop an adaptive measurement--feedback protocol based on reinforcement learning under partial observability. The controller uses only the history of experimentally accessible measurement outcomes to choose both the measurement operator and the feedback action in real time. To make training compatible with experiments, we introduce a stochastic terminal reward built from one-shot measurements of randomly sampled Hamiltonian components, avoiding unphysical full-state reconstruction while remaining an unbiased estimator of the target energy. We demonstrate the method by preparing ground states of the Bose--Hubbard model and by generating GHZ states, establishing a scalable and hardware-compatible route to quantum state preparation.

Comments
4 pages, 3 figures

Related papers

Robust Adaptive Quantum Feedback Under Practical Uncertainties- A Lightweight Approach

Anusha Krishna Murthy, John Watkins, Elizabeth Behrman +2 more

Quantum systems are highly sensitive to timing jitter, measurement noise, and partial observability, which degrade feedback control performance. We present a lightweight adaptive quantum feedback strategy inspired by Deep Deterministic Policy Gradient (DDPG), but designed to operate without full reinforcement learning training. The method adaptively updates control gains using filtered partial measurements and scalar rewards to enhance fidelity under uncertainty. We describe the control formulation, motivate its relevance to near-term devices, and outline future directions for simulation and implementation.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Aug 30, 2025•0 citations

A New Framework for Quantum Reinforcement Learning

Alireza Tavakoli, Mohsen Heidari

Quantum reinforcement learning (QRL) has emerged as a promising approach for controlling quantum systems and accelerating learning tasks with quantum resources. However, most existing QRL formulations still retain a classical reinforcement learning interface: states and actions are often encoded in computational bases and rewards are extracted through measurements. This interface is restrictive for genuinely quantum environments: choosing a measurement can discard entanglement information, while repeated intermediate measurements collapse the evolving state and require costly re-preparation. This motivates a fully QRL framework in which the agent, environment, rewards, and return accumulation are all quantum. In this paper, we take a step toward this goal and introduce a new QRL framework in which both the policy and the environment are modeled by conditional quantum channels. We then propose a quantum policy-gradient algorithm for parameterized conditional quantum channels with a trainable control basis. We also derive finite- and infinite-horizon gradient estimators using a new parameter-shift rule. This rule is needed because policy parameters are shared across repeated interaction blocks and the infinite-horizon objective is not a finite circuit; rather than shifting every occurrence and evaluating the whole trajectory, our estimator shifts only one sampled policy block. Sampling this block from a geometric distribution yields an unbiased gradient estimator under bounded rewards. Finally, we establish convergence of the resulting stochastic gradient-ascent procedure to stationary points under standard smoothness and step-size assumptions.

arXiv:2611.14731•Nov 10, 2026•0 citations

Improving robustness of quantum feedback control with reinforcement learning

Manuel Guatto, Gian Antonio Susto, Francesco Ticozzi

Obtaining reliable state preparation protocols is a key step toward practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to derive a feedback law for state preparation of a desired state in a target system. In particular, we focus on the robustness of the obtained strategies with respect to different types and amount of noise. Comparing the results indicates that the learned controls are more robust to unmodeled perturbations with respect to simple feedback strategy based on optimized population transfer, and that training on a simulated nominal model retains the same advantages displayed by controllers trained on real data. The possibility of effective off-line training of robust controllers promises significant advantages toward practical implementation.

arXiv:2401.17190•Physical Review A•Jul 3, 2024•7 citations

Adaptive Quantum State Tomography with Reinforcement Learning

Jincheng Zhang

Quantum state tomography (QST) is a fundamental technique for characterizing the state of a quantum system. However, traditional QST protocols often require a large number of measurements, leading to significant experimental overhead and uncertainties in the reconstructed state. This paper proposes a novel approach to QST that leverages reinforcement learning (RL) to dynamically adapt measurement strategies. The core idea is to train an RL agent to control the parameters of the QST experiment, learning to optimize the measurement process based on feedback from the acquired data. The agent learns to select measurement bases and angles that minimize the uncertainty in the reconstructed quantum state. This adaptive strategy significantly reduces the number of measurements needed compared to traditional QST while maintaining high accuracy. We present a theoretical framework for this approach, outlining the key components and demonstrating its potential for improved QST performance. The proposed method offers a promising direction for enhancing the efficiency and reliability of QST, contributing to the advancement of quantum information processing.

•Sep 7, 2026•0 citations

Adaptive Quantum Control via Reinforcement Learning

Jincheng Zhang

This paper investigates the application of reinforcement learning (RL) for adaptive quantum control. Traditional quantum control methods often rely on pre-designed pulse shapes optimized for specific scenarios, lacking adaptability to variations in system parameters or environmental noise. This work proposes a novel framework where an RL agent learns to dynamically adjust quantum control pulses in real-time, maximizing the fidelity of quantum operations. The agent receives feedback from the quantum system, typically measured through state variables, and utilizes this information to optimize the control pulse sequence. This adaptive approach addresses the limitations of static control schemes and promises enhanced robustness and performance in complex quantum systems. The core claim centers on utilizing reinforcement learning to design optimal quantum control pulses. The central mechanism involves a trained controller dynamically adjusting pulses based on system feedback. The presented methodology offers a new approach to quantum control, particularly relevant in noisy environments and systems with parameter variations. The research demonstrates the potential of RL for achieving superior quantum control outcomes compared to conventional techniques. ---

•Sep 4, 2026•0 citations

Preparing quantum states by measurement-feedback control with Bayesian optimization

Yadong Wu, Juan Yao, Pengfei Zhang

The preparation of quantum states is crucial for enabling quantum computations and simulations. In this work, we present a general framework for preparing ground states of many-body systems by combining the measurement-feedback control process (MFCP) with machine learning techniques. Specifically, we employ Bayesian optimization (BO) to enhance the efficiency of determining the measurement and feedback operators within the MFCP. As an illustration, we study the ground state preparation of the one-dimensional Bose–Hubbard model. Through BO, we are able to identify optimal parameters that can effectively drive the system towards low-energy states with a high probability across various quantum trajectories. Our results open up new directions for further exploration and development of advanced control strategies for quantum computations and simulations.

arXiv:2212.02336•Frontiers of Physics•Jul 1, 2023•5 citations
Ground-state preparation is a critical task in quantum simulation and quantum computing, as it enables the study of correlated phases and the generation of entangled resource states. While measurement--feedback control has emerged as a promising route to state preparation, existing schemes either rely on handcrafted, task-specific policies or are designed using full quantum-state information that is unavailable in real experiments and becomes impractical for large many-body systems. Here we develop an adaptive measurement--feedback protocol based on reinforcement learning under partial observability. The controller uses only the history of experimentally accessible measurement outcomes to choose both the measurement operator and the feedback action in real time. To make training compatible with experiments, we introduce a stochastic terminal reward built from one-shot measurements of randomly sampled Hamiltonian components, avoiding unphysical full-state reconstruction while remaining an unbiased estimator of the target energy. We demonstrate the method by preparing ground states of the Bose--Hubbard model and by generating GHZ states, establishing a scalable and hardware-compatible route to quantum state preparation.
Quantum systems are highly sensitive to timing jitter, measurement noise, and partial observability, which degrade feedback control performance. We present a lightweight adaptive quantum feedback strategy inspired by Deep Deterministic Policy Gradient (DDPG), but designed to operate without full reinforcement learning training. The method adaptively updates control gains using filtered partial measurements and scalar rewards to enhance fidelity under uncertainty. We describe the control formulation, motivate its relevance to near-term devices, and outline future directions for simulation and implementation.
Quantum reinforcement learning (QRL) has emerged as a promising approach for controlling quantum systems and accelerating learning tasks with quantum resources. However, most existing QRL formulations still retain a classical reinforcement learning interface: states and actions are often encoded in computational bases and rewards are extracted through measurements. This interface is restrictive for genuinely quantum environments: choosing a measurement can discard entanglement information, while repeated intermediate measurements collapse the evolving state and require costly re-preparation. This motivates a fully QRL framework in which the agent, environment, rewards, and return accumulation are all quantum. In this paper, we take a step toward this goal and introduce a new QRL framework in which both the policy and the environment are modeled by conditional quantum channels. We then propose a quantum policy-gradient algorithm for parameterized conditional quantum channels with a trainable control basis. We also derive finite- and infinite-horizon gradient estimators using a new parameter-shift rule. This rule is needed because policy parameters are shared across repeated interaction blocks and the infinite-horizon objective is not a finite circuit; rather than shifting every occurrence and evaluating the whole trajectory, our estimator shifts only one sampled policy block. Sampling this block from a geometric distribution yields an unbiased gradient estimator under bounded rewards. Finally, we establish convergence of the resulting stochastic gradient-ascent procedure to stationary points under standard smoothness and step-size assumptions.
Obtaining reliable state preparation protocols is a key step toward practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to derive a feedback law for state preparation of a desired state in a target system. In particular, we focus on the robustness of the obtained strategies with respect to different types and amount of noise. Comparing the results indicates that the learned controls are more robust to unmodeled perturbations with respect to simple feedback strategy based on optimized population transfer, and that training on a simulated nominal model retains the same advantages displayed by controllers trained on real data. The possibility of effective off-line training of robust controllers promises significant advantages toward practical implementation.
Quantum state tomography (QST) is a fundamental technique for characterizing the state of a quantum system. However, traditional QST protocols often require a large number of measurements, leading to significant experimental overhead and uncertainties in the reconstructed state. This paper proposes a novel approach to QST that leverages reinforcement learning (RL) to dynamically adapt measurement strategies. The core idea is to train an RL agent to control the parameters of the QST experiment, learning to optimize the measurement process based on feedback from the acquired data. The agent learns to select measurement bases and angles that minimize the uncertainty in the reconstructed quantum state. This adaptive strategy significantly reduces the number of measurements needed compared to traditional QST while maintaining high accuracy. We present a theoretical framework for this approach, outlining the key components and demonstrating its potential for improved QST performance. The proposed method offers a promising direction for enhancing the efficiency and reliability of QST, contributing to the advancement of quantum information processing.
This paper investigates the application of reinforcement learning (RL) for adaptive quantum control. Traditional quantum control methods often rely on pre-designed pulse shapes optimized for specific scenarios, lacking adaptability to variations in system parameters or environmental noise. This work proposes a novel framework where an RL agent learns to dynamically adjust quantum control pulses in real-time, maximizing the fidelity of quantum operations. The agent receives feedback from the quantum system, typically measured through state variables, and utilizes this information to optimize the control pulse sequence. This adaptive approach addresses the limitations of static control schemes and promises enhanced robustness and performance in complex quantum systems. The core claim centers on utilizing reinforcement learning to design optimal quantum control pulses. The central mechanism involves a trained controller dynamically adjusting pulses based on system feedback. The presented methodology offers a new approach to quantum control, particularly relevant in noisy environments and systems with parameter variations. The research demonstrates the potential of RL for achieving superior quantum control outcomes compared to conventional techniques. ---
The preparation of quantum states is crucial for enabling quantum computations and simulations. In this work, we present a general framework for preparing ground states of many-body systems by combining the measurement-feedback control process (MFCP) with machine learning techniques. Specifically, we employ Bayesian optimization (BO) to enhance the efficiency of determining the measurement and feedback operators within the MFCP. As an illustration, we study the ground state preparation of the one-dimensional Bose–Hubbard model. Through BO, we are able to identify optimal parameters that can effectively drive the system towards low-energy states with a high probability across various quantum trajectories. Our results open up new directions for further exploration and development of advanced control strategies for quantum computations and simulations.