Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2604.16784

Learning Non-Markovian Noise via Ensemble Optimal Control

Da-Wei Luo, Ting Yu

quant-phSubmitted Apr 18, 2026• Announced Apr 21, 2026• 0 citations
arXivHTMLPDF

Abstract

We study the estimation of parameters pertaining to non-Markovian quantum open systems, such as the dissipation rate and environmental memory time. A key challenge is identifying the optimal measurement time, which must allow sufficient time to acquire information about the environment, yet be short enough to avoid dissipation that erases the information. Using machine learning approaches, we develop an optimized control scheme trained over a representative ensemble to fix the optimal measurement time at a prescribed runtime. The protocol is robust to errors in the training process, enhances precision by exploiting non-Markovian memory effects, and achieves measurement uncertainties approaching the quantum limits set by the Cramér-Rao bound.

Comments
7 pages, 4 figures

Related papers

Machine Learning-aided Optimal Control of a noisy qubit

Cantone, Riccardo, Shreyasi Mukherjee, Luigi Giannelli +2 more

We apply a graybox machine-learning framework to model and control a qubit undergoing Markovian and non-Markovian dynamics from environmental noise. The approach combines physics-informed equations with a lightweight transformer neural network based on the self-attention mechanism. The model is trained on simulated data and learns an effective operator that predicts observables accurately, even in the presence of memory effects. We benchmark both non-Gaussian random-telegraph noise and Gaussian Ornstein-Uhlenbeck noise and achieve low prediction errors even in challenging noise coupling regimes. Using the model as a dynamics emulator, we perform gradient-based optimal control to identify pulse sequences implementing a universal set of single-qubit gates, achieving fidelities above 99% for the lowest considered value of the coupling and remaining above 90% for the highest.

arXiv:2507.14085•Jul 18, 2025•1 citation

Harnessing Environmental Memory with Reinforcement Learning in Open Quantum Systems

Safae Gaidi, Abdallah Slaoui, Mohammed EL Falaki +1 more

Non-Markovian quantum dynamics, characterized by information backflow from the environment to the system, has emerged as a potential resource for quantum technologies. A key challenge is therefore to control and enhance such memory effects. In this work, we investigate the use of reinforcement learning (RL) to maximize non-Markovianity in a driven two-level system coupled to a structured reservoir. We compare RL-based control strategies with standard optimal control theory (OCT). We show that OCT produces localized but relatively weak revivalsin the instantaneous non-Markovianity rate, whereas RL policies generate significantly stronger and better-timed information backflow by synchronizing the system dynamics with favorable memory intervals of the environment. This enhanced exploitation of memory effects leads to a higher total integrated non-Markovianity for RL than for OCT, with SAC achieving the largest overall enhancement and PPO delivering slightly lower but still strongly improved performance with smoother, experimentally attractive pulses. Our results contribute to the emerging view of non-Markovianity as an operational resource and illustrate how RL can serve as a flexible, model-free tool for non-Markovian quantum control.

quant-pharXiv:2601.01252•Jan 6, 2026•0 citations

Machine Learning Non-Markovian Quantum Dynamics

I. A. Luchnikov, Stephen Vintskevich, D. A. Grigoriev +1 more

Machine learning methods have proved to be useful for the recognition of patterns in statistical data. The measurement outcomes are intrinsically random in quantum physics, however, they do have a pattern when the measurements are performed successively on an open quantum system. This pattern is due to the system-environment interaction and contains information about the relaxation rates as well as non-Markovian memory effects. Here we develop a method to extract the information about the unknown environment from a series of projective single-shot measurements on the system (without resorting to the process tomography). The method is based on embedding the non-Markovian system dynamics into a Markovian dynamics of the system and the effective reservoir of finite dimension. The generator of Markovian embedding is learned by the maximum likelihood estimation. We verify the method by comparing its prediction with an exactly solvable non-Markovian dynamics. The developed algorithm to learn unknown quantum environments enables one to efficiently control and manipulate quantum systems.

arXiv:1902.07019•Physical Review Letters•Apr 9, 2020•107 citations

Memory-enhanced quantum extreme learning machines for characterizing non-Markovian dynamics

Hajar Assil, Abderrahim El Allati, Gian Luca Giorgi

We use a Quantum Extreme Learning Machine for characterizing and estimating parameters of quantum dynamics generated by a tunable collision model. The input to the learning protocol consists of quantum states produced by successive system environment interactions, while the reservoir is implemented as a disordered many body quantum system evolving under a fixed Hamiltonian. We systematically explore how extending the QELM feature space, through the inclusion of temporal information and additional observables, affects estimation performance. Our results demonstrate that temporal extensions of the feature vector consistently and significantly enhance estimation accuracy relative to the baseline protocol. Notably, incorporating memory from earlier time steps yields the most substantial and robust improvements, whereas extensions based solely on additional observables offer only marginal gains. Crucially, the advantage conferred by temporal memory becomes increasingly pronounced as the dynamics become more strongly non Markovian, indicating that environmental memory effects serve as a constructive resource for learning.

quant-pharXiv:2603.17182•Physical Review Research•Mar 19, 2026•2 citations

Machine learning assisted zero-area pulse design in an open quantum system

Yi-Ye Li, Lian-Ao Wu, Zhao-Ming Wang

Accurate and precise quantum control is crucial for quantum information processing. Zero-area pulse control, originally developed for closed systems, has played a significant role in driving quantum systems toward desired states. However, its effectiveness is often compromised by environmental noise. Traditional methods can find optimal pulses for fixed environmental parameters, and they need to be recalculated again once the environmental parameters change. Here, we propose a supervised learning (SL)-based protocol to design optimal zero-area pulses in noisy environments. By including environmental parameters as input during training, the neural network (NN) learns to generate effective controls for various environmental parameters. We demonstrate the protocol using quantum state transmission through a spin chain governed by a non-Markovian master equation. The SL-optimized pulses significantly enhance transmission fidelity compared to ideal pulses, with greater improvements observed at higher system-bath coupling and temperature, where more optimization space exists. Interestingly, fidelity first increases and then decreases with stronger Markovianity, suggesting that highly Markovian environments limit control performance. We also compare the SL method with a genetic algorithm, and the similar results confirm the accuracy and generalization ability of the NN-based approach.

Physical Review Research•Aug 8, 2025•3 citations

Machine Learning-Aided Optimal Control of a Qubit Subjected to External Noise

Riccardo Cantone, Shreyasi Mukherjee, Luigi Giannelli +2 more

We apply a machine-learning-enhanced greybox framework to a quantum optimal control protocol for open quantum systems. Combining a whitebox physical model with a neural-network blackbox trained on synthetic data, the method captures non-Markovian noise effects and achieves gate fidelities above 90% under Random Telegraph and Ornstein-Uhlenbeck noise. Critical issues of the approach are discussed.

quant-pharXiv:2512.24393•Dec 31, 2025•0 citations
We study the estimation of parameters pertaining to non-Markovian quantum open systems, such as the dissipation rate and environmental memory time. A key challenge is identifying the optimal measurement time, which must allow sufficient time to acquire information about the environment, yet be short enough to avoid dissipation that erases the information.
Using machine learning approaches, we develop an optimized control scheme trained over a representative ensemble to fix the optimal measurement time at a prescribed runtime. The protocol is robust to errors in the training process, enhances precision by exploiting non-Markovian memory effects, and achieves measurement uncertainties approaching the quantum limits set by the Cramér-Rao bound.
We apply a graybox machine-learning framework to model and control a qubit undergoing Markovian and non-Markovian dynamics from environmental noise. The approach combines physics-informed equations with a lightweight transformer neural network based on the self-attention mechanism. The model is trained on simulated data and learns an effective operator that predicts observables accurately, even in the presence of memory effects. We benchmark both non-Gaussian random-telegraph noise and Gaussian Ornstein-Uhlenbeck noise and achieve low prediction errors even in challenging noise coupling regimes. Using the model as a dynamics emulator, we perform gradient-based optimal control to identify pulse sequences implementing a universal set of single-qubit gates, achieving fidelities above 99% for the lowest considered value of the coupling and remaining above 90% for the highest.
Non-Markovian quantum dynamics, characterized by information backflow from the environment to the system, has emerged as a potential resource for quantum technologies. A key challenge is therefore to control and enhance such memory effects. In this work, we investigate the use of reinforcement learning (RL) to maximize non-Markovianity in a driven two-level system coupled to a structured reservoir. We compare RL-based control strategies with standard optimal control theory (OCT). We show that OCT produces localized but relatively weak revivalsin the instantaneous non-Markovianity rate, whereas RL policies generate significantly stronger and better-timed information backflow by synchronizing the system dynamics with favorable memory intervals of the environment. This enhanced exploitation of memory effects leads to a higher total integrated non-Markovianity for RL than for OCT, with SAC achieving the largest overall enhancement and PPO delivering slightly lower but still strongly improved performance with smoother, experimentally attractive pulses. Our results contribute to the emerging view of non-Markovianity as an operational resource and illustrate how RL can serve as a flexible, model-free tool for non-Markovian quantum control.
Machine learning methods have proved to be useful for the recognition of patterns in statistical data. The measurement outcomes are intrinsically random in quantum physics, however, they do have a pattern when the measurements are performed successively on an open quantum system. This pattern is due to the system-environment interaction and contains information about the relaxation rates as well as non-Markovian memory effects. Here we develop a method to extract the information about the unknown environment from a series of projective single-shot measurements on the system (without resorting to the process tomography). The method is based on embedding the non-Markovian system dynamics into a Markovian dynamics of the system and the effective reservoir of finite dimension. The generator of Markovian embedding is learned by the maximum likelihood estimation. We verify the method by comparing its prediction with an exactly solvable non-Markovian dynamics. The developed algorithm to learn unknown quantum environments enables one to efficiently control and manipulate quantum systems.
We use a Quantum Extreme Learning Machine for characterizing and estimating parameters of quantum dynamics generated by a tunable collision model. The input to the learning protocol consists of quantum states produced by successive system environment interactions, while the reservoir is implemented as a disordered many body quantum system evolving under a fixed Hamiltonian. We systematically explore how extending the QELM feature space, through the inclusion of temporal information and additional observables, affects estimation performance. Our results demonstrate that temporal extensions of the feature vector consistently and significantly enhance estimation accuracy relative to the baseline protocol. Notably, incorporating memory from earlier time steps yields the most substantial and robust improvements, whereas extensions based solely on additional observables offer only marginal gains. Crucially, the advantage conferred by temporal memory becomes increasingly pronounced as the dynamics become more strongly non Markovian, indicating that environmental memory effects serve as a constructive resource for learning.
Accurate and precise quantum control is crucial for quantum information processing. Zero-area pulse control, originally developed for closed systems, has played a significant role in driving quantum systems toward desired states. However, its effectiveness is often compromised by environmental noise. Traditional methods can find optimal pulses for fixed environmental parameters, and they need to be recalculated again once the environmental parameters change. Here, we propose a supervised learning (SL)-based protocol to design optimal zero-area pulses in noisy environments. By including environmental parameters as input during training, the neural network (NN) learns to generate effective controls for various environmental parameters. We demonstrate the protocol using quantum state transmission through a spin chain governed by a non-Markovian master equation. The SL-optimized pulses significantly enhance transmission fidelity compared to ideal pulses, with greater improvements observed at higher system-bath coupling and temperature, where more optimization space exists. Interestingly, fidelity first increases and then decreases with stronger Markovianity, suggesting that highly Markovian environments limit control performance. We also compare the SL method with a genetic algorithm, and the similar results confirm the accuracy and generalization ability of the NN-based approach.