Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Chinese Control Conference (CCC)

Hybrid control of uncertain quantum systems via fuzzy estimation and quantum reinforcement learning

Chunlin Chen, Jiang Frank, Daoyi Dong

Published Jan 1, 2012• 1 citation
OpenAlex

Abstract

A hybrid control approach for uncertain quantum systems is proposed using probabilistic fuzzy estimators (PFE) and quantum reinforcement learning (QRL). This hybrid control design involves coherent control with PFE and learning control via QRL. The problems of controlling a quantum system from an initial state to a pointed target state are studied in this paper, where we assume that the initial quantum state is a mixed state and the target quantum state is a controllable pure state within a wavefunction controllable subspace. First, the initial quantum system is controlled coherently with the help of a PFE. When the controlled system is estimated to be likely to collapse to an expected eigen state, trigger the measurement and the quantum system collapses to an eigen state in the wavefuntion controllable subspace with a high probability. Then the quantum system is driven to the target state with admissible controls, where the control sequence is learned and optimized with QRL. An example is presented and analyzed to demonstrate the control process.

Related papers

Control Design of Uncertain Quantum Systems With Fuzzy Estimators

Chunlin Chen, Daoyi Dong, James Lam +2 more

An approach of control design using fuzzy estimators (FEs) is proposed for quantum systems with uncertainties. Two types of quantum control problems are considered: 1) control of a pure-state quantum system in the presence of uncertainties and 2) control design of quantum systems with initial mixed states and uncertainties. For the first type of tasks, a partial feedback control scheme with an FE is presented to design controllers. In this scheme, an FE is trained to estimate the quantum state for feedback control of a quantum system, and controlled projective measurement is used to assist in controlling the system. For the second type of quantum control tasks, a probabilistic fuzzy estimator (PFE) is trained to estimate the quantum state for control design of a quantum system with an initial mixed state, and a corresponding control algorithm is proposed to design a control law that drives the system from the mixed state to a target pure state. Two examples of two-spin-1/2systems are also presented and analyzed to demonstrate the process of control design and potential applications of the proposed approach.

IEEE Transactions on Fuzzy Systems•Feb 3, 2012•34 citations

Partial feedback control of quantum systems using probabilistic fuzzy estimator

Chunlin Chen, Gerasimos G. Rigatos, Daoyi Dong +1 more

A partial feedback control scheme with a probabilistic fuzzy estimator (PFE) is presented for the robust control of quantum systems. In this scheme, a probabilistic fuzzy simulator is trained to estimate the quantum states for feedback control of quantum systems. Usually, the estimated state is fed back to design a controller. However, when the estimated quantum state is an almost-eigenstate, a projective measurement will be triggered for the quantum system and the measurement results will be fed back to construct the controller and regulate the fuzzy estimator. This scheme is a partial feedback strategy with controlled discontinuous measurement, where the quantum measurement serves as a control tool and is helpful for driving the quantum system to a desired state tracking even in the presence of unknown disturbances and stochastic noises. An example of a two-spin-¿ system is also presented to demonstrate the proposed approach.

IEEE Conference on Decision and Control (CDC)•Dec 1, 2009•11 citations

Incoherent Control of Quantum Systems With Wavefunction-Controllable Subspaces via Quantum Reinforcement Learning

Daoyi Dong, Chunlin Chen, Tzyh‐Jong Tarn +2 more

In this paper, an incoherent control scheme for accomplishing the state control of a class of quantum systems which have wavefunction-controllable subspaces is proposed. This scheme includes the following two steps: projective measurement on the initial state and learning control in the wavefunction-controllable subspace. The first step probabilistically projects the initial state into the wavefunction-controllable subspace. The probability of success is sensitive to the initial state; however, it can be greatly improved through multiple experiments on several identical initial states even in the case with a small probability of success for an individual measurement. The second step finds a local optimal control sequence via quantum reinforcement learning and drives the controlled system to the objective state through a set of suitable controls. In this strategy, the initial states can be unknown identical states, the quantum measurement is used as an effective control, and the controlled system is not necessarily unitarily controllable. This incoherent control scheme provides an alternative quantum engineering strategy for locally controllable quantum systems.

IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics)•Jul 24, 2008•77 citations

Control design of two-level quantum systems with reinforcement learning

Haixu Yu, Xudong Xu, Hailan Ma +2 more

In recent years, some experimental studies and simulations show that reinforcement learning (RL) is an effective learning control approach for solving certain quantum control problems. In this paper, Q-learning with different exploration strategies (e.g., ε-greedy and Softmax), probabilistic Q-learning (PQL) and quantum reinforcement learning (QRL) are applied to solve the state transition problem of two-level quantum systems (e.g., spin-1/2 systems), respectively. These reinforcement learning algorithms are introduced and analyzed regarding the learning control problem of the spin-1/2 system. According to the constraints of the control fields, two typical kinds of controllers, i.e., three-switch controller and Bang-Bang controller, are designed using reinforcement learning. The learning performance of the above RL algorithms for both of the three-switch control and Bang-Bang control of two-level quantum systems are demonstrated and analyzed.

Youth Academic Annual Conference of Chinese Association of Automation (YAC)•May 1, 2018•5 citations

A New Framework for Quantum Reinforcement Learning

Alireza Tavakoli, Mohsen Heidari

Quantum reinforcement learning (QRL) has emerged as a promising approach for controlling quantum systems and accelerating learning tasks with quantum resources. However, most existing QRL formulations still retain a classical reinforcement learning interface: states and actions are often encoded in computational bases and rewards are extracted through measurements. This interface is restrictive for genuinely quantum environments: choosing a measurement can discard entanglement information, while repeated intermediate measurements collapse the evolving state and require costly re-preparation. This motivates a fully QRL framework in which the agent, environment, rewards, and return accumulation are all quantum. In this paper, we take a step toward this goal and introduce a new QRL framework in which both the policy and the environment are modeled by conditional quantum channels. We then propose a quantum policy-gradient algorithm for parameterized conditional quantum channels with a trainable control basis. We also derive finite- and infinite-horizon gradient estimators using a new parameter-shift rule. This rule is needed because policy parameters are shared across repeated interaction blocks and the infinite-horizon objective is not a finite circuit; rather than shifting every occurrence and evaluating the whole trajectory, our estimator shifts only one sampled policy block. Sampling this block from a geometric distribution yields an unbiased gradient estimator under bounded rewards. Finally, we establish convergence of the resulting stochastic gradient-ascent procedure to stationary points under standard smoothness and step-size assumptions.

arXiv:2611.14731•Nov 10, 2026•0 citations

Fidelity-Based Probabilistic Q-Learning for Control of Quantum Systems

Chunlin Chen, Daoyi Dong, Han‐Xiong Li +2 more

The balance between exploration and exploitation is a key problem for reinforcement learning methods, especially for Q-learning. In this paper, a fidelity-based probabilistic Q-learning (FPQL) approach is presented to naturally solve this problem and applied for learning control of quantum systems. In this approach, fidelity is adopted to help direct the learning process and the probability of each action to be selected at a certain state is updated iteratively along with the learning process, which leads to a natural exploration strategy instead of a pointed one with configured parameters. A probabilistic Q-learning (PQL) algorithm is first presented to demonstrate the basic idea of probabilistic action selection. Then the FPQL algorithm is presented for learning control of quantum systems. Two examples (a spin-1/2 system and a Λ-type atomic system) are demonstrated to test the performance of the FPQL algorithm. The results show that FPQL algorithms attain a better balance between exploration and exploitation, and can also avoid local optimal policies and accelerate the learning process.

arXiv:1806.03145•IEEE Transactions on Neural Networks and Learning Systems•Oct 11, 2013•154 citations
A hybrid control approach for uncertain quantum systems is proposed using probabilistic fuzzy estimators (PFE) and quantum reinforcement learning (QRL). This hybrid control design involves coherent control with PFE and learning control via QRL. The problems of controlling a quantum system from an initial state to a pointed target state are studied in this paper, where we assume that the initial quantum state is a mixed state and the target quantum state is a controllable pure state within a wavefunction controllable subspace. First, the initial quantum system is controlled coherently with the help of a PFE. When the controlled system is estimated to be likely to collapse to an expected eigen state, trigger the measurement and the quantum system collapses to an eigen state in the wavefuntion controllable subspace with a high probability. Then the quantum system is driven to the target state with admissible controls, where the control sequence is learned and optimized with QRL. An example is presented and analyzed to demonstrate the control process.
An approach of control design using fuzzy estimators (FEs) is proposed for quantum systems with uncertainties. Two types of quantum control problems are considered: 1) control of a pure-state quantum system in the presence of uncertainties and 2) control design of quantum systems with initial mixed states and uncertainties. For the first type of tasks, a partial feedback control scheme with an FE is presented to design controllers. In this scheme, an FE is trained to estimate the quantum state for feedback control of a quantum system, and controlled projective measurement is used to assist in controlling the system. For the second type of quantum control tasks, a probabilistic fuzzy estimator (PFE) is trained to estimate the quantum state for control design of a quantum system with an initial mixed state, and a corresponding control algorithm is proposed to design a control law that drives the system from the mixed state to a target pure state. Two examples of two-spin-1/2systems are also presented and analyzed to demonstrate the process of control design and potential applications of the proposed approach.
A partial feedback control scheme with a probabilistic fuzzy estimator (PFE) is presented for the robust control of quantum systems. In this scheme, a probabilistic fuzzy simulator is trained to estimate the quantum states for feedback control of quantum systems. Usually, the estimated state is fed back to design a controller. However, when the estimated quantum state is an almost-eigenstate, a projective measurement will be triggered for the quantum system and the measurement results will be fed back to construct the controller and regulate the fuzzy estimator. This scheme is a partial feedback strategy with controlled discontinuous measurement, where the quantum measurement serves as a control tool and is helpful for driving the quantum system to a desired state tracking even in the presence of unknown disturbances and stochastic noises. An example of a two-spin-¿ system is also presented to demonstrate the proposed approach.
In this paper, an incoherent control scheme for accomplishing the state control of a class of quantum systems which have wavefunction-controllable subspaces is proposed. This scheme includes the following two steps: projective measurement on the initial state and learning control in the wavefunction-controllable subspace. The first step probabilistically projects the initial state into the wavefunction-controllable subspace. The probability of success is sensitive to the initial state; however, it can be greatly improved through multiple experiments on several identical initial states even in the case with a small probability of success for an individual measurement. The second step finds a local optimal control sequence via quantum reinforcement learning and drives the controlled system to the objective state through a set of suitable controls. In this strategy, the initial states can be unknown identical states, the quantum measurement is used as an effective control, and the controlled system is not necessarily unitarily controllable. This incoherent control scheme provides an alternative quantum engineering strategy for locally controllable quantum systems.
In recent years, some experimental studies and simulations show that reinforcement learning (RL) is an effective learning control approach for solving certain quantum control problems. In this paper, Q-learning with different exploration strategies (e.g., ε-greedy and Softmax), probabilistic Q-learning (PQL) and quantum reinforcement learning (QRL) are applied to solve the state transition problem of two-level quantum systems (e.g., spin-1/2 systems), respectively. These reinforcement learning algorithms are introduced and analyzed regarding the learning control problem of the spin-1/2 system. According to the constraints of the control fields, two typical kinds of controllers, i.e., three-switch controller and Bang-Bang controller, are designed using reinforcement learning. The learning performance of the above RL algorithms for both of the three-switch control and Bang-Bang control of two-level quantum systems are demonstrated and analyzed.
Quantum reinforcement learning (QRL) has emerged as a promising approach for controlling quantum systems and accelerating learning tasks with quantum resources. However, most existing QRL formulations still retain a classical reinforcement learning interface: states and actions are often encoded in computational bases and rewards are extracted through measurements. This interface is restrictive for genuinely quantum environments: choosing a measurement can discard entanglement information, while repeated intermediate measurements collapse the evolving state and require costly re-preparation. This motivates a fully QRL framework in which the agent, environment, rewards, and return accumulation are all quantum. In this paper, we take a step toward this goal and introduce a new QRL framework in which both the policy and the environment are modeled by conditional quantum channels. We then propose a quantum policy-gradient algorithm for parameterized conditional quantum channels with a trainable control basis. We also derive finite- and infinite-horizon gradient estimators using a new parameter-shift rule. This rule is needed because policy parameters are shared across repeated interaction blocks and the infinite-horizon objective is not a finite circuit; rather than shifting every occurrence and evaluating the whole trajectory, our estimator shifts only one sampled policy block. Sampling this block from a geometric distribution yields an unbiased gradient estimator under bounded rewards. Finally, we establish convergence of the resulting stochastic gradient-ascent procedure to stationary points under standard smoothness and step-size assumptions.
The balance between exploration and exploitation is a key problem for reinforcement learning methods, especially for Q-learning. In this paper, a fidelity-based probabilistic Q-learning (FPQL) approach is presented to naturally solve this problem and applied for learning control of quantum systems. In this approach, fidelity is adopted to help direct the learning process and the probability of each action to be selected at a certain state is updated iteratively along with the learning process, which leads to a natural exploration strategy instead of a pointed one with configured parameters. A probabilistic Q-learning (PQL) algorithm is first presented to demonstrate the basic idea of probabilistic action selection. Then the FPQL algorithm is presented for learning control of quantum systems. Two examples (a spin-1/2 system and a Λ-type atomic system) are demonstrated to test the performance of the FPQL algorithm. The results show that FPQL algorithms attain a better balance between exploration and exploitation, and can also avoid local optimal policies and accelerate the learning process.