Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2505.22070 · IEEE Control Systems Letters

Physical Reduced Stochastic Equations for Continuously Monitored Non-Markovian Quantum Systems With a Markovian Embedding

Hendra I. Nurdin

Published Jan 1, 2025• 1 citation
arXivHTMLPDF

Abstract

An effective approach to modeling non-Markovian quantum systems is to embed a principal (quantum) system of interest into a larger quantum system. A widely employed embedding is one that uses another quantum system, referred to as the auxiliary system, which is coupled to the principal system, and both the principal and auxiliary can be coupled to quantum white noise processes. The principal and auxiliary together form a quantum Markov system and the quantum white noises act as a bath (environment) for this system. Recently it was shown that the conditional evolution of the principal system in this embedding under continuous monitoring by a travelling quantum probe can be expressed as a system of coupled stochastic differential equations (SDEs) that involve only operators of the principal system. The reduced conditional state of the principal only (conditioned on the measurement outcomes) are determined by the “diagonal" blocks of this coupled systems of SDEs. It is shown here that the “off-diagonal" blocks can be exactly eliminated up to their initial conditions, leaving a reduced closed system of SDEs for the diagonal blocks only. Under additional conditions the off-diagonal initial conditions can be made to vanish. This new closed system of equations, which includes an integration term involving a two-time stochastic kernel, represents the non-Markovian stochastic dynamics of the principal system under continuous-measurement. The system of equations determine the reduced conditional state of the principal only and may be viewed as a stochastic Nakajima-Zwanzig type of equation for continuously monitored non-Markovian quantum systems.

DOI
10.1109/lcsys.2025.3575438

Related papers

Markovian Embeddings of Non-Markovian Quantum Systems: Coupled Stochastic and Quantum Master Equations for Non-Markovian Quantum Systems

Hendra I. Nurdin

Quantum Markov models are employed ubiqui-tously in quantum physics and in quantum information theory due to their relative simplicity and analytical tractability. In particular, these models are known to give accurate approxi-mations for a wide range of quantum optical and meso scopic systems. However, in general, the validity of the Markov approximation entails assumptions regarding properties of the system of interest and its environment, which may not be satisfied or accurate in arbitrary physical systems. Therefore, developing useful modelling tools for general non-Markovian quantum systems for which the Markov approximation is inappropriate or deficient is an undertaking of significant importance. This work considers non-Markovian principal quantum systems that can be embedded in a larger Markovian quantum system with one or more compound baths consisting of an auxiliary quantum system and a quantum white noise field, and derives a set of coupled stochastic and quantum master equations for embedded non-Markovian quantum systems. The case of a purely Hamiltonian coupling between the principal and auxiliary systems as a closed system without coupling to white noises is included as a special case. The results are expected to be of interest for (open-loop and feedback) control of continuous-time non-Markovian systems and studying reduced models for numerical simulation of such systems. They may also shed more light on the general structure of continuous-time non-Markovian quantum systems.

arXiv:2312.00134•IEEE Conference on Decision and Control (CDC)•Dec 13, 2023•1 citation

Projection Operator Stochastic Equations for Non-Markovian Quantum Systems Under Continuous Measurement-Based Feedback

H. I. Nurdin

Quantum Markov models have been successfully used to accurately model various physical quantum systems in fields such as quantum optics, optomechanics and superconducting circuits and they provide the basis for (measurement-based) quantum feedback control. However, the quantum Markov assumption is a strong one and it is not expected to hold for general quantum systems of interest. The projection operator approach is one approach that has been developed to model non-Markovian quantum systems by considering its embedding in a larger Markovian quantum system, but mainly in the context of quantum master equations for the dynamics of the unmonitored reduced quantum state of a quantum system. This approach was recently adapted for continuously measured non-Markovian quantum systems, which enables open-loop control but did not yet consider the presence of feedback of the stochastic measurement record, deriving non-Markovian SDEs for the evolution of the projected state of the Markovian embedding. This paper generalizes these stochastic equations to the setting of stochastic feedback based on the continuous-measurement record and shows that the equations take the same form but that previously deterministic terms become stochastic ones which depend on the measurement record, as would be intuitively expected. The stochastic equations are obtained for a generalized class of measurements that includes continuous (possibly adaptive) homodyne and photon counting measurements.

quant-pharXiv:2606.31321•Jul 1, 2026•1 citation

Single photon quantum filtering using non-Markovian embeddings

John Edward Gough, M. R. James, Hendra I. Nurdin

We determine quantum master and filter equations for continuous measurement of systems coupled to input fields in certain non-classical continuous-mode states, specifically single photon states. The quantum filters are shown to be derivable from an embedding into a larger non-Markovian system, and are given by a system of coupled stochastic differential equations.

Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences•Oct 22, 2012•21 citations

Diffusive Dynamics and Continuous Monitoring

Alessio Serafini

In the last chapter, we dealt with the wide class of physical operations that preserve the Gaussian character of the initial state, treating them as discrete transformations. Here, we describe what could loosely be considered the continuous-time version of such transformations. This chapter is intended to provide the reader with the tools to describe a wide range of notable quantum dynamics, with a very broad applicative scope. After a note on the action of linear and quadratic Hamiltonians, whose description follows directly from the theory of Gaussian states presented in Chapter 3 but was not explicitly clarified so far, we shall address systems linearly coupled to a reservoir of modes that are delta-correlated in time (a situation commonly referred to as ‘white noise’), and thus give rise to Markovian dynamics which we shall refer to as ‘diffusive’ for reasons that will be made clear in due time. Our story will commence with a derivation of the Gaussian dynamics resulting from such an environmental coupling, in the form of dynamical equations for the first and second statistical moments. Besides their interest per se , the latter will be instrumental in obtaining an unconventional derivation of the master equations that govern general, not necessarily Gaussian, quantum states under the same conditions. The corresponding quantum Langevin equations for the canonical operators in the Heisenberg picture will also be derived. Next, we will turn our attention to the study of the system's dynamics that result from the measurement of the environment. This is a topic with a longstanding tradition in quantum mechanics, grounded in the formalism of quantum stochastic calculus that emerged within the mathematical physics community as early as the seventies, and then re-introduced as the quantum trajectories approach in quantum optics almost twenty years later. The ‘weak’ POVMs resulting from observing a weakly coupled environment (as opposed to ‘strong’, projective measurements), carried out continuously in time (a prescription customarily subsumed by the term ‘monitoring’), leads to a stochastic dynamics for the system, where the randomness of the measurement outcomes is compactly and most elegantly represented by infinitesimal stochastic increments, giving rise to continuous but not differentiable quantum dynamics. Existing approaches to this subject tend to be quite impervious to the uninitiated. In the quantum optics literature, this is largely due to the technicalities involved in incorporating the discontinuous update of the quantum state prescribed by the von Neumann postulate. More mathematically oriented treatments have instead typically preferred an algebraic approach where the usual difficulty of describing measurements in the Heisenberg picture is compounded by the adoption of a rather abstract hierarchy of filters, in part inspired by classical control theory, to describe different possible updates of the quantum state. This state of affairs is further complicated by the added difficulties that come with the necessary introduction of some form of quantum stochastic calculus. Our approach to monitoring will therefore take a different route. Like in our derivation of diffusion and master equations, we shall keep restricting to linear couplings with a white noise environment, forfeiting full generality This situation is well modelled by the so called input-output formalism, whose physical origin will be discussed in detail in Chapter 9 , which approximates reliably, among other instances, the interaction between internal resonating modes and electromagnetic radiation leaking in and out of an optical cavity. First, we shall introduce stochastic Wiener increments and the Itô rule, which will arise naturally from the identification of the continuum field's modes subject to monitoring. We shall deliberately keep our arsenal of stochastic methods to these bare essentials, sacrificing to some extent both depth and generality, but still providing the reader with a powerful and seminal demonstration of the formalism. We shall then restrict to Gaussian general-dyne detections and apply the exact formalism developed in the previous chapter to the continuous filtering of the system's state conditioned by such measurements' outcomes. Next, as in our derivation of the unconditional master equations, we shall use the Gaussian dynamics as a key to unlock the full stochastic master equations governing general states. Hence, we will build on the quantum theory of filtering in the Gaussian regime to derive dynamical equations for linear feedback control and also apply our theoretical tools to the enhanced production of squeezing. Finally, we will turn to the closely related paradigm of coherent feedback, where environmental modes do not undergo measurements but are fed back to interact coherently with the system, see in detail how it modifies Gaussian diffusive dynamics and assess its potential for control by reconsidering the production of squeezing assisted by interferometric coherent feedback loops.

CRC Press eBooks•Jun 1, 2023•0 citations

Genuine quantum trajectories for non-Markovian processes

Heinz‐Peter Breuer

A large class of non-Markovian quantum processes in open systems can be formulated through time-local master equations which are not in Lindblad form. It is shown that such processes can be embedded in a Markovian dynamics which involves a time-dependent Lindblad generator on an extended state space. If the state space of the open system is given by some Hilbert space $\mathcal{H}$, the extended state space is the triple Hilbert space $\mathcal{H}\ensuremath{\bigotimes}{\mathbb{C}}^{3}$ which is obtained by combining the open system with a three-state system. This embedding is used to derive an unraveling for non-Markovian time evolution by means of a stochastic process in the extended state space. The process is defined through a stochastic Schr\"odinger equation which generates genuine quantum trajectories for the state vector conditioned on a continuous monitoring of an environment. The construction leads to a continuous measurement interpretation for non-Markovian dynamics within the framework of the theory of quantum measurement.

arXiv:quant-ph/0403117•Physical Review A•Jul 12, 2004•170 citations

Non-Markovian reduced propagator, multiple-time correlation functions, and master equations with general initial conditions in the weak-coupling limit

Inés de Vega, Daniel Alonso

In this paper we derive the evolution equation for the reduced propagator, an object that evolves vectors of the Hilbert space of a system $\mathcal{S}$ interacting with an environment $\mathcal{B}$ in a non-Markovian way. This evolution is conditioned to certain initial and final states of the environment. Once an average over these environmental states is made, reduced propagators permit the evaluation of multiple-time correlation functions of system observables. When this average is done stochastically the reduced propagator evolves according to a stochastic Schr\"odinger equation. In addition, it is possible to obtain the evolution equations of the multiple-time correlation functions which generalize the well-known quantum regression theorem to the non-Markovian case. Here, both methods, stochastic and evolution equations, are described by assuming a weak coupling between system and environment. Finally, we show that reduced propagators can be used to obtain a master equation with general initial conditions, and not necessarily an initial vacuum state for the environment. We illustrate the theory with several examples.

Physical Review A•Feb 2, 2006•43 citations
An effective approach to modeling non-Markovian quantum systems is to embed a principal (quantum) system of interest into a larger quantum system. A widely employed embedding is one that uses another quantum system, referred to as the auxiliary system, which is coupled to the principal system, and both the principal and auxiliary can be coupled to quantum white noise processes. The principal and auxiliary together form a quantum Markov system and the quantum white noises act as a bath (environment) for this system. Recently it was shown that the conditional evolution of the principal system in this embedding under continuous monitoring by a travelling quantum probe can be expressed as a system of coupled stochastic differential equations (SDEs) that involve only operators of the principal system. The reduced conditional state of the principal only (conditioned on the measurement outcomes) are determined by the “diagonal" blocks of this coupled systems of SDEs. It is shown here that the “off-diagonal" blocks can be exactly eliminated up to their initial conditions, leaving a reduced closed system of SDEs for the diagonal blocks only. Under additional conditions the off-diagonal initial conditions can be made to vanish. This new closed system of equations, which includes an integration term involving a two-time stochastic kernel, represents the non-Markovian stochastic dynamics of the principal system under continuous-measurement. The system of equations determine the reduced conditional state of the principal only and may be viewed as a stochastic Nakajima-Zwanzig type of equation for continuously monitored non-Markovian quantum systems.
Quantum Markov models are employed ubiqui-tously in quantum physics and in quantum information theory due to their relative simplicity and analytical tractability. In particular, these models are known to give accurate approxi-mations for a wide range of quantum optical and meso scopic systems. However, in general, the validity of the Markov approximation entails assumptions regarding properties of the system of interest and its environment, which may not be satisfied or accurate in arbitrary physical systems. Therefore, developing useful modelling tools for general non-Markovian quantum systems for which the Markov approximation is inappropriate or deficient is an undertaking of significant importance. This work considers non-Markovian principal quantum systems that can be embedded in a larger Markovian quantum system with one or more compound baths consisting of an auxiliary quantum system and a quantum white noise field, and derives a set of coupled stochastic and quantum master equations for embedded non-Markovian quantum systems. The case of a purely Hamiltonian coupling between the principal and auxiliary systems as a closed system without coupling to white noises is included as a special case. The results are expected to be of interest for (open-loop and feedback) control of continuous-time non-Markovian systems and studying reduced models for numerical simulation of such systems. They may also shed more light on the general structure of continuous-time non-Markovian quantum systems.
Quantum Markov models have been successfully used to accurately model various physical quantum systems in fields such as quantum optics, optomechanics and superconducting circuits and they provide the basis for (measurement-based) quantum feedback control. However, the quantum Markov assumption is a strong one and it is not expected to hold for general quantum systems of interest. The projection operator approach is one approach that has been developed to model non-Markovian quantum systems by considering its embedding in a larger Markovian quantum system, but mainly in the context of quantum master equations for the dynamics of the unmonitored reduced quantum state of a quantum system. This approach was recently adapted for continuously measured non-Markovian quantum systems, which enables open-loop control but did not yet consider the presence of feedback of the stochastic measurement record, deriving non-Markovian SDEs for the evolution of the projected state of the Markovian embedding. This paper generalizes these stochastic equations to the setting of stochastic feedback based on the continuous-measurement record and shows that the equations take the same form but that previously deterministic terms become stochastic ones which depend on the measurement record, as would be intuitively expected. The stochastic equations are obtained for a generalized class of measurements that includes continuous (possibly adaptive) homodyne and photon counting measurements.
In the last chapter, we dealt with the wide class of physical operations that preserve the Gaussian character of the initial state, treating them as discrete transformations. Here, we describe what could loosely be considered the continuous-time version of such transformations. This chapter is intended to provide the reader with the tools to describe a wide range of notable quantum dynamics, with a very broad applicative scope. After a note on the action of linear and quadratic Hamiltonians, whose description follows directly from the theory of Gaussian states presented in Chapter 3 but was not explicitly clarified so far, we shall address systems linearly coupled to a reservoir of modes that are delta-correlated in time (a situation commonly referred to as ‘white noise’), and thus give rise to Markovian dynamics which we shall refer to as ‘diffusive’ for reasons that will be made clear in due time. Our story will commence with a derivation of the Gaussian dynamics resulting from such an environmental coupling, in the form of dynamical equations for the first and second statistical moments. Besides their interest per se , the latter will be instrumental in obtaining an unconventional derivation of the master equations that govern general, not necessarily Gaussian, quantum states under the same conditions. The corresponding quantum Langevin equations for the canonical operators in the Heisenberg picture will also be derived. Next, we will turn our attention to the study of the system's dynamics that result from the measurement of the environment. This is a topic with a longstanding tradition in quantum mechanics, grounded in the formalism of quantum stochastic calculus that emerged within the mathematical physics community as early as the seventies, and then re-introduced as the quantum trajectories approach in quantum optics almost twenty years later. The ‘weak’ POVMs resulting from observing a weakly coupled environment (as opposed to ‘strong’, projective measurements), carried out continuously in time (a prescription customarily subsumed by the term ‘monitoring’), leads to a stochastic dynamics for the system, where the randomness of the measurement outcomes is compactly and most elegantly represented by infinitesimal stochastic increments, giving rise to continuous but not differentiable quantum dynamics. Existing approaches to this subject tend to be quite impervious to the uninitiated. In the quantum optics literature, this is largely due to the technicalities involved in incorporating the discontinuous update of the quantum state prescribed by the von Neumann postulate. More mathematically oriented treatments have instead typically preferred an algebraic approach where the usual difficulty of describing measurements in the Heisenberg picture is compounded by the adoption of a rather abstract hierarchy of filters, in part inspired by classical control theory, to describe different possible updates of the quantum state. This state of affairs is further complicated by the added difficulties that come with the necessary introduction of some form of quantum stochastic calculus. Our approach to monitoring will therefore take a different route. Like in our derivation of diffusion and master equations, we shall keep restricting to linear couplings with a white noise environment, forfeiting full generality This situation is well modelled by the so called input-output formalism, whose physical origin will be discussed in detail in Chapter 9 , which approximates reliably, among other instances, the interaction between internal resonating modes and electromagnetic radiation leaking in and out of an optical cavity. First, we shall introduce stochastic Wiener increments and the Itô rule, which will arise naturally from the identification of the continuum field's modes subject to monitoring. We shall deliberately keep our arsenal of stochastic methods to these bare essentials, sacrificing to some extent both depth and generality, but still providing the reader with a powerful and seminal demonstration of the formalism. We shall then restrict to Gaussian general-dyne detections and apply the exact formalism developed in the previous chapter to the continuous filtering of the system's state conditioned by such measurements' outcomes. Next, as in our derivation of the unconditional master equations, we shall use the Gaussian dynamics as a key to unlock the full stochastic master equations governing general states. Hence, we will build on the quantum theory of filtering in the Gaussian regime to derive dynamical equations for linear feedback control and also apply our theoretical tools to the enhanced production of squeezing. Finally, we will turn to the closely related paradigm of coherent feedback, where environmental modes do not undergo measurements but are fed back to interact coherently with the system, see in detail how it modifies Gaussian diffusive dynamics and assess its potential for control by reconsidering the production of squeezing assisted by interferometric coherent feedback loops.
A large class of non-Markovian quantum processes in open systems can be formulated through time-local master equations which are not in Lindblad form. It is shown that such processes can be embedded in a Markovian dynamics which involves a time-dependent Lindblad generator on an extended state space. If the state space of the open system is given by some Hilbert space H\mathcal{H}H, the extended state space is the triple Hilbert space $\mathcal{H}\ensuremath{\bigotimes}{\mathbb{C}}^{3}$ which is obtained by combining the open system with a three-state system. This embedding is used to derive an unraveling for non-Markovian time evolution by means of a stochastic process in the extended state space. The process is defined through a stochastic Schr\"odinger equation which generates genuine quantum trajectories for the state vector conditioned on a continuous monitoring of an environment. The construction leads to a continuous measurement interpretation for non-Markovian dynamics within the framework of the theory of quantum measurement.
In this paper we derive the evolution equation for the reduced propagator, an object that evolves vectors of the Hilbert space of a system S\mathcal{S}S interacting with an environment B\mathcal{B}B in a non-Markovian way. This evolution is conditioned to certain initial and final states of the environment. Once an average over these environmental states is made, reduced propagators permit the evaluation of multiple-time correlation functions of system observables. When this average is done stochastically the reduced propagator evolves according to a stochastic Schr\"odinger equation. In addition, it is possible to obtain the evolution equations of the multiple-time correlation functions which generalize the well-known quantum regression theorem to the non-Markovian case. Here, both methods, stochastic and evolution equations, are described by assuming a weak coupling between system and environment. Finally, we show that reduced propagators can be used to obtain a master equation with general initial conditions, and not necessarily an initial vacuum state for the environment. We illustrate the theory with several examples.