Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

AIP conference proceedings

Mutual Information in Quantum Systems

Lev B. Levitin

Published Jan 1, 2004• 1 citation
Publisher

Abstract

The concepts of conditional entropy and information between subsystems of a composite quantum system are generalized to include arbitrary indirect measurements (POVMs). Some properties of those quantities differ from those of their classical counterparts; certain equalities and inequalities of classical information theory may be violated.

DOI
10.1063/1.1834375

Related papers

Conditional Entropy and Information in Quantum Systems

Lev B. Levitin

The concepts of conditional entropy of a physical system given the state of another system and of information in a physical system about another one are generalized for quantum systems. The fundamental difference between the classical case and the quantum one is that the entropy and information in quantum systems depend on the choice of measurements performed over the systems. It is shown that some equalities of the classical information theory turn into inequalities for the generalized quantities. Specific quantum phenomena such as EPR pairs and superdense coding are described and explained in terms of the generalized conditional entropy and information.

Chaos Solitons & Fractals•Sep 1, 1999•10 citations

Conditional entropy and information in quantum systems

Lev B. Levitin

The concepts of conditional entropy of a physical system given the state of another system and of information in a physical system about another one are generalized for quantum systems. It is shown that some equalities of the classical information theory turn into inequalities for the generalized quantities.

IEEE International Symposium on Information Theory (ISIT)•Nov 27, 2002•3 citations

Exploiting variational formulas for quantum relative entropy

Mario Berta, Omar Fawzi, Marco Tomamichel

The relative entropy is the basic concept underlying various information measures like entropy, conditional entropy and mutual information. Here, we discuss how to make use of variational formulas for measured relative entropy and quantum relative entropy for understanding the additivity properties of various entropic quantities that appear in quantum information theory. In particular, we show that certain lower bounds on quantum conditional mutual information are superadditive.

IEEE International Symposium on Information Theory (ISIT)•Jul 1, 2016•4 citations

Mutual Information: A way to quantify correlations

Marcelo Tisoc, J. Beltrán

Within the framework of Information Theory, the existence of correlations between two random variables means that we can obtain information about one of them, just by measuring or observing the other random variable. In certain cases, this kind of relationship allows obtaining information about a variable even when the other is separated by a very large distance, that is, the process of obtaining information is non-local, an example (if not the only) is the quantum entanglement. These features of correlations make it interesting and important to study, classify and quantify them. The correlations are classified into classical correlations and quantum correlations, in addition they are quantified through the mutual information. Here we will present a natural way to define classical mutual information and then we will generalize it to the quantum case. Furthermore, every term in the definitions of mutual information will be interpreted using the concepts of classical and quantum entropy.

Revista Brasileira de Ensino de Física•Jan 1, 2022•8 citations

Information Theory Meets Quantum Chemistry: A Review and Perspective

Yilin Zhao, Dongbo Zhao, Chunying Rong +2 more

In this survey, we begin with a concise introduction to information theory within Shannon's framework, focusing on the key concept of Shannon entropy and its related quantities: relative entropy, joint entropy, conditional entropy, and mutual information. We then demonstrate how to apply these information-theoretic tools in quantum chemistry, adopting either classical or quantum formalisms based on the choice of information carrier involved.

Entropy•Jun 16, 2025•16 citations

Addendum Entropy and information causality in general probabilistic theories

Howard Barnum, Jonathan Barrett, Lisa Orloff Clark +5 more

In this addendum to our paper (2010 New J. Phys. 12 033024), we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In this addendum to our paper [1], we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In [1], we defined notions of measurement and mixing entropy for a broad class of probabilistic theories (which includes finite-dimensional quantum theory). We defined a theory to be monoentropic if for every state of a system in the theory, the mixing entropy (denoted S) is equal to the measurement entropy (denoted H ). This broad class of theories has a notion of composite system, and of the ‘marginal state’ of a subsystem given a state for the composite system, so that the strong subadditivity inequality may be formulated for real-valued functions of states, including the measurement and mixing entropies. We proved the following theorem. Theorem 1 (theorem 4 of [1]). Suppose that a theory has the following properties: (1) it is monoentropic, meaning that measurement entropy equals mixing entropy for all systems, (2) its measurement entropy is strongly subadditive and (3) its measurement entropy satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. In [1] we noted that monoentropicity was only used to establish the technical condition of positivity of conditional information, H(A|C), defined as H(AC)− H(C), when A is classical. This condition does not hold for all theories in the broad class we consider. Shortly after submitting the final version of [1], but too late for inclusion therein, we noticed that it does, however, hold for all theories satisfying strong subadditivity, enabling us to strengthen our theorem as follows. Theorem 2. Suppose that a theory’s measurement entropy is strongly subadditive and satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. As noted in our earlier paper, one can replace the two premises of this theorem with the single premise that the measurement entropy satisfies the data processing inequality. To see that H(A|C)> 0 for classical A follows from strong subadditivity, we recall (from e.g. lemma 1 of [1]), that strong subadditivity is equivalent to the positivity of conditional mutual information, I (A : B|C)> 0. Letting A and B be perfectly correlated classical systems in this inequality, we have I (A : B|C)= H(A|C)+ H(B|C)− H(AB|C) = H(AC)− H(C)+ H(BC) − H(C)− H(ABC)+ H(C) = H(AC)+ H(BC)− H(ABC)− H(C). New Journal of Physics 14 (2012) 129401 (http://www.njp.org/)

•Jan 1, 2012•0 citations
The concepts of conditional entropy and information between subsystems of a composite quantum system are generalized to include arbitrary indirect measurements (POVMs). Some properties of those quantities differ from those of their classical counterparts; certain equalities and inequalities of classical information theory may be violated.
The concepts of conditional entropy of a physical system given the state of another system and of information in a physical system about another one are generalized for quantum systems. The fundamental difference between the classical case and the quantum one is that the entropy and information in quantum systems depend on the choice of measurements performed over the systems. It is shown that some equalities of the classical information theory turn into inequalities for the generalized quantities. Specific quantum phenomena such as EPR pairs and superdense coding are described and explained in terms of the generalized conditional entropy and information.
Within the framework of Information Theory, the existence of correlations between two random variables means that we can obtain information about one of them, just by measuring or observing the other random variable. In certain cases, this kind of relationship allows obtaining information about a variable even when the other is separated by a very large distance, that is, the process of obtaining information is non-local, an example (if not the only) is the quantum entanglement. These features of correlations make it interesting and important to study, classify and quantify them. The correlations are classified into classical correlations and quantum correlations, in addition they are quantified through the mutual information. Here we will present a natural way to define classical mutual information and then we will generalize it to the quantum case. Furthermore, every term in the definitions of mutual information will be interpreted using the concepts of classical and quantum entropy.
In this addendum to our paper (2010 New J. Phys. 12 033024), we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In this addendum to our paper [1], we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In [1], we defined notions of measurement and mixing entropy for a broad class of probabilistic theories (which includes finite-dimensional quantum theory). We defined a theory to be monoentropic if for every state of a system in the theory, the mixing entropy (denoted S) is equal to the measurement entropy (denoted H ). This broad class of theories has a notion of composite system, and of the ‘marginal state’ of a subsystem given a state for the composite system, so that the strong subadditivity inequality may be formulated for real-valued functions of states, including the measurement and mixing entropies. We proved the following theorem. Theorem 1 (theorem 4 of [1]). Suppose that a theory has the following properties: (1) it is monoentropic, meaning that measurement entropy equals mixing entropy for all systems, (2) its measurement entropy is strongly subadditive and (3) its measurement entropy satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. In [1] we noted that monoentropicity was only used to establish the technical condition of positivity of conditional information, H(A|C), defined as H(AC)− H(C), when A is classical. This condition does not hold for all theories in the broad class we consider. Shortly after submitting the final version of [1], but too late for inclusion therein, we noticed that it does, however, hold for all theories satisfying strong subadditivity, enabling us to strengthen our theorem as follows. Theorem 2. Suppose that a theory’s measurement entropy is strongly subadditive and satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. As noted in our earlier paper, one can replace the two premises of this theorem with the single premise that the measurement entropy satisfies the data processing inequality. To see that H(A|C)> 0 for classical A follows from strong subadditivity, we recall (from e.g. lemma 1 of [1]), that strong subadditivity is equivalent to the positivity of conditional mutual information, I (A : B|C)> 0. Letting A and B be perfectly correlated classical systems in this inequality, we have I (A : B|C)= H(A|C)+ H(B|C)− H(AB|C) = H(AC)− H(C)+ H(BC) − H(C)− H(ABC)+ H(C) = H(AC)+ H(BC)− H(ABC)− H(C). New Journal of Physics 14 (2012) 129401 (http://www.njp.org/)