Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression proper ties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement the pattern of non-classical correlations be tween systems is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies as sign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical truth emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.
Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression proper ties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement the pattern of non-classical correlations be tween systems is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies as sign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical truth emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.
Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression properties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement—the pattern of non-classical correlations between systems—is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies assign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical “truth” emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.
This paper explores the fundamental relationship between the geometry of entanglement and von Neumann entropy, shedding light on the intricate nature of quantum correlations. We provide a comprehensive overview of entanglement, highlighting its crucial role in quantum mechanics. Our focus centers on the connection between entanglement, von Neumann entropy, a measure of the information content within quantum systems and the geometry of composite Hilbert spaces. We discuss various methods for quantifying and characterizing entanglement through a geometric perspective and elucidate how this connection unveils the nature of quantum entanglement, offering valuable insights into the underlying structure of quantum systems. This study underscores the significance of geometry as a key tool for understanding the rich landscape of quantum correlations and their implications across various domains of physics and information theory. An example of entanglement as an indispensable resource for the task of state teleportation is presented at the end.
The presence of correlations shared among the subparts of a given physical system, and which do not have a classical counterpart, is a clear signature of non-classicality for a quantum state. As we saw in Chap. 2, such correlations can be captured by entanglement, one of the most intriguing features predicted by quantum theory, which points directly to a violation of the Bell’s inequalities. In this chapter we provide a rigorous definition of entanglement, and review its basic properties together with the general framework that is needed to quantify it for bipartite states. We present the common criteria that are used to detect whether a state is entangled or not, and discuss the most common entanglement quantifiers in the bipartite context. The latter follow an introduction of the cornerstone concepts of classical Shannon entropy and quantum von Neumann entropy. Subsequently, the multipartite scenario is briefly addressed. Although entanglement is the most remarkable among non-classical correlations, even some separable (not entangled) mixed states can exhibit a non-classical behaviour. In this wider context we discuss the quantum discord, which is expressed as the difference between two entropic quantities and is extractable by performing a local measure on one of the subsystems. This, and other related quantifiers, enlighten the impossibility of recovering the information contained in a composite quantum system after the measurement process. A special-topic section on the different definitions of entropy used in physics closes the chapter.
In this chapter, we discuss several information measures that are important for quantifying the amount of information and correlations that are present in quantum systems. The first fundamental measure that we introduce is the von Neumman entropy. It is the quantum analog of the Shannon entropy, but it captures both classical and quantum uncertainty in a quantum state. The von Neumann entropy gives meaning to a notion of the information qubit . This notion is different from that of the physical qubit, which is the description of a quantum state in an electron or a photon. The information qubit is the fundamental quantum informational unit of measure, determining how much quantum information is in a quantum system. The beginning definitions here are analogous to the classical definitions of entropy, but we soon discover a radical departure from the intuitive classical notions from the previous chapter: the conditional quantum entropy can be negative for certain quantum states. In the classical world, this negativity simply does not occur, but it takes a special meaning in quantum information theory. Pure quantum states that are entangled have stronger-than-classical spatial correlations and are examples of states that have negative conditional entropy. The negative of the conditional quantum entropy is so important in quantum information theory that we even have a special name for it: the coherent information. We discover that the coherent information obeys a quantum data-processing inequality, placing it on a firm footing as a particular informational measure of quantum correlations.
The idea that information can be localized is pervasive in physics. In thermodynamics, entropy flows from one reservoir to another, and in quantum gravity, the entropy content of some spatial regions is bounded. In quantum information theory, information is transmitted from one place to another, and entanglement can provide an advantage when there are constraints on such transmission.
Shannon entropy quantifies localizable information in the sense that marginalization defines an outer measure on the set of parts of a classical multipartite system. In contrast, von Neumann entropy does not quantify localizable information in this sense. However, a variant of von Neumann entropy, which originates in noncommutative geometry, does.
We prove that this adjusted von Neumann entropy is the minimum quantum entropy that quantifies localizable information. We also prove that this is the unique quantum entropy that characterizes Bell states in terms of redundant information, directly generalizing the classical case. We work with finite-dimensional C∗-algebras throughout, modeling finite quantum systems that may have superselection sectors.
The concept of entropy rst arose in the study of thermodynamics and statistical me- chanics. In information theory the so-called Shannon entropy plays a signi cant role, which measures how much information we gain, on average, when we learn the value of a random variable. An alternative interpretation is that the entropy of the random variable quanti es the amount of uncertainty about the random variable before we learn its value. The concept was introduced by Claude E. Shannon in his 1948 paper "A Mathematical Theory of Communication". In the rst part of the present work we consider this fundamental measure of information and show some of its properties, such as non-negativity. The relative entropy or the Kullback-Leibler divergence is a very useful measure of the distance between two prob- ability distributions. After introducing its de nition and other notions (joint entropy, conditional entropy or mutual information) we can prove additional assertions about the Shannon entropy and present statements about the relations between the above men- tioned quantities. In quantum information theory, there is a quantity, namely von Neumann entropy, which corresponds to Shannon entropy and originates from it. In the section Von Neu- mann entropy we will introduce this quantity which is a continuous functional on the states, or on their mathematical representatives, the density operators, and it ful ls in- equalities such as subadditivity and strong subaddititvity. Just as with the Shannon entropy, it is extremely useful to de ne a quantum version of the relative entropy, which is one of the most important numerical quantities appearing in quantum information theory. It is used as a measure of distinguishability between quantum states. Among others its properties are jointly convexity, monotonicity which are speci cally convenient. Transformations on structures which preserve operations, quantities or relations among elements appear in many areas of mathematics. These are the so-called preservers which show up also in physics and even in chemistry where they are usually called symmetries. Therefore, the study of preserver transformations is an important area of research. The third section of this work is based on a paper, in which Lajos Molnár described the structure every bijective map on the space of all density operators on a given Hilbert space, which preserves the relative entropy. This result is closely related to Wigner's famous theorem on the form of quantum mechanical symmetry transformations. The above theorem of Molnár can be extended into two directions. On the one hand, the result holds also in the case when the transformation under consideration acts on the space of all positive semide nite operators not only on density operators (i.e., we omit the condition of unit trace). On the other hand the statement remains valid even if we omit the strongly restrictive condition that the transformation is bijective. The second result is a joint work with Prof. Lajos Molnár which appeared in the journal Linear Algebra and Its Applications.