The concept of Logical Entropy, SL = 1-Σni=1 pi2, where the pi are normalized probabilities, was introduced by David Ellerman in a series of recent papers. Although the mathematical formula itself is not new, Ellerman provided a sound probabilistic interpretation of SL as a measure of the distinctions of a partition on a given set. The same formula comes across as a useful definition of entropy in quantum mechanics, where it is linked to the notion of purity of a quantum state. The quadratic form of the logical entropy lends itself to a generalization of the probabilities that include negative values, an idea that goes back to Feynman and Wigner. Here, we analyze and reinterpret negative probabilities in the light of the concept of logical entropy. Several intriguing quantum-like properties of the logical entropy are derived and discussed in finite dimensional spaces. For infinite-dimensional spaces (continuum), we show that, under the sole hypothesis that the logical entropy and the total probability are preserved in time, one obtains an evolution equation for the probability density that is basically identical to the quantum evolution of the Wigner function in phase space, at least when one considers only the momentum variable. This result suggest that the logical entropy plays a profound role in establishing the peculiar rules of quantum physics.
The concept of Logical Entropy, SL = 1-Σni=1 pi2, where the pi are normalized probabilities, was introduced by David Ellerman in a series of recent papers. Although the mathematical formula itself is not new, Ellerman provided a sound probabilistic interpretation of SL as a measure of the distinctions of a partition on a given set. The same formula comes across as a useful definition of entropy in quantum mechanics, where it is linked to the notion of purity of a quantum state. The quadratic form of the logical entropy lends itself to a generalization of the probabilities that include negative values, an idea that goes back to Feynman and Wigner. Here, we analyze and reinterpret negative probabilities in the light of the concept of logical entropy. Several intriguing quantum-like properties of the logical entropy are derived and discussed in finite dimensional spaces. For infinite-dimensional spaces (continuum), we show that, under the sole hypothesis that the logical entropy and the total probability are preserved in time, one obtains an evolution equation for the probability density that is basically identical to the quantum evolution of the Wigner function in phase space, at least when one considers only the momentum variable. This result suggest that the logical entropy plays a profound role in establishing the peculiar rules of quantum physics.
Logical entropy gives a measure, in the sense of measure theory, of the distinctions of a given partition of a set, an idea that can be naturally generalized to classical probability distributions. Here, we analyze how this fundamental concept and other related definitions can be applied to the study of quantum systems with the use of quantum logical entropy. Moreover, we prove several properties of this entropy for generic density matrices that may be relevant to various areas of quantum mechanics and quantum information. Furthermore, we extend the notion of quantum logical entropy to post-selected systems.
Abstract It is common knowledge that the Wigner function of a quantum state may admit negative values, so that it cannot be viewed as a genuine probability density. Here, we examine the difficulty in finding an entropy-like functional in phase space that extends to negative Wigner functions and then advocate the merits of defining a complex-valued entropy associated with any Wigner function. This quantity, which we call thecomplex Wigner entropy, is defined via the analytic continuation of Shannon’s differential entropy of the Wigner function in the complex plane. We show that the complex Wigner entropy enjoys interesting properties, especially its real and imaginary parts are both invariant under Gaussian unitaries (displacements, rotations, and squeezing in phase space). Its real part is physically relevant when considering the evolution of the Wigner function under a Gaussian convolution, while its imaginary part is simply proportional to the negative volume of the Wigner function. Finally, we define the complex-valued Fisher information of any Wigner function, which is linked (via an extended de Bruijn’s identity) to the time derivative of the complex Wigner entropy when the state undergoes Gaussian additive noise. Overall, it is anticipated that the complex plane yields a proper framework for analyzing the entropic properties of quasiprobability distributions in phase space.
We live in the information age. Claude Shannon, as the father of the information age, gave us a theory of communications that quantified an “amount of information,” but, as he pointed out, “no concept of information itself was defined.” Logical entropy provides that definition. Logical entropy is the natural measure of the notion of information based on distinctions, differences, distinguishability, and diversity. It is the (normalized) quantitative measure of the distinctions of a partition on a set-just as the Boole–Laplace logical probability is the normalized quantitative measure of the elements of a subset of a set. And partitions and subsets are mathematically dual concepts – so the logic of partitions is dual in that sense to the usual Boolean logic of subsets, and hence the name “logical entropy.” The logical entropy of a partition has a simple interpretation as the probability that a distinction or dit (elements in different blocks) is obtained in two independent draws from the underlying set. The Shannon entropy is shown to also be based on this notion of information-as-distinctions; it is the average minimum number of binary partitions (bits) that need to be joined to make all the same distinctions of the given partition. Hence all the concepts of simple, joint, conditional, and mutual logical entropy can be transformed into the corresponding concepts of Shannon entropy by a uniform non-linear dit-bit transform. And finally logical entropy linearizes naturally to the corresponding quantum concept. The quantum logical entropy of an observable applied to a state is the probability that two different eigenvalues are obtained in two independent projective measurements of that observable on that state.
The new logic of partitions is dual to the usual Boolean logic of subsets (usually presented only in the special case of the logic of propositions) in the sense that partitions and subsets are category-theoretic duals. The new information measure of logical entropy is the normalized quantitative version of partitions. The new approach to interpreting quantum mechanics (QM) is showing that the mathematics (not the physics) of QM is the linearized Hilbert space version of the mathematics of partitions. Or, putting it the other way around, the math of partitions is a skeletal version of the math of QM. The key concepts throughout this progression from logic, to logical information, to quantum theory are distinctions versus indistinctions, definiteness versus indefiniteness, or distinguishability versus indistinguishability. The distinctions of a partition are the ordered pairs of elements from the underlying set that are in different blocks of the partition and logical entropy is defined (initially) as the normalized number of distinctions. The cognate notions of definiteness and distinguishability run throughout the math of QM, e.g., in the key non-classical notion of superposition (=ontic indefiniteness) and in the Feynman rules for adding amplitudes (indistinguishable alternatives) versus adding probabilities (distinguishable alternatives).
The concept of entropy rst arose in the study of thermodynamics and statistical me- chanics. In information theory the so-called Shannon entropy plays a signi cant role, which measures how much information we gain, on average, when we learn the value of a random variable. An alternative interpretation is that the entropy of the random variable quanti es the amount of uncertainty about the random variable before we learn its value. The concept was introduced by Claude E. Shannon in his 1948 paper "A Mathematical Theory of Communication". In the rst part of the present work we consider this fundamental measure of information and show some of its properties, such as non-negativity. The relative entropy or the Kullback-Leibler divergence is a very useful measure of the distance between two prob- ability distributions. After introducing its de nition and other notions (joint entropy, conditional entropy or mutual information) we can prove additional assertions about the Shannon entropy and present statements about the relations between the above men- tioned quantities. In quantum information theory, there is a quantity, namely von Neumann entropy, which corresponds to Shannon entropy and originates from it. In the section Von Neu- mann entropy we will introduce this quantity which is a continuous functional on the states, or on their mathematical representatives, the density operators, and it ful ls in- equalities such as subadditivity and strong subaddititvity. Just as with the Shannon entropy, it is extremely useful to de ne a quantum version of the relative entropy, which is one of the most important numerical quantities appearing in quantum information theory. It is used as a measure of distinguishability between quantum states. Among others its properties are jointly convexity, monotonicity which are speci cally convenient. Transformations on structures which preserve operations, quantities or relations among elements appear in many areas of mathematics. These are the so-called preservers which show up also in physics and even in chemistry where they are usually called symmetries. Therefore, the study of preserver transformations is an important area of research. The third section of this work is based on a paper, in which Lajos Molnár described the structure every bijective map on the space of all density operators on a given Hilbert space, which preserves the relative entropy. This result is closely related to Wigner's famous theorem on the form of quantum mechanical symmetry transformations. The above theorem of Molnár can be extended into two directions. On the one hand, the result holds also in the case when the transformation under consideration acts on the space of all positive semide nite operators not only on density operators (i.e., we omit the condition of unit trace). On the other hand the statement remains valid even if we omit the strongly restrictive condition that the transformation is bijective. The second result is a joint work with Prof. Lajos Molnár which appeared in the journal Linear Algebra and Its Applications.
Abstract Starting at the logical level of the logic of partitions, dual to the usual Boolean logic of subsets, the notion of logical entropy, i.e., information as distinctions, is developed as the quantification of the distinctions of partitions—just as probability theory starts with the quantification of elements of subsets. Logical entropy is compared and contrasted with the usual notion of Shannon entropy. Then a semi-algorithmic procedure (from the mathematical folklore) is used to translate the notion of logical entropy at the set level to the corresponding notion of quantum logical entropy at the (Hilbert) vector space level. Examples and some important propositions relate quantum logical entropy to projective measurement and to the Hilbert-Schmidt distance. Overall, the approach demonstrates the logical basis and naturality of this notion of entropy for quantum mechanics.