Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:quant-ph/0212065 · Electronic Notes in Theoretical Computer Science

Entropic Geometry from Logic

Bob Coecke

Published Jan 1, 2003• 9 citations
arXivHTMLPDF

Abstract

We establish the following equation: Quantitative Probability = Logic + Partiality of Knowledge + Entropy I.e.: 1. A finitary probability space Δn (= all probability measures on {1,…, n}) can be fully and faithfully represented by the pair consisting of the abstraction Dn (= the object up to isomorphism) of the partially ordered set (Δn, ⊑) introduced in [3], and, Shannon entropy; 2. Dn itself can be obtained via a systematic purely order-theoretic procedure (which embodies introduction of partiality of knowledge) on an (algebraic) logic. This procedure applies to any poset A; DA ≅ (Δn ,⊑) when A is the n-element powerset and DA ≅ (Ωn, ⊑), the domain of mixed quantum states also introduced in [3], when A is the lattice of subspaces of a Hilbert space.

DOI
10.1016/s1571-0661(03)50003-2

Related papers

Logical Entropy: Introduction to Classical and Quantum Logical Information Theory

David Ellerman

Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences and distinguishability and is formalized using the distinctions ("dits") of a partition (a pair of points distinguished by the partition). All the definitions of simple, joint, conditional and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates (cohered together in the pure superposition state being measured) that are distinguished by the measurement (decohered in the post-measurement mixed state). Both the classical and quantum versions of logical entropy have simple interpretations as "two-draw" probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states.

Entropy•Sep 6, 2018•30 citations

A New Logical Measure for Quantum Information

David Ellerman

Abstract Starting at the logical level of the logic of partitions, dual to the usual Boolean logic of subsets, the notion of logical entropy, i.e., information as distinctions, is developed as the quantification of the distinctions of partitions—just as probability theory starts with the quantification of elements of subsets. Logical entropy is compared and contrasted with the usual notion of Shannon entropy. Then a semi-algorithmic procedure (from the mathematical folklore) is used to translate the notion of logical entropy at the set level to the corresponding notion of quantum logical entropy at the (Hilbert) vector space level. Examples and some important propositions relate quantum logical entropy to projective measurement and to the Hilbert-Schmidt distance. Overall, the approach demonstrates the logical basis and naturality of this notion of entropy for quantum mechanics.

Quantum Information and Computation•Feb 25, 2025•2 citations

Introduction to logical entropy and its relationship to Shannon entropy

David Ellerman

We live in the information age. Claude Shannon, as the father of the information age, gave us a theory of communications that quantified an “amount of information,” but, as he pointed out, “no concept of information itself was defined.” Logical entropy provides that definition. Logical entropy is the natural measure of the notion of information based on distinctions, differences, distinguishability, and diversity. It is the (normalized) quantitative measure of the distinctions of a partition on a set-just as the Boole–Laplace logical probability is the normalized quantitative measure of the elements of a subset of a set. And partitions and subsets are mathematically dual concepts – so the logic of partitions is dual in that sense to the usual Boolean logic of subsets, and hence the name “logical entropy.” The logical entropy of a partition has a simple interpretation as the probability that a distinction or dit (elements in different blocks) is obtained in two independent draws from the underlying set. The Shannon entropy is shown to also be based on this notion of information-as-distinctions; it is the average minimum number of binary partitions (bits) that need to be joined to make all the same distinctions of the given partition. Hence all the concepts of simple, joint, conditional, and mutual logical entropy can be transformed into the corresponding concepts of Shannon entropy by a uniform non-linear dit-bit transform. And finally logical entropy linearizes naturally to the corresponding quantum concept. The quantum logical entropy of an observable applied to a state is the probability that two different eigenvalues are obtained in two independent projective measurements of that observable on that state.

4open•Jan 1, 2022•13 citations

Probability in quantum mechanics

J. V. Corbett

Quantum mechanics is usually described in the terminology of probability theory even though the properties of the probability spaces associated with it are fundamentally different from the standard ones of probability theory. For example, Kolmogorov's axioms are not general enough to encompass the non-commutative situations that arise in quantum theory. There have been many attempts to generalise these axioms to meet the needs of quantum mechanics. The focus of these attempts has been the observation, first made by Birkhoff and von Neumann (1936), that the propositions associated with a quantum-mechanical system do not form a Boolean σ-algebra. There is almost universal agreement that the probability space associated with a quantum-mechanical system is given by the set of subspaces of a separable Hilbert space, but there is disagreement over the algebraic structure that this set represents. In the most popular model for the probability space of quantum mechanics the propositions are assumed to form an orthocomplemented lattice (Mackey (1963), Jauch (1968)). The fundamental concept here is that of a partial order, that is a binary relation that is reflexive and transitive but not symmetric. The partial order is interpreted as embodying the logical concept of implication in the set of propositions associated with the physical system. Although this model provides an acceptable mathematical expression of the probabilistic structure of quantum mechanics in that the subspaces of a separable Hilbert space give a representation of an ortho-complemented lattice, it has several deficiencies which will be discussed later.

Advances in Applied Probability•Dec 1, 1978•1 citation

Introduction to Quantum Logical Information Theory: Talk

David Ellerman

Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences, and distinguishability, and is formalized using the distinctions (“dits”) of a partition (a pair of points distinguished by the partition). All the definitions of simple, joint, conditional, and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this talk is to outline the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., “qudits” of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates (cohered together in the pure superposition state being measured) that are distinguished by the measurement (decohered in the postmeasurement mixed state). Both the classical and quantum versions of logical entropy have simple interpretations as “two-draw” probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states.

EPJ Web of Conferences•Jan 1, 2018•1 citation

New Logical Foundations for Quantum Information Theory: Introduction to Quantum Logical Information Theory

David Ellerman

Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences, and distinguishability, and is formalized using the distinctions (`dits') of a partition (a pair of points distinguished by the partition). All the definitions of simple, joint, conditional, and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates (cohered together in the pure superposition state being measured) that are distinguished by the measurement (decohered in the post-measurement mixed state). Both the classical and quantum versions of logical entropy have simple interpretations as "two-draw" probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states.

arXiv:1707.04728•Jul 15, 2017•1 citation
We establish the following equation: Quantitative Probability = Logic + Partiality of Knowledge + Entropy I.e.: 1. A finitary probability space Δn (= all probability measures on {1,…, n}) can be fully and faithfully represented by the pair consisting of the abstraction Dn (= the object up to isomorphism) of the partially ordered set (Δn, ⊑) introduced in [3], and, Shannon entropy; 2. Dn itself can be obtained via a systematic purely order-theoretic procedure (which embodies introduction of partiality of knowledge) on an (algebraic) logic. This procedure applies to any poset A; DA ≅ (Δn ,⊑) when A is the n-element powerset and DA ≅ (Ωn, ⊑), the domain of mixed quantum states also introduced in [3], when A is the lattice of subspaces of a Hilbert space.
Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences and distinguishability and is formalized using the distinctions ("dits") of a partition (a pair of points distinguished by the partition). All the definitions of simple, joint, conditional and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates (cohered together in the pure superposition state being measured) that are distinguished by the measurement (decohered in the post-measurement mixed state). Both the classical and quantum versions of logical entropy have simple interpretations as "two-draw" probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states.
Abstract Starting at the logical level of the logic of partitions, dual to the usual Boolean logic of subsets, the notion of logical entropy, i.e., information as distinctions, is developed as the quantification of the distinctions of partitions—just as probability theory starts with the quantification of elements of subsets. Logical entropy is compared and contrasted with the usual notion of Shannon entropy. Then a semi-algorithmic procedure (from the mathematical folklore) is used to translate the notion of logical entropy at the set level to the corresponding notion of quantum logical entropy at the (Hilbert) vector space level. Examples and some important propositions relate quantum logical entropy to projective measurement and to the Hilbert-Schmidt distance. Overall, the approach demonstrates the logical basis and naturality of this notion of entropy for quantum mechanics.
We live in the information age. Claude Shannon, as the father of the information age, gave us a theory of communications that quantified an “amount of information,” but, as he pointed out, “no concept of information itself was defined.” Logical entropy provides that definition. Logical entropy is the natural measure of the notion of information based on distinctions, differences, distinguishability, and diversity. It is the (normalized) quantitative measure of the distinctions of a partition on a set-just as the Boole–Laplace logical probability is the normalized quantitative measure of the elements of a subset of a set. And partitions and subsets are mathematically dual concepts – so the logic of partitions is dual in that sense to the usual Boolean logic of subsets, and hence the name “logical entropy.” The logical entropy of a partition has a simple interpretation as the probability that a distinction or dit (elements in different blocks) is obtained in two independent draws from the underlying set. The Shannon entropy is shown to also be based on this notion of information-as-distinctions; it is the average minimum number of binary partitions (bits) that need to be joined to make all the same distinctions of the given partition. Hence all the concepts of simple, joint, conditional, and mutual logical entropy can be transformed into the corresponding concepts of Shannon entropy by a uniform non-linear dit-bit transform. And finally logical entropy linearizes naturally to the corresponding quantum concept. The quantum logical entropy of an observable applied to a state is the probability that two different eigenvalues are obtained in two independent projective measurements of that observable on that state.
Quantum mechanics is usually described in the terminology of probability theory even though the properties of the probability spaces associated with it are fundamentally different from the standard ones of probability theory. For example, Kolmogorov's axioms are not general enough to encompass the non-commutative situations that arise in quantum theory. There have been many attempts to generalise these axioms to meet the needs of quantum mechanics. The focus of these attempts has been the observation, first made by Birkhoff and von Neumann (1936), that the propositions associated with a quantum-mechanical system do not form a Boolean σ-algebra. There is almost universal agreement that the probability space associated with a quantum-mechanical system is given by the set of subspaces of a separable Hilbert space, but there is disagreement over the algebraic structure that this set represents. In the most popular model for the probability space of quantum mechanics the propositions are assumed to form an orthocomplemented lattice (Mackey (1963), Jauch (1968)). The fundamental concept here is that of a partial order, that is a binary relation that is reflexive and transitive but not symmetric. The partial order is interpreted as embodying the logical concept of implication in the set of propositions associated with the physical system. Although this model provides an acceptable mathematical expression of the probabilistic structure of quantum mechanics in that the subspaces of a separable Hilbert space give a representation of an ortho-complemented lattice, it has several deficiencies which will be discussed later.
Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences, and distinguishability, and is formalized using the distinctions (“dits”) of a partition (a pair of points distinguished by the partition). All the definitions of simple, joint, conditional, and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this talk is to outline the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., “qudits” of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates (cohered together in the pure superposition state being measured) that are distinguished by the measurement (decohered in the postmeasurement mixed state). Both the classical and quantum versions of logical entropy have simple interpretations as “two-draw” probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states.
Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences, and distinguishability, and is formalized using the distinctions (`dits') of a partition (a pair of points distinguished by the partition). All the definitions of simple, joint, conditional, and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates (cohered together in the pure superposition state being measured) that are distinguished by the measurement (decohered in the post-measurement mixed state). Both the classical and quantum versions of logical entropy have simple interpretations as "two-draw" probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states.