Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Shannon Entropy: From Probabilities to Particles

Thomas Wallek, Andreas Pfennig

Published Feb 13, 2012• 0 citations
OpenAlex

Related papers

Physical information entropy and probability Shannon entropy

Renato Ascoli, R. Urigu

International Journal of Theoretical Physics•Aug 1, 1997•0 citations

Shannon's Entropy and the Correspondence Principle

Francesco R. Ruggeri

In the literature (e.g. (1)), the expression - density(x) ln(density(x)) is used as Shannon’s spatial entropy for a quantum system (bound or not). For the bound case, the correspondence principle is said to hold for high energy levels (2). In that case, quantum density = W(x)W(x) (W(x)=real wavefunction) is said to be equivalent to the classical density C/v(x) where v(x) the velocity is given by .5mv(x)v(x) + V(x) = E. Classical density yields a curve which passes through peak regions of quantum density humps. In the classical case, particle motion is completely determinate. C/v(x) as a density (probability) is proportional to dt, the amount of time a particle spends passing through a fixed length dx. If the particle moves quickly, it spends little time, and hence there is less time for a measurement (i.e one may miss the particle due to its speed). We argue in this note that such a scenario does not seem to be in keeping with the ideas of Shannon’s entropy where one has probabilities for certain mutually exclusive events at each ti. For example at each ti, one may toss a coin. If it is not “heads”, this means it is tails. For the classical particle in the correspondence principle, each dx region has its own probability proportional to dt = dx/v(x). Thus, each dx is a region of its own in terms of probability. Thus, if Ci measurements of the presence of the particle are made within dx of xi out of N trials, the probability that a measurement is made in dx at xi is Ci/N and the probability that it is not is 1-Ci/N. Thus, unlike Shannon’s picture, various arrangements do not have the same weight or probability. We investigate this scenario in more detail and argue that it does not follow the approach of Shannon’s entropy. We also try to connect with the quantum situation.

•Oct 16, 2020•0 citations

Information Theory and Statistical Entropy

Roger Balian

Springer eBooks•Jan 1, 1991•2 citations

Shannon and Renyi Entropy of Wavelets

H. M. de Oliveira

This paper reports a new reading for wavelets, which is based on the classical 'De Broglie' principle. The wave-particle duality principle is adapted to wavelets. Every continuous basic wavelet is associated with a proper probability density, allowing defining the Shannon entropy of a wavelet. Further entropy definitions are considered, such as Jumarie or Renyi entropy of wavelets. We proved that any wavelet of the same family has the same Shannon entropy of its mother wavelet. Finally, the Shannon entropy for a few standard wavelet families is determined.

arXiv:1502.01871•Feb 6, 2015•5 citations

Introduction to Logical Entropy and its Relationship to Shannon Entropy

David Ellerman

•Jan 1, 2021•8 citations

Maximization Of Arrangements and Quantum Bound States

Francesco R. Ruggeri

The Maxwell-Boltzmann MB distribution is often derived by maximizing the number of possible arrangements of particles with different energies subject to the constraint of a fixed number of particles and fixed energy. Using the canonical approximation that only average energy is conserved and using Stirling’s approximation for large number factorials leads to the Maxwell-Boltzmann distribution. The ln of total number of arrangements using Stirling’s approximation is linked to a math form called Shannon’s entropy i.e. - Sum over i f(ei) ln(f(ei)). Interestingly this same MB result may be obtained through reaction balance which makes no use of the idea of arrangements or entropy or maximization. It is concerned with including all possible physical reactions (for example two body reactions between all energy particles) subject to conservation of energy. In this sense it deals directly with the dynamics of the problem while the arrangement approach does not. The dynamical approach considers all possible reactions with notions of independence or lack of information and ensures the system remains unchanged. Why are they the same? We argue that it is because the “recipe” for the probability of two body reactions namely n(e1)n(e2) is of the same form as the leading factor of n(e1)! n(e2)!. In the case of quantum mechanics one may apply the dynamical approach to obtain the time-independent Schrodinger equation. In such a case one does not need to think in terms of “maximizing” any quantity although one considers all possible reactions with a potential V(x). a(p) factors in W(x) = wavefunction = Sum over p a(p)exp(ipx) are interrelated, but retain their identity after all possible interactions occur. This we argue is the idea for the eigenvalue equation. At the same time, Shannon’s entropy, which is directly linked to the notion of arrangements, is applied to a bound state and possibly linked to thermodynamics i.e. dE = TdS -PdV which may be applied to an adiabatic expansion. Shannon’s entropy is created from existing probabilities in this case which do not arise from explicitly maximizing entropy subject to constraints as the probabilities follow directly from the Schrodinger equation. One might ask why Shannon’s entropy has any relevance if it is the dynamics which determines the value of W(x) and a(p). It seems, however, that one may knock out a particle in a state p with probability P(p)= a*(p)a(p) or find a particle at x with probability P(x)=W*(x)W(x). These are classical type probabilities linked to the quantum dynamical probabilities a(p) and W(x). It seems Shannon’s entropy is only applied to P(x) and P(p) or a product P(x)P(p) which may give it physical meaning in a quantum bound state. We examine these ideas in this note.

•Jun 20, 2022•0 citations
In the literature (e.g. (1)), the expression - density(x) ln(density(x)) is used as Shannon’s spatial entropy for a quantum system (bound or not). For the bound case, the correspondence principle is said to hold for high energy levels (2). In that case, quantum density = W(x)W(x) (W(x)=real wavefunction) is said to be equivalent to the classical density C/v(x) where v(x) the velocity is given by .5mv(x)v(x) + V(x) = E. Classical density yields a curve which passes through peak regions of quantum density humps. In the classical case, particle motion is completely determinate. C/v(x) as a density (probability) is proportional to dt, the amount of time a particle spends passing through a fixed length dx. If the particle moves quickly, it spends little time, and hence there is less time for a measurement (i.e one may miss the particle due to its speed). We argue in this note that such a scenario does not seem to be in keeping with the ideas of Shannon’s entropy where one has probabilities for certain mutually exclusive events at each ti. For example at each ti, one may toss a coin. If it is not “heads”, this means it is tails. For the classical particle in the correspondence principle, each dx region has its own probability proportional to dt = dx/v(x). Thus, each dx is a region of its own in terms of probability. Thus, if Ci measurements of the presence of the particle are made within dx of xi out of N trials, the probability that a measurement is made in dx at xi is Ci/N and the probability that it is not is 1-Ci/N. Thus, unlike Shannon’s picture, various arrangements do not have the same weight or probability. We investigate this scenario in more detail and argue that it does not follow the approach of Shannon’s entropy. We also try to connect with the quantum situation.
This paper reports a new reading for wavelets, which is based on the classical 'De Broglie' principle. The wave-particle duality principle is adapted to wavelets. Every continuous basic wavelet is associated with a proper probability density, allowing defining the Shannon entropy of a wavelet. Further entropy definitions are considered, such as Jumarie or Renyi entropy of wavelets. We proved that any wavelet of the same family has the same Shannon entropy of its mother wavelet. Finally, the Shannon entropy for a few standard wavelet families is determined.
The Maxwell-Boltzmann MB distribution is often derived by maximizing the number of possible arrangements of particles with different energies subject to the constraint of a fixed number of particles and fixed energy. Using the canonical approximation that only average energy is conserved and using Stirling’s approximation for large number factorials leads to the Maxwell-Boltzmann distribution. The ln of total number of arrangements using Stirling’s approximation is linked to a math form called Shannon’s entropy i.e. - Sum over i f(ei) ln(f(ei)). Interestingly this same MB result may be obtained through reaction balance which makes no use of the idea of arrangements or entropy or maximization. It is concerned with including all possible physical reactions (for example two body reactions between all energy particles) subject to conservation of energy. In this sense it deals directly with the dynamics of the problem while the arrangement approach does not. The dynamical approach considers all possible reactions with notions of independence or lack of information and ensures the system remains unchanged. Why are they the same? We argue that it is because the “recipe” for the probability of two body reactions namely n(e1)n(e2) is of the same form as the leading factor of n(e1)! n(e2)!. In the case of quantum mechanics one may apply the dynamical approach to obtain the time-independent Schrodinger equation. In such a case one does not need to think in terms of “maximizing” any quantity although one considers all possible reactions with a potential V(x). a(p) factors in W(x) = wavefunction = Sum over p a(p)exp(ipx) are interrelated, but retain their identity after all possible interactions occur. This we argue is the idea for the eigenvalue equation. At the same time, Shannon’s entropy, which is directly linked to the notion of arrangements, is applied to a bound state and possibly linked to thermodynamics i.e. dE = TdS -PdV which may be applied to an adiabatic expansion. Shannon’s entropy is created from existing probabilities in this case which do not arise from explicitly maximizing entropy subject to constraints as the probabilities follow directly from the Schrodinger equation. One might ask why Shannon’s entropy has any relevance if it is the dynamics which determines the value of W(x) and a(p). It seems, however, that one may knock out a particle in a state p with probability P(p)= a*(p)a(p) or find a particle at x with probability P(x)=W*(x)W(x). These are classical type probabilities linked to the quantum dynamical probabilities a(p) and W(x). It seems Shannon’s entropy is only applied to P(x) and P(p) or a product P(x)P(p) which may give it physical meaning in a quantum bound state. We examine these ideas in this note.