Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

WORLD SCIENTIFIC eBooks

Information Theoretical Approaches to Quantum Chemistry

Shridhar Ramachandra Gadre

Published Dec 1, 2002• 31 citations
Publisher

Abstract

The development of the concept of entropy is traced briefly from the time of Boltzmann to the present. The axiomatic formulation of the Shannon information entropy functional [C. E. Shannon, Bell System Tech. J. 27 , 379 (1948)], viz. S = - k Σ p i ln p i is presented. The maximum entropy principle (MEP) due to Jaynes [E.T. Jaynes, Phys. Rev. 106 , 620 (1957)] is summarized and the existence and uniqueness of such maximum entropy solution with the constraints of moments of the distribution is discussed. This is followed by an account of the practical reconstruction of the electron momentum distributions and Compton profiles by employing the first and second moment constraints. Connections of information entropy encompassing kinetic energy functional, reaction dynamics, loges as well as surprisal analysis are brought out. The pioneering contribution of Białynicki-Birula and Mycielski [I. Białynicki-Birula, and J. Mycielski, Commun. Math. Phys. 44 , 129 (1975)] highlighting the connection between the sum of information entropies in conjugate spaces and the Heisenberg uncertainty relation is outlined. The problem of characterizing the quality of atomic and molecular wave functions has been considered in terms of the sum of information entropies in conjugate spaces. This is followed by the discussion of a new maximum entropy principle [S. R. Gadre and R. D. Bendale, Int. J. Quantum Chem. 28 , 311 (1985)] stipulating the maximization of the sum of the Shannon entropies in conjugate spaces. Some applications of this new maximum entropy principle for obtaining the probability distributions in conjugate spaces are summarized.

DOI
10.1142/9789812775702_0006

Related papers

Rigorous relationships among quantum-mechanical kinetic energy and atomic information entropies: Upper and lower bounds

Shridhar Ramachandra Gadre, Rajeev D. Bendale

An uncertainty-type lower bound [I. Bialynicki-Birula and J. Mycielski, Commun. Math. Phys. 44, 129 (1975)] to the information-entropy sum in complementary spaces has recently been reformulated by Gadre et al. [Phys. Rev. A 32, 2602 (1985)] in terms of the respective one-particle probability densities. This bound has been exploited to derive rigorous upper as well as lower bounds to the information entropies and their sum in terms of the corresponding second moments of their distributions. Thus the present work establishes a direct connection, as suggested by Sears, Parr, and Dinur [Israel J. Chem. 19, 165 (1980)], between the quantum-mechanical kinetic energy and information entropy in position space. It has also been demonstrated that given at least one arbitrary moment-type constraint in each space, it is possible to derive an upper bound to the information entropy sum in complementary spaces.

Physical Review A•Aug 1, 1987•96 citations

Entropic representation in the theory of molecular electronic structure

Roman F. Nalewajski

The entropic perspective on the molecular electronic structure is investigated. Information-theoretic description of electron probabilities is extended to cover the complex amplitudes (wave functions) of quantum mechanics. This analysis emphasizes the entropic concepts due to the phase part of electronic states, which generates the probability current density, thus allowing one to distinguish the information content of states generating the same electron density and differing in their current densities. The classical information measures of Fisher and Shannon, due to the probability/density distributions themselves, are supplemented by the nonclassical terms generated by the wave-function phase or the associated probability current. A complementary character of the Fisher and Shannon information measures is explored and the relationship between these classical information densities is derived. It is postulated to characterize also their nonclassical (phase/current-dependent) contributions. The continuity equations of the generalized information densities are examined and the associated nonclassical information sources are identified. The variational rules involving the quantum-generalized Shannon entropy, which generate the stationary and time-dependent Schrödinger equations from the relevant maximum entropy principles, are discussed and their implications for the system “thermodynamic” equilibrium states are examined. It is demonstrated that the lowest, stationary “thermodynamic” state differs from the true ground state of the system, by exhibiting the space-dependent phase, linked to the modulus part of the wave function, and hence also a nonvanishing probability current.

Journal of Mathematical Chemistry•Sep 26, 2012•21 citations

Classical Probability Theory and Quantum Wavefunctions

Francesco R. Ruggeri

In (1), we noted that a Gaussian wavefunction may be a solution to the time-independent Schrodinger equation (e.g. the ground state solution of the quantum oscillator) and simultaneously a solution of maximizing spatial Shannon’s entropy - density(x) ln(density(x)) subject to the constraint V(x) xx constant, where density(x) =W*(x)W(x) with W(x) being the wavefunction. In (2), which deals strictly with classical probabilities and the Maxwell-Boltzmann factor n(ei) = exp(-ei/T), we argued that this function is equivalent to: ln(n(ei)) = -ei/T. This in turn is equivalent to the maximization of ln(n(ei)!) with the constraint ei n(ei) which is part of: ln( N!/ Product over i n(ei)!) with the full constraint Sum over i ei n(ei)=Eave. Here n(ei)=N p(ei) where p(ei) is a probability and N a very large number. Thus a function of exp( something) may indicate that “something” * density(x) is a constraint with -density ln(density) being Shannon’s entropy. Quantum mechanics for a bound system yields a real wavefunction W(x) such that density(x)=W(x)W(x)=probability(x). Thus maximization of Shannon’s entropy - density(x) ln (density) subject to a constraint: density(x)B(x) should correspond to a solution for density of exp( B(x)). B(x) as part of the constraint, however, should represent a physical constraint. Thus if there is a solution to the Schrodinger equation of the form exp(.5B(x)) and B(x)density(x) represents the physical constraint in the system, classical maximization of probability solves the quantum problem in such a case. The above ideas may be applied to the quantum oscillator ground state and essentially repeat what is done in (1). We, however, try to generalize them to see if they may apply to a free quantum particle. In this case the probability used is exp(ipx) which is complex. It corresponds to P(x)=exp(ipx)exp(-ipx)=1 which is a uniform distribution which has maximum lack of information.

•May 17, 2023•0 citations

Quantum Information Measures and Their Use in Chemistry

Roman F. Nalewajski

Background: The resultant measures of the information content in molecular electronic states are revisited. In these overall measures the current-related terms complement the probability functionals of classical Information Theory. The nonclassical Shannon entropy reflects the average magnitude of the state phase distribution, while the related current term in the complementary Fisher measure accounts for the average phase-gradient. Method: These generalized Fisher and Shannon descriptors of the information content in complex electronic states are applied to determine the phase-equilibria in molecules. The vertical and horizontal equilibria in molecules, which mark the extrema of the nonclassical and resultant entropy/information descriptors, respectively, are explored. The requirement, that the resultant measures have common solutions of the associated extreme entropy/information principles, calls for the negative sign of the nonclassical gradient measure. Conclusion: These extrema imply the phase-transformation of molecular electronic states. A separation of the density (modulus) and current (phase) factors in many-electron states is effected using the Harriman-Zumbach-Maschke construction of complex antisymmetric states yielding the specified electron density. A combined description of molecular systems, which accounts for the density and current degrees-of-freedom of electronic states is summarized and continuity equations for the state phase and resultant entropy are discussed. Keywords: Continuity equations, current-information, information continuity, molecular equilibria, phase-entropy/information, entropy.

Current Physical Chemistry•Sep 25, 2017•17 citations

Information Theory Meets Quantum Chemistry: A Review and Perspective

Yilin Zhao, Dongbo Zhao, Chunying Rong +2 more

In this survey, we begin with a concise introduction to information theory within Shannon's framework, focusing on the key concept of Shannon entropy and its related quantities: relative entropy, joint entropy, conditional entropy, and mutual information. We then demonstrate how to apply these information-theoretic tools in quantum chemistry, adopting either classical or quantum formalisms based on the choice of information carrier involved.

Entropy•Jun 16, 2025•16 citations

Characteristic features of Shannon information entropy of confined atoms

K. D. Sen

The Shannon information entropy of 1-normalized electron density in position and momentum space Sr and Sp, and the sum ST, respectively, are reported for the ground-state H, He+, Li2+, H-, He, Li+, Li, and B atoms confined inside an impenetrable spherical boundary defined by radius R. We find new characteristic features in ST denoted by well-defined minimum and maximum as a function of confinement. The results are analyzed in the background of the irreducible lower bound stipulated by the entropy uncertainty principle [I. Bialynicki-Birula and J. Mycielski, Commun. Math. Phys. 44, 129 (1975)]. The spherical confinement model leads to the ST values which satisfy the lower bound up to the limits of extreme confinements with the interesting new result displaying regions over which a set of upper and lower bounds to the information entropy sum can be locally prescribed. Similar calculations on the H atom in 2s excited states are presented and their novel characteristics are discussed.

The Journal of Chemical Physics•Aug 15, 2005•195 citations
The development of the concept of entropy is traced briefly from the time of Boltzmann to the present. The axiomatic formulation of the Shannon information entropy functional [C. E. Shannon, Bell System Tech. J. 27 , 379 (1948)], viz. S = - k Σ p i ln p i is presented. The maximum entropy principle (MEP) due to Jaynes [E.T. Jaynes, Phys. Rev. 106 , 620 (1957)] is summarized and the existence and uniqueness of such maximum entropy solution with the constraints of moments of the distribution is discussed. This is followed by an account of the practical reconstruction of the electron momentum distributions and Compton profiles by employing the first and second moment constraints. Connections of information entropy encompassing kinetic energy functional, reaction dynamics, loges as well as surprisal analysis are brought out. The pioneering contribution of Białynicki-Birula and Mycielski [I. Białynicki-Birula, and J. Mycielski, Commun. Math. Phys. 44 , 129 (1975)] highlighting the connection between the sum of information entropies in conjugate spaces and the Heisenberg uncertainty relation is outlined. The problem of characterizing the quality of atomic and molecular wave functions has been considered in terms of the sum of information entropies in conjugate spaces. This is followed by the discussion of a new maximum entropy principle [S. R. Gadre and R. D. Bendale, Int. J. Quantum Chem. 28 , 311 (1985)] stipulating the maximization of the sum of the Shannon entropies in conjugate spaces. Some applications of this new maximum entropy principle for obtaining the probability distributions in conjugate spaces are summarized.
An uncertainty-type lower bound [I. Bialynicki-Birula and J. Mycielski, Commun. Math. Phys. 44, 129 (1975)] to the information-entropy sum in complementary spaces has recently been reformulated by Gadre et al. [Phys. Rev. A 32, 2602 (1985)] in terms of the respective one-particle probability densities. This bound has been exploited to derive rigorous upper as well as lower bounds to the information entropies and their sum in terms of the corresponding second moments of their distributions. Thus the present work establishes a direct connection, as suggested by Sears, Parr, and Dinur [Israel J. Chem. 19, 165 (1980)], between the quantum-mechanical kinetic energy and information entropy in position space. It has also been demonstrated that given at least one arbitrary moment-type constraint in each space, it is possible to derive an upper bound to the information entropy sum in complementary spaces.
The entropic perspective on the molecular electronic structure is investigated. Information-theoretic description of electron probabilities is extended to cover the complex amplitudes (wave functions) of quantum mechanics. This analysis emphasizes the entropic concepts due to the phase part of electronic states, which generates the probability current density, thus allowing one to distinguish the information content of states generating the same electron density and differing in their current densities. The classical information measures of Fisher and Shannon, due to the probability/density distributions themselves, are supplemented by the nonclassical terms generated by the wave-function phase or the associated probability current. A complementary character of the Fisher and Shannon information measures is explored and the relationship between these classical information densities is derived. It is postulated to characterize also their nonclassical (phase/current-dependent) contributions. The continuity equations of the generalized information densities are examined and the associated nonclassical information sources are identified. The variational rules involving the quantum-generalized Shannon entropy, which generate the stationary and time-dependent Schrödinger equations from the relevant maximum entropy principles, are discussed and their implications for the system “thermodynamic” equilibrium states are examined. It is demonstrated that the lowest, stationary “thermodynamic” state differs from the true ground state of the system, by exhibiting the space-dependent phase, linked to the modulus part of the wave function, and hence also a nonvanishing probability current.
In (1), we noted that a Gaussian wavefunction may be a solution to the time-independent Schrodinger equation (e.g. the ground state solution of the quantum oscillator) and simultaneously a solution of maximizing spatial Shannon’s entropy - density(x) ln(density(x)) subject to the constraint V(x) xx constant, where density(x) =W*(x)W(x) with W(x) being the wavefunction. In (2), which deals strictly with classical probabilities and the Maxwell-Boltzmann factor n(ei) = exp(-ei/T), we argued that this function is equivalent to: ln(n(ei)) = -ei/T. This in turn is equivalent to the maximization of ln(n(ei)!) with the constraint ei n(ei) which is part of: ln( N!/ Product over i n(ei)!) with the full constraint Sum over i ei n(ei)=Eave. Here n(ei)=N p(ei) where p(ei) is a probability and N a very large number. Thus a function of exp( something) may indicate that “something” * density(x) is a constraint with -density ln(density) being Shannon’s entropy. Quantum mechanics for a bound system yields a real wavefunction W(x) such that density(x)=W(x)W(x)=probability(x). Thus maximization of Shannon’s entropy - density(x) ln (density) subject to a constraint: density(x)B(x) should correspond to a solution for density of exp( B(x)). B(x) as part of the constraint, however, should represent a physical constraint. Thus if there is a solution to the Schrodinger equation of the form exp(.5B(x)) and B(x)density(x) represents the physical constraint in the system, classical maximization of probability solves the quantum problem in such a case. The above ideas may be applied to the quantum oscillator ground state and essentially repeat what is done in (1). We, however, try to generalize them to see if they may apply to a free quantum particle. In this case the probability used is exp(ipx) which is complex. It corresponds to P(x)=exp(ipx)exp(-ipx)=1 which is a uniform distribution which has maximum lack of information.
Background: The resultant measures of the information content in molecular electronic states are revisited. In these overall measures the current-related terms complement the probability functionals of classical Information Theory. The nonclassical Shannon entropy reflects the average magnitude of the state phase distribution, while the related current term in the complementary Fisher measure accounts for the average phase-gradient. Method: These generalized Fisher and Shannon descriptors of the information content in complex electronic states are applied to determine the phase-equilibria in molecules. The vertical and horizontal equilibria in molecules, which mark the extrema of the nonclassical and resultant entropy/information descriptors, respectively, are explored. The requirement, that the resultant measures have common solutions of the associated extreme entropy/information principles, calls for the negative sign of the nonclassical gradient measure. Conclusion: These extrema imply the phase-transformation of molecular electronic states. A separation of the density (modulus) and current (phase) factors in many-electron states is effected using the Harriman-Zumbach-Maschke construction of complex antisymmetric states yielding the specified electron density. A combined description of molecular systems, which accounts for the density and current degrees-of-freedom of electronic states is summarized and continuity equations for the state phase and resultant entropy are discussed. Keywords: Continuity equations, current-information, information continuity, molecular equilibria, phase-entropy/information, entropy.
The Shannon information entropy of 1-normalized electron density in position and momentum space Sr and Sp, and the sum ST, respectively, are reported for the ground-state H, He+, Li2+, H-, He, Li+, Li, and B atoms confined inside an impenetrable spherical boundary defined by radius R. We find new characteristic features in ST denoted by well-defined minimum and maximum as a function of confinement. The results are analyzed in the background of the irreducible lower bound stipulated by the entropy uncertainty principle [I. Bialynicki-Birula and J. Mycielski, Commun. Math. Phys. 44, 129 (1975)]. The spherical confinement model leads to the ST values which satisfy the lower bound up to the limits of extreme confinements with the interesting new result displaying regions over which a set of upper and lower bounds to the information entropy sum can be locally prescribed. Similar calculations on the H atom in 2s excited states are presented and their novel characteristics are discussed.