Entropy is a fundamental concept which emerged along with other ideas during the development of thermodynamics and statistical mechanics Landau and Lifshitz (1978); Lieb and Yngvason (1999). Entropy has developed foremost out of phenomenological thermodynamical considerations such as the second law of thermodynamics in which it plays a prominent role Wehrl (1978). With the intense interest in the investigation of the physics of matter at the atomic and subatomic quantum levels, it maywell be askedwhether this concept can emerge out of the study of systems at a more fundamental level. In fact, it may be argued that a correct definition is only possible in the framework of quantum mechanics, whereas in classical mechanics, entropy can only be introduced in a rather limited and artificial way. Entropy relates macroscopic and microscopic aspects of nature, and ultimately determines the behavior of macroscopic systems. It is the intention here to present an introduction to this subject in a readable manner from the quantum point of view. There are many reasons for undertaking this. The intense interest in irreversible thermodynamics Grossing (2008), the statistical mechanics of astrophysical objects Padmanabhan (1990); Pathria (1977), quantum gravity and entropy of black holes Peres & al. (2004), testing quantum mechanics Ballentine (1970) and applications to condensed matter and quantum optics Haroche & al. (2006); Raimond & al. (2001) are just a few areas which are directly or indirectly touched on here. Let us begin by introducing the concept of entropy from the quantummechanical perspective, realizing that the purpose is to focus on quantum mechanics in particular. Quantum mechanics makes a clear distinction between observables and states. Observables such as position and momentum are mathematically described by self-adjoint operators in a Hilbert space. States, which are generally mixed, can be described by a density matrix, which is designated by ρ throughout. This operator ρ is Hermitean, has trace one and yields the expectation value of an observable A in the state ρ through the definition
Entropy is a fundamental concept which emerged along with other ideas during the development of thermodynamics and statistical mechanics Landau and Lifshitz (1978); Lieb and Yngvason (1999). Entropy has developed foremost out of phenomenological thermodynamical considerations such as the second law of thermodynamics in which it plays a prominent role Wehrl (1978). With the intense interest in the investigation of the physics of matter at the atomic and subatomic quantum levels, it maywell be askedwhether this concept can emerge out of the study of systems at a more fundamental level. In fact, it may be argued that a correct definition is only possible in the framework of quantum mechanics, whereas in classical mechanics, entropy can only be introduced in a rather limited and artificial way. Entropy relates macroscopic and microscopic aspects of nature, and ultimately determines the behavior of macroscopic systems. It is the intention here to present an introduction to this subject in a readable manner from the quantum point of view. There are many reasons for undertaking this. The intense interest in irreversible thermodynamics Grossing (2008), the statistical mechanics of astrophysical objects Padmanabhan (1990); Pathria (1977), quantum gravity and entropy of black holes Peres & al. (2004), testing quantum mechanics Ballentine (1970) and applications to condensed matter and quantum optics Haroche & al. (2006); Raimond & al. (2001) are just a few areas which are directly or indirectly touched on here. Let us begin by introducing the concept of entropy from the quantummechanical perspective, realizing that the purpose is to focus on quantum mechanics in particular. Quantum mechanics makes a clear distinction between observables and states. Observables such as position and momentum are mathematically described by self-adjoint operators in a Hilbert space. States, which are generally mixed, can be described by a density matrix, which is designated by ρ throughout. This operator ρ is Hermitean, has trace one and yields the expectation value of an observable A in the state ρ through the definition
What is the physical significance of entropy? What is the physical origin of irreversibility? Do entropy and irreversibility exist only for complex and macroscopic systems? The bulk of the physics community accepts and teaches that all these fundamental questions are rationalized within statistical mechanics. Indeed, for everyday laboratory physics, the mathematical formalism of statistical mechanics (canonical and grandcanonica1, Boltzmann, Bose-Einstein and Fermi-Dirac distributions) allows a successful description of the thermodynamic equilibrium properties of matter, including entropy values. But an ever growing handful of physicists (Schrodinger among the first) have realized that, even in its explanation of the meaning of entropy, statistical mechanics is impaired by ambiguities and logical inconsistencies. They have started to search for a better theory to eliminate these stumbling blocks while maintaining the mathematical formalism that has been so successful in so many applications. This handful of upstreamers must not be confused with the many schools of physicists that have thrived on the more renowned incompleteness of statistical mechanics, namely, the lack of a quantitative (and the weakness of the qualitative) explanation of the origin of irreversibility. In these studies the thrust is provided by the discovery that the macroscopic dynamics of certain complex systems may be modeled using a few-degrees-of-freedom nonlinear Hamiltonian with singularities that give rise to bifurcations and chaotic behavior. These results have generated successful ways to describe irreversible behavior, but their link to the origin of irreversibility is still only heuristic (what is the connection between the nonlinear model Hamiltonian and the true full Hamiitonian?) and does not provide yet a rigorous resolution of the century-old paradox of the conflict between the irreversibiiity of macroscopic behavior, and the reversibility of the laws of mechanics. To resolve both the problem of the meaning of entropy and that of the origin of irreversibility we have built entropy and irreversibility into the laws of mechanics. The result is a theory that we call quantum thermodynamics that has all the necessary properties to combine mechanics and thermodynamics uniting all the successful results of both theories, eliminating the logical inconsistencies of statistical mechanics and the paradox on irreversibiiity, and providing an entirely new perspective on the microscopic origin of irreversibility, nonlinearity and therefore chaotic behavior. The mathematical formalism of quantum thermodynamics differs from that of statistical mechanics mainly in the equation of motion which is nonlinear but has solutions identical to those of the Schrodinger equation for all the states for which statistical mechanics reduces to quantum mechanics. The physical meaning of the formalism of quantum thermodynamics differs more drastically from that of statistical mechanics. The significance of the state operator of quantum thermodynamics is entirely different from that of the density operator of statistical mechanics, even though the two are mathematically equivalent. Indeed they obey different equations of motion. In particular, quantum thermodynamics is concerned only with those systems for which quantum mechanics would describe the states with vectors in Hilbert space or, equivalently, projection operators. Using a well known jargon, we can say that quantum thermodynamics like quantum mechanics is concerned only with pure quantum states. However, it postulates that the set of pure quantum states of a system is much broader than contemplated by quantum mechanics. Pure quantum states must be described by operators defined by all the features of projection operators except the condition of idempotence. As a result, an operator that within statistical mechanics would describe a mixed quantum state (that is, the average state of a statistical mixture of identical systems in different pure quantum states) in quantum thermodynamics describes a pure quantum state, a state that neither quantum mechanics non statistical mechanics would contemplate. Conceptually, the increased richness of pure quantum states is a new revolutionary postulate of quantum physics. But from the point of view of the statistical mechanics practitioners the new theory is not as traumatic as it seems. Whenever one uses a nonidempotent density operator to describe a thermodynamic equilibrium state one simply has to reinterpret it as one of the new pure quantum states. One even saves the usual ad hoc arguments on thermal baths and reservoirs that are usually required in statistical mechanics to justify the use of a nonidempotent density operator to describe the state of a system. In this paper we discuss the background and formalism of quantum thermodynamics including its nonlinear equation of motion and the main general results. Our objective is to show in a not-too-technical manner that this theory provides indeed a complete and coherent resolution of the century-old dilemma on the meaning of entropy and the origin of irreversibility. As a byproduct, we discuss a long set of criteria that a theory should meet in order to afford the same claim.
Classical formulations of the entropy concept and its interpretation are introduced. This is to motivate the definition of the quantum von Neumann entropy. Some general properties of quantum entropy are developed, such as the quantum entropy which always increases. The current state of the area that includes thermodynamics and quantum mechanics is reviewed. This interaction shall be critical for the development of nonequilibrium thermodynamics. The Jarzynski inequality is developed in two separate but related ways. The nature of irreversibility and its role in physics are considered as well. Finally, a specific quantum spin model is defined and is studied in such a way as to illustrate many of the subjects that have appeared.
The concept of entropy rst arose in the study of thermodynamics and statistical me- chanics. In information theory the so-called Shannon entropy plays a signi cant role, which measures how much information we gain, on average, when we learn the value of a random variable. An alternative interpretation is that the entropy of the random variable quanti es the amount of uncertainty about the random variable before we learn its value. The concept was introduced by Claude E. Shannon in his 1948 paper "A Mathematical Theory of Communication". In the rst part of the present work we consider this fundamental measure of information and show some of its properties, such as non-negativity. The relative entropy or the Kullback-Leibler divergence is a very useful measure of the distance between two prob- ability distributions. After introducing its de nition and other notions (joint entropy, conditional entropy or mutual information) we can prove additional assertions about the Shannon entropy and present statements about the relations between the above men- tioned quantities. In quantum information theory, there is a quantity, namely von Neumann entropy, which corresponds to Shannon entropy and originates from it. In the section Von Neu- mann entropy we will introduce this quantity which is a continuous functional on the states, or on their mathematical representatives, the density operators, and it ful ls in- equalities such as subadditivity and strong subaddititvity. Just as with the Shannon entropy, it is extremely useful to de ne a quantum version of the relative entropy, which is one of the most important numerical quantities appearing in quantum information theory. It is used as a measure of distinguishability between quantum states. Among others its properties are jointly convexity, monotonicity which are speci cally convenient. Transformations on structures which preserve operations, quantities or relations among elements appear in many areas of mathematics. These are the so-called preservers which show up also in physics and even in chemistry where they are usually called symmetries. Therefore, the study of preserver transformations is an important area of research. The third section of this work is based on a paper, in which Lajos Molnár described the structure every bijective map on the space of all density operators on a given Hilbert space, which preserves the relative entropy. This result is closely related to Wigner's famous theorem on the form of quantum mechanical symmetry transformations. The above theorem of Molnár can be extended into two directions. On the one hand, the result holds also in the case when the transformation under consideration acts on the space of all positive semide nite operators not only on density operators (i.e., we omit the condition of unit trace). On the other hand the statement remains valid even if we omit the strongly restrictive condition that the transformation is bijective. The second result is a joint work with Prof. Lajos Molnár which appeared in the journal Linear Algebra and Its Applications.
Abstract Entropy has played an essential role in the history of physics. Its mathematical definition and applications have changed over time till today. In this paper, we first review the historical evolution of these various points of view, from the thermodynamic definition to information entropy from Shannon in classical physics, up to the modern concept of Neumann’s quantum entropy. As a specific example, we consider entanglement entropy and compare the phase space approach in classical physics to the Hilbert space approach in quantum physics in simple model systems. We derive a general expression for the entanglement entropy of fermions and bosons in arbitrary partitions of Hilbert space, valid beyond the thermodynamic limit. Next, we compare thermodynamic heat engines with quantum heat engines. Finally, we proceed to the more general concept of quantum (computational) complexity and argue, using the concept of entanglement entropy, that the Heisenberg time in classically chaotic systems coincides with the time when maximal complexity is reached in the quantum case for systems with all–all interactions.
Since the days of Boltzmann the foundation of thermodynamics has been subject to an ongoing discussion. Various problems like the precise definition of entropy, the origin of the second law, etc. have always been issues. For a long time the discussion has not been in the center of interest, for statistical physics work extremely well from a practical point of view. But now, as research deals with single small objects like molecules or atoms, the question arises whether or not thermodynamics are applicable to them, which leads back to the old question of the foundation of thermodynamics. We examine whether thermodynamics can be viewed as emerging from Schrödinger-type quantum dynamics. Therefore we partially transfer concepts of thermodynamical behavior in Gamma-space to the Hilbertspace of compound systems. Central roles play the local Von Neumann entropy of a system and the inevitability of entanglement with its environment, causing it to increase.
ABSTRACT. What is the physical significance of entropy? What is the physical origin of irreversibility? Do entropy and irreversibility exist only for complex and macroscopic systems? Most physicists still accept and teach that the rationalization of these fundamental ques-tions is given by Statistical Mechanics. Indeed, for everyday laboratory physics, the math-ematical formalism of Statistical Mechanics (canonical and grand-canonical, Boltzmann, Bose-Einstein and Fermi-Dirac distributions) allows a successful description of the ther-modynamic equilibrium properties of matter, including entropy values. However, as al-ready recognized by Schrödinger in 1936, Statistical Mechanics is impaired by conceptual ambiguities and logical inconsistencies, both in its explanation of the meaning of entropy and in its implications on the concept of state of a system. An alternative theory has been developed by Gyftopoulos, Hatsopoulos and the present author to eliminate these stumbling conceptual blocks while maintaining the mathematical formalism so successful in applications. To resolve both the problem of the meaning of entropy and that of the origin of irreversibility we have built entropy and irreversibility