Quantum mechanics is our most successful physical theory. However, it raises conceptual issues that have perplexed physicists and philosophers of science for decades. This 2004 book develops an approach, based on the proposal that quantum theory is not a complete, final theory, but is in fact an emergent phenomenon arising from a deeper level of dynamics. The dynamics at this deeper level are taken to be an extension of classical dynamics to non-commuting matrix variables, with cyclic permutation inside a trace used as the basic calculational tool. With plausible assumptions, quantum theory is shown to emerge as the statistical thermodynamics of this underlying theory, with the canonical commutation/anticommutation relations derived from a generalized equipartition theorem. Brownian motion corrections to this thermodynamics are argued to lead to state vector reduction and to the probabilistic interpretation of quantum theory, making contact with phenomenological proposals for stochastic modifications to Schrödinger dynamics.
Quantum mechanics is our most successful physical theory. However, it raises conceptual issues that have perplexed physicists and philosophers of science for decades. This 2004 book develops an approach, based on the proposal that quantum theory is not a complete, final theory, but is in fact an emergent phenomenon arising from a deeper level of dynamics. The dynamics at this deeper level are taken to be an extension of classical dynamics to non-commuting matrix variables, with cyclic permutation inside a trace used as the basic calculational tool. With plausible assumptions, quantum theory is shown to emerge as the statistical thermodynamics of this underlying theory, with the canonical commutation/anticommutation relations derived from a generalized equipartition theorem. Brownian motion corrections to this thermodynamics are argued to lead to state vector reduction and to the probabilistic interpretation of quantum theory, making contact with phenomenological proposals for stochastic modifications to Schrödinger dynamics.
I review the proposal made in my 2004 book [1], that quantum theory is an emergent theory arising from a deeper level of dynamics. The dynamics at this deeper level is taken to be an extension of classical dynamics to non-commuting matrix variables, with cyclic permutation inside a trace used as the basic calculational tool. With plausible assumptions, quantum theory is shown to emerge as the statistical thermodynamics of this underlying theory, with the canonical commutation-anticommutation relations derived from a generalized equipartition theorem. Brownian motion corrections to this thermodynamics are argued to lead to state vector reduction and to the probabilistic interpretation of quantum theory, making contact with phenomenological proposals [2, 3] for stochastic modifications to Schrödinger dynamics.
We consider the classical dynamics of bosonic and fermionic matrix variables in complex Hilbert space, defined by a trace action, assuming cyclic invariance under the trace and the presence of a global unitary invariance. With plausible and explicitly stated assumptions, including the existence of a large hierarchy of scale between the underlying dynamics and observed physics, we show that (1) the equilibrium statistical mechanics of this matrix dynamics, in the canonical ensemble, gives rise to an emergent quantum mechanics for many degrees of freedom, including the standard canonical commutation/anticommutation relations and the usual unitary Heisenberg and Schrödinger picture time evolutions of operators and states, and (2) the fluctuation or Brownian motion corrections to this thermodyamics lead to an energy-driven stochastic modification of the Schrödinger equation, which is known to imply state vector reduction with Born rule probabilities. Thus, quantum mechanics and its probabilistic interpretation both arise as emergent phenomena in the underlying trace dynamics.
Recently, the possibility of investigating single molecule, or single spin observables, as well as the necessity of a better understanding of the mechanisms underlying quantum dynamics in order to obtain nanoscale devices and nanostructered materials suitable for quantum computing tasks, have revived the interest in foundational aspects of quantum statistical mechanics. This thesis aims to give a contribution to this field by re-considering the statistical characterization of a quantum system at the light of some paradigmatic changes in our understanding of quantum theory which have taken place in the last two decades. In particular the impressive development of quantum information theory has changed the perceptions of quantum entanglement: for a long time it has been considered a somewhat paradoxical property of the matter at the atomic scale, but now it is regarded as an essential and ubiquitous phenomenon whose consequences are affecting the very macroscopic world that we experience. Still the decoherence program has brought out the importance of considering a quantum system together with its environment in order to clarify some key aspects of quantum dynamics. Thus, we start from the idea that quantum correlations are ubiquitous and somewhat uncontrollable in systems with many degrees of freedom which are typically considered in statistical mechanics. As a consequence we assume the standpoint that quantum statistical mechanics has not to be based on the underlying idea of a collection of many, independent quantum systems but rather it has to emerge at the level of a global wavefunction (pure state) which describes the system as well as its environment as a whole. In order to investigate the consequences of these assumptions we study the equilibrium distribution of an isolated quantum system. This is defined, in analogy with the ergodic foundations of classical statistical mechanics, on the basis of the time evolution of the quantum state. Then, we study the emergence of thermodynamic properties in a quantum system by studying the probability distribution of some function of interests, as the entropy and the equilibrium state of a subsystem, on Ensembles of Pure States. Such a probability distribution is derived from the geometry of the Hilbert space, and the theoretical tools suitable for its characterization are developed. On the one hand we perform a numerical sampling of the ensemble distributions by employing Monte Carlo techniques, on the other hand simpler analytical approximation of the geometrical distributions are derived by means of a maximum entropy principle. Model systems composed of an ensemble of spins are chosen to illustrate the salient features which emerge from the developed theoretical framework: the main point is that the Ensemble Distributions of “thermodynamic observables” (entropy or equilibrium state of a subsystem) are sharply peaked around a typical value. From the analysis it emerges that each of the overwhelming majority of the wavefunctions which has appreciable weight in the considered ensemble, is characterized by the same value of the “macroscopic” functions. This is a striking evidence of the “typicality” of these properties. In the essence, our impossibility to know the state of the system in detail does not matter, just for the remarkable fact that almost all quantum states behave essentially in the same way. By virtue of this typicality the study of the behaviour of the typical values of the thermodynamic function become meaningful. Notably, under certain conditions, one recovers the results of standard statistical mechanics, that is, the equilibrium average of the state of a subsystem can be cast in the Boltzmann canonical form at the temperature given by the usual thermodynamical relation . In the second part of the thesis we consider the dynamical aspects of the equilibrium state of a subsystem interacting with its environment. The fluctuations around the equilibrium average critically depends on the entanglement between the system and the environment and on the form of the interaction Hamiltonian. The connection between the dynamics of the fluctuations of an observable at the equilibrium and the relaxation toward the equilibrium from a “non typical” initial value is also investigated with the aid of simple model systems. The study presented in this thesis was partly motivated by a critical analysis of the statistical methods available for the theoretical modelling of magnetic resonance experiments. One of these, the Stochastic Liouville Equation, has been employed in a work completed during the first year of my Ph.D. program in order to interpret some feature of a two dimensional electron spin resonance experiment, [Fresch B., Frezzato D., Moro G. J., Kothe G., Freed J. H.; J. Phys. Chem. B., 110, 24238, (2006)].
An attempt is made to interpret quantum mechanics as a statistical theory, or more exactly as a form of non-deterministic statistical dynamics. The paper falls into three parts. In the first, the distribution functions of the complete set of dynamical variables specifying a mechanical system (phase-space distributions), which are fundamental in any form of statistical dynamics, are expressed in terms of the wave vectors of quantum theory. This is shown to be equivalent to specifying a theory of functions of non-commuting operators, and may hence be considered as an interpretation of quantum kinematics . In the second part, the laws governing the transformation with time of these phase-space distributions are derived from the equations of motion of quantum dynamics and found to be of the required form for a dynamical stochastic process. It is shown that these phase-space transformation equations can be used as an alternative to the Schrödinger equation in the solution of quantum mechanical problems, such as the evolution with time of wave packets, collision problems and the calculation of transition probabilities in perturbed systems; an approximation method is derived for this purpose. The third part, quantum statistics , deals with the phase-space distribution of members of large assemblies, with a view to applications of quantum mechanics to kinetic theories of matter. Finally, the limitations of the theory, its uniqueness and the possibilities of experimental verification are discussed.
Quantum mechanics is one of the most fundamental yet difficult subjects in physics. Nonrelativistic quantum theory is presented here in a clear and systematic fashion, integrating Born's probabilistic interpretation with Schrödinger dynamics. Basic quantum principles are illustrated with simple examples requiring no mathematics beyond linear algebra and elementary probability theory. The quantum measurement process is consistently analyzed using fundamental quantum principles without referring to measurement. These same principles are used to resolve several of the paradoxes that have long perplexed physicists, including the double slit and Schrödinger's cat. The consistent histories formalism used here was first introduced by the author, and extended by M. Gell-Mann, J. Hartle and R. Omnès. Essential for researchers yet accessible to advanced undergraduate students in physics, chemistry, mathematics, and computer science, this book is supplementary to standard textbooks. It will also be of interest to physicists and philosophers working on the foundations of quantum mechanics.
The question of how statistical physics can be seen to emerge from unitary quantum dynamics goes back to Schrödinger and von Neumann, however has been reaffirmed as a topic of importance due to recent advances in experimental capabilities, allowing the observation of the unitary evolution of many-particle systems over long periods of time. Understanding why such a system evolves to the specific thermal equilibrium state, effectively described by a relevant thermodynamic ensemble, has thus seen significantly more interest in recent years. Furthermore, observations of the dynamics of such systems open questions on the route to equilibrium, and subsequent fluctuations. In this thesis I will develop an approach to this problem, taking as a starting point the non-integrability of the system under study, which leads to a generic model in terms of random matrix theory (RMT), and more generally, chaotic wavefunctions. In the formulation of these methods, special attention is paid to the form of local observables of quantum systems, and an approach to their description is developed in terms of correlation functions of chaotic wavefunctions. From this approach a key conjecture in the understanding of thermalization, the eigenstate thermalization hypothesis (ETH), is derived in full, and the dynamical behaviour of such observables is obtained analytically. Further, I will show that emergent classical behaviour can be observed in the form of a fluctuation-dissipation theorem (FDT) of Brownian processes. This is exploited to develop an experimental proposal to measure the ‘complexity’ of a quantum device, by experimentally obtaining its effective Hilbert space dimension in terms of a fully connected system. Finally, quantum jump trajectories, describing stroboscopic projective measurements of local observables are studied, and shown to display classical Brownian dynamics in the form of a Markov process. Throughout this thesis, exact diagonalization calculations of realistic quantum spin systems are used to confirm analytical results.