This report reviews what quantum physics and information theory have to tell us about the age-old question, How come existence? No escape is evident from four conclusions: (1) The world cannot be a giant machine, ruled by any preestablished continuum physical law. (2) There is no such thing at the microscopic level as space or time or spacetime continuum. (3) The familiar probability function or functional, and wave equation or functional wave equation, of standard quantum theory provide mere continuum idealizations and by reason of this circumstance conceal the information-theoretic source from which they derive. (4) No element in the description of physics shows itself as closer to primordial than the elementary quantum phenomenon, that is, the elementary device-intermediated act of posing a yes-no physical question and eliciting an answer or, in brief, the elementary act of observer-participancy. Otherwise stated, every physical quantity, every it, derives its ultimate significance from bits, binary yes-or-no indications, a conclusion which we epitomize in the phrase, it from bit .
This report reviews what quantum physics and information theory have to tell us about the age-old question, How come existence? No escape is evident from four conclusions: (1) The world cannot be a giant machine, ruled by any preestablished continuum physical law. (2) There is no such thing at the microscopic level as space or time or spacetime continuum. (3) The familiar probability function or functional, and wave equation or functional wave equation, of standard quantum theory provide mere continuum idealizations and by reason of this circumstance conceal the information-theoretic source from which they derive. (4) No element in the description of physics shows itself as closer to primordial than the elementary quantum phenomenon, that is, the elementary device-intermediated act of posing a yes-no physical question and eliciting an answer or, in brief, the elementary act of observer-participancy. Otherwise stated, every physical quantity, every it, derives its ultimate significance from bits, binary yes-or-no indications, a conclusion which we epitomize in the phrase, it from bit .
Whoever it was who first contracted the words 'binary digit' to form 'bit' can hardly have realised that he (she?) was coining a term not only for the smallest unit of information but also for the smallest unit of 'being' – or so the general relativist John Archibald Wheeler would have us believe. 'It from bit' is his declamation of the ultimate fount of significance of every physical quantity: all we can know about photons, fields, black holes – you name 'it' – depends at root, he emphasizes, on yes-or-no indications. Pursuing the implications of this observation through quantised strings, quantum measurement theory, computational representations of physical laws, information theory, thermodynamic entropy, evolution... those, he says, are routes to that happy state of perceived simplicity and beauty when we finally know the Final Answer to the question: 'How come existence?'
What is information? A short answer could be: Anything that changes our minds and states of thinking! Information is virtual. It can be carried by speech, an image, scratches on a stone, patterns in a photon field, the connections of neurons in our brains or even by the wavefunction of an electron. Information does not depend on the actual means of transmission nor does its identity change when changing the carrier. Information is physical. It needs to be sustained by a physical substrate and rearranging that substrate to contain the wanted information requires to spend energy or work. Without a physical world, information can not be stored, processed, or transmitted. Our world is permeated with different representations of information. Actually Information about the physical laws governing our Universe can be found everywhere and in everything. Could it then be that the real fundamental elements of this world are tiny bits of information? Could we get it from bit?1 A number of researcher investigate this possibility, and several of their attempts to recover physical laws from the principles governing information are reported about in this special issue on physics of information. The articles by Gregg Jaeger,2 by Ariel Caticha,3 and by John Skilling and Kevin Knuth4 address the reconstruction of quantum mechanics from information theory. Furthermore, Kevin Knuth and James Walsh5 show how to recover space-time from particles sending each others signals in an initially geometry-free setting. A central element of most works on information is the concept of a probability. Probabilities can be defined via various routes. Most familiar might be their definitions by the frequentists school as relative frequencies of events (in the limit of infinite amounts of such). A more general definition of probabilities is the Bayesians' one, which regards probabilities as quantifiers of statements, expressing how much those should be expected to be true. Although this definition looks subjective on the first glance, it rests on a solid mathematical theorem by Richard Cox6 that any extension of binary logic to a continuum of single valued truthfulness quantifier that respects a minimum of requirements must be isomorphic to probability theory. And this definition turns out to embrace the frequentists' definition in case that infinite numbers of comparable events are actually available and can be counted. The majority of authors of this special issues seem to favor the Bayesian perspective, which is probably a result of our own, the guest editors', preference and not necessarily a reflection of the prevailing position of contemporary scientists. The different views on probabilities of frequentists and Bayesians are addressed by the article of Allen Caldwell.7 He builds a bridge between these antagonistic camps by explaining frequentists' constructions in a Bayesian language. In particular, his argumentation why the omnipresent p-value in statistical and experimental literature might often capture a relevant signal of model misfit is reassuring, given that a large fraction of our medical system is based on decisions backed up by p-values. A Bayesian might add that it would be even more reassuring, if a system rigorously build on logic and its continuous extension would be used for decisions affecting live-or-death questions. The laws governing probabilities themselves seem to reflect that of more elementary mathematical structures. Kevin Knuth shows how these emerge from lattice theory, which deals with relations in partially ordered sets like that of collections of possibilities.8 The sum rule of probability theory is a direct consequence of the underlying lattice structure. Interestingly, a number of other theories are resting also on such lattices and therefore exhibit their own versions of sum rules: measures of sets, mutual information, the Euler characteristics of topological spaces, as well as quantum mechanical interactions that are quantified by pairs of numbers, the real and imaginary parts of complex probability amplitudes (see also4). The theory of information has very practical application in physics and elsewhere. Manfred Opper discusses how the solutions of stochastic differential equations can be inferred via variational methods, which have their origin in thermodynamics.9 Torsten Enßlin introduces information field theory (IFT), the information theory for fields, as a means to infer the configuration of a physical field from incomplete and noisy data.10 The mathematical apparatus for this is that of quantum field theory (QFT), just with ordinary probabilities instead of complex probability amplitudes as in the latter. Could it be that the difference between IFT and QFT is just be the same as between classical information theory and quantum mechanics, the transition from real valued to complex valued quantifier for statements? Anyhow, any practical inference machinery, be it for dynamical systems or for fields, requires sophisticated numerical methods. Michael Betancourt reviews Markov Chain Monte Carlo Methods to calculate expectation values over high dimensional probabilities.11 Theo Steininger and coworkers present the NIFTy3 software package for numerical information field theory calculations, which can handle very high dimensional field inference problems.12 Finally, in an article focused on the subtleties of the Monty Hall problem and mostly aiming at information theoretical entertainment, Torsten Enßlin and Margret Westercamp investigate the possibility that human intuition might be more rational than contemporary psychology thinks.13 A number of possible topics for an issue on physics of information are not addressed here. We would have loved to have articles on Landauer's principle, which states that erasing information has to cost energy, on QBism, a Bayesian version of quantum mechanics, on artificial and biological neural networks, as well as any other aspect of the information-soaked biological world. What has a reader of this special issue to be equipped with in order to follow the lines of thoughts? In addition to the usual physicist's education, the minimal additional equipment are the basics of probability theory and the concept of entropy. Most of the other concepts used in the articles rest on those and are introduced there. Let A, B, and C be propositions (or possibilities). The probability P ( A | B ) of A being true assuming that B is true is a number between 0 and 1, with P ( A | B ) = 1 expressing certainty of A under B ( B ⇒ A ) and P ( A | B ) = 0 expressing certainty of not A being the case under B ( B ⇒ ¬ A ).
Of John Wheeler's “Really Big Questions,” the one on which the most progress has been made is “It from bit?” – does information play a significant role at the foundations of physics? It is perhaps less ambitious than some of the other questions, such as “How come existence?”, because it does not necessarily require a metaphysical answer. And unlike, say, “Why the quantum?”, it does not require the discovery of new laws of nature: there was room for hope that it might be answered through a better understanding of the laws as we currently know them, particularly those of quantum physics. And this is what has happened: the better understanding is the quantum theory of information and computation.
The theory is based on a new hypothesis on the nature of matter. This hypothesis is that the elementary particles, atoms, and molecules we have found in nature are not part of the real world, but constitute information about the real world. They are the wave components of a generalized Fourier analysis of our observations (which in the final analysis are always space-time distributions of photon- or particle-counter clicks). This Fourier analysis should be so general that every observation can be expressed in its terms; it thereby becomes axiomatic. Physicists of past generations, with their sound instincts, were intuitively approaching this most general and most powerful possible analysis of our observations. With the discovery of quantum mechanics, this development had advanced so far that the precise formulation of this ultimate analysis could be guessed. The model which can guide us to this mathematical formulation is that of an ideal optical observation on a physical object. This observation is made by illuminating the object with a finite number of laser beams of known amplitude and phase, and observing the amplitude and phase of the finite number of light beams emerging from the object space. The assumption that this is all the information we can ever obtain about the object leads to a wave function of the object which consists of light waves, extrapolated from the photon detectors back to the object space. It is suggested that these light waves should be presented as a product of amplitudes in a 4n-dimensional space, where n is the number of light quanta in the signal. Most important, force, or interaction, can then be described as a linear transformation in this space. The actual mathematical formalism proposed on the basis of that model is Xf=dtitdf. X is the Hamiltonian of the whole universe with ${n}_{0}\ensuremath{\cong}{10}^{80}$ particles. It is a $4{n}_{0}\ifmmode\times\else\texttimes\fi{}4{n}_{0}$ linear matrix operator. f is a 4n0-component vector wave function representing waves traveling at the speed of light. The coordinates are the homogeneous coordinates (xj,yj,zj,uj) of the n0 particles in the closed universe. The eigenvalue $\ensuremath{\omega}$, in $Xf=\ensuremath{\omega}f$, is a $4{n}_{0}\ifmmode\times\else\texttimes\fi{}4{n}_{0}$ Hermitian matrix. It can be divided into ${n}_{0}\ifmmode\times\else\texttimes\fi{}{n}_{0}$, 4 \ifmmode\times\else\texttimes\fi{} 4 submatrices, each representing a complete set of dynamic and inertial quantities of elementary particles, or interaction quanta between particles. $\frac{\mathrm{it}df}{\mathrm{dt}}=\ensuremath{\omega}f$ is therefore a complete expression of the dynamic conservation laws. A special orthogonal transformation ${\ensuremath{\alpha}}_{0}$ transforms the solution into a standard solution with eigenvalue ${\ensuremath{\omega}}_{0}$, representing n0 identical elementary particles. The assumption that the universe is of maximum probability then leads to simple explicit expressions for all matrix elements of ${\ensuremath{\omega}}_{0}$. This means that the energy levels of all n-particle systems (atoms or molecules) of the theory can be directly calculated. The equations demand relations between cosmological constants and atomic constants. In a universe of the size and mass of our observed universe, the elementary particle would have to be the size of the proton.
We know how to use the “rules” of quantum physics to build lasers, microchips, and nuclear power plants, but when students question the rules themselves, the best answer we can give is often, “The world just happens to be that way.” Yet why are individual outcomes in quantum measurements random? What is the origin of the Schrodinger equation? In a paper [1] appearing in Physical Review A, Giulio Chiribella at the Perimeter Institute in Waterloo, Canada, and Giacomo Mauro D’Ariano and Paolo Perinotti at the University of Pavia, Italy, offer a framework in which to answer these penetrating questions. They show that by making six fundamental assumptions about how information is processed, they can derive quantum theory. (Strictly speaking, their derivation only applies to systems that can be constructed from a finite number of quantum states, such as spin.) In this sense, Chiribella et al.’s work is in the spirit of John Wheeler’s belief that one obtains “it from bit,” in other words, that our account of the universe is constructed from bits of information, and the rules on how that information can be obtained determine the “meaning” of what we call particles and fields.
Quantum computing raises novel meditation upon the nature of information, notably a number of theorists set out the critical elements of Shannon’s work, which currently emerges as the most popular reference in the quantum territory. The present paper follows this vein and highlights how the prerequisites of the information theory, which should detail the precise hypotheses of this theory, appear rather obscure and the problem of the existence of information is still open. This work puts forward a theoretical scheme that calculates the existence of elementary items. These results clarify basic assumptions in information engineering. Later we bring evidence how information is not an absolute quantity and close with a discussion upon the information relativity.