It is broadly believed that everything in the universe is found to be made from a few basic building blocks called fundamental particles, governed by four fundamental forces. However, physicists such as John Archibald Wheeler suggested that information is fundamental to the physics of the universe. According to this it from bit doctrine, all things physical are information-theoretic in origin. This doctrine is based in the old Copenhagen interpretation of quantum mechanics; an interpretation which is internally inconsistent and no applicable to the cosmos as a whole. Modern consistent interpretations of quantum mechanics eliminate the old myths about measurement processes and observers' consciousness and reintroduce the idea of a wholly physical reality, invalidating the it from bit doctrine. Utilizing a new phase space formulation of quantum mechanics developed recently by the author, the concepts of bit and it are reconsidered. We introduce the new states D as quantum bits and the new Hamiltonians H as quantum its. The new concepts of it and bit introduced in this work have a well-defined and rigorous definition, unlike Wheeler's concepts. Moreover, the new concepts apply on situations where the traditional wavefunction theory does not work. The it H is not derivable from the bit D and, as a consequence, the old it from bit doctrine gets substituted by the new it and bit. After showing why the physical entropy used in the science of thermodynamics is not a measure of the ignorance of human observers, the final part of this Essay is devoted to emphasize the importance that the bit acquires in modern science when confronted to the delicious multiplicity of the far-from-equilibrium regimes, where the certainty of Newtonian and Schrodinger motion begin to fade in favour of a complex non-geometrical, 'living', conception of Nature: an it and bit conception.
It is broadly believed that everything in the universe is found to be made from a few basic building blocks called fundamental particles, governed by four fundamental forces. However, physicists such as John Archibald Wheeler suggested that information is fundamental to the physics of the universe. According to this it from bit doctrine, all things physical are information-theoretic in origin. This doctrine is based in the old Copenhagen interpretation of quantum mechanics; an interpretation which is internally inconsistent and no applicable to the cosmos as a whole. Modern consistent interpretations of quantum mechanics eliminate the old myths about measurement processes and observers' consciousness and reintroduce the idea of a wholly physical reality, invalidating the it from bit doctrine. Utilizing a new phase space formulation of quantum mechanics developed recently by the author, the concepts of bit and it are reconsidered. We introduce the new states D as quantum bits and the new Hamiltonians H as quantum its. The new concepts of it and bit introduced in this work have a well-defined and rigorous definition, unlike Wheeler's concepts. Moreover, the new concepts apply on situations where the traditional wavefunction theory does not work. The it H is not derivable from the bit D and, as a consequence, the old it from bit doctrine gets substituted by the new it and bit. After showing why the physical entropy used in the science of thermodynamics is not a measure of the ignorance of human observers, the final part of this Essay is devoted to emphasize the importance that the bit acquires in modern science when confronted to the delicious multiplicity of the far-from-equilibrium regimes, where the certainty of Newtonian and Schrodinger motion begin to fade in favour of a complex non-geometrical, 'living', conception of Nature: an it and bit conception.
The experience from Quantum Information of the last twenty years has lead theorists to look at Quantum Theory and the whole of Physics from a different angle. A new information-theoretic paradigm is emerging, long time ago prophesied by John Archibald Wheeler with his popular coinage 'It from bit'. Theoretical groups are now addressing the problem of deriving Quantum Theory from informational principles, and similar lines are investigated in new approaches to Quantum Gravity. In my talk I will review some recent advances on these lines. The general idea synthesizing the new paradigm is that there is only Quantum Theory (without quantization rules): the whole Physics--including space-time and relativity--is emergent from quantum-information processing. And, since Quantum Theory itself is made with purely informational principles, the whole Physics must be reformulated in information-theoretical terms. The review is divided into the following parts: (a) The informational axiomatization of Quantum Theory; (b) How space-time and relativistic covariance emerge from the quantum computation; (c) What is the information-theoretical meaning of inertial mass and Planck constant, and how the quantum field emerges; (d) Observational consequences: mass-dependent refraction index of vacuum. I then conclude with some possible future research lines.
Whoever it was who first contracted the words 'binary digit' to form 'bit' can hardly have realised that he (she?) was coining a term not only for the smallest unit of information but also for the smallest unit of 'being' – or so the general relativist John Archibald Wheeler would have us believe. 'It from bit' is his declamation of the ultimate fount of significance of every physical quantity: all we can know about photons, fields, black holes – you name 'it' – depends at root, he emphasizes, on yes-or-no indications. Pursuing the implications of this observation through quantised strings, quantum measurement theory, computational representations of physical laws, information theory, thermodynamic entropy, evolution... those, he says, are routes to that happy state of perceived simplicity and beauty when we finally know the Final Answer to the question: 'How come existence?'
In his 1989 essay, John Archibald Wheeler has tried to answer the eternal question of existence. He did it by searching for links between information, physics, and quanta. The main concept emerging from his essay is that "every physical quantity, every it, derives its ultimate significance from bits, binary yes-or-no indications". This concept has been summarized in the catchphrase "it from bit". In the Wheeler's essay, it is possible to read several times the echoes of the philosophy of Niels Bohr. The Danish physicist has pointed out how the quantum and relativistic physics - forcing us to abandon the anchor of the visual reference of common sense - have imposed a greater attention to the language. Bohr did not deny the physical reality, but recognizes that there is always need of a language no matter what a person wants to do. To put it as Carlo Sini, language is the first toolbox that man has at hands to analyze the experience. It is not a thought translated into words, because to think is to operate with signs as reminded us by various philosophers from Leonardo da Vinci to Ludwig Wittgenstein. [...]
The present understanding of the relation betweenreality and information theory is for the time being rather vague. There are many speculations about the fact that the understanding of reality may be beyond ourcapabilities. However the perception of our observed reality in relation to quantum physics and consciousness as per Wheeler’s theories may lead to the exploration of some new branches of quantum physics and consciousness theory. For many physicists, this may be something rather troubling but what if non – computability was actually part of reality? What if there were some processes or some kind of information that cannot be understood through algorithms and needed new understanding. In this essay the relation between information, reality and consciousness will be briefly discussed.
What is information? A short answer could be: Anything that changes our minds and states of thinking! Information is virtual. It can be carried by speech, an image, scratches on a stone, patterns in a photon field, the connections of neurons in our brains or even by the wavefunction of an electron. Information does not depend on the actual means of transmission nor does its identity change when changing the carrier. Information is physical. It needs to be sustained by a physical substrate and rearranging that substrate to contain the wanted information requires to spend energy or work. Without a physical world, information can not be stored, processed, or transmitted. Our world is permeated with different representations of information. Actually Information about the physical laws governing our Universe can be found everywhere and in everything. Could it then be that the real fundamental elements of this world are tiny bits of information? Could we get it from bit?1 A number of researcher investigate this possibility, and several of their attempts to recover physical laws from the principles governing information are reported about in this special issue on physics of information. The articles by Gregg Jaeger,2 by Ariel Caticha,3 and by John Skilling and Kevin Knuth4 address the reconstruction of quantum mechanics from information theory. Furthermore, Kevin Knuth and James Walsh5 show how to recover space-time from particles sending each others signals in an initially geometry-free setting. A central element of most works on information is the concept of a probability. Probabilities can be defined via various routes. Most familiar might be their definitions by the frequentists school as relative frequencies of events (in the limit of infinite amounts of such). A more general definition of probabilities is the Bayesians' one, which regards probabilities as quantifiers of statements, expressing how much those should be expected to be true. Although this definition looks subjective on the first glance, it rests on a solid mathematical theorem by Richard Cox6 that any extension of binary logic to a continuum of single valued truthfulness quantifier that respects a minimum of requirements must be isomorphic to probability theory. And this definition turns out to embrace the frequentists' definition in case that infinite numbers of comparable events are actually available and can be counted. The majority of authors of this special issues seem to favor the Bayesian perspective, which is probably a result of our own, the guest editors', preference and not necessarily a reflection of the prevailing position of contemporary scientists. The different views on probabilities of frequentists and Bayesians are addressed by the article of Allen Caldwell.7 He builds a bridge between these antagonistic camps by explaining frequentists' constructions in a Bayesian language. In particular, his argumentation why the omnipresent p-value in statistical and experimental literature might often capture a relevant signal of model misfit is reassuring, given that a large fraction of our medical system is based on decisions backed up by p-values. A Bayesian might add that it would be even more reassuring, if a system rigorously build on logic and its continuous extension would be used for decisions affecting live-or-death questions. The laws governing probabilities themselves seem to reflect that of more elementary mathematical structures. Kevin Knuth shows how these emerge from lattice theory, which deals with relations in partially ordered sets like that of collections of possibilities.8 The sum rule of probability theory is a direct consequence of the underlying lattice structure. Interestingly, a number of other theories are resting also on such lattices and therefore exhibit their own versions of sum rules: measures of sets, mutual information, the Euler characteristics of topological spaces, as well as quantum mechanical interactions that are quantified by pairs of numbers, the real and imaginary parts of complex probability amplitudes (see also4). The theory of information has very practical application in physics and elsewhere. Manfred Opper discusses how the solutions of stochastic differential equations can be inferred via variational methods, which have their origin in thermodynamics.9 Torsten Enßlin introduces information field theory (IFT), the information theory for fields, as a means to infer the configuration of a physical field from incomplete and noisy data.10 The mathematical apparatus for this is that of quantum field theory (QFT), just with ordinary probabilities instead of complex probability amplitudes as in the latter. Could it be that the difference between IFT and QFT is just be the same as between classical information theory and quantum mechanics, the transition from real valued to complex valued quantifier for statements? Anyhow, any practical inference machinery, be it for dynamical systems or for fields, requires sophisticated numerical methods. Michael Betancourt reviews Markov Chain Monte Carlo Methods to calculate expectation values over high dimensional probabilities.11 Theo Steininger and coworkers present the NIFTy3 software package for numerical information field theory calculations, which can handle very high dimensional field inference problems.12 Finally, in an article focused on the subtleties of the Monty Hall problem and mostly aiming at information theoretical entertainment, Torsten Enßlin and Margret Westercamp investigate the possibility that human intuition might be more rational than contemporary psychology thinks.13 A number of possible topics for an issue on physics of information are not addressed here. We would have loved to have articles on Landauer's principle, which states that erasing information has to cost energy, on QBism, a Bayesian version of quantum mechanics, on artificial and biological neural networks, as well as any other aspect of the information-soaked biological world. What has a reader of this special issue to be equipped with in order to follow the lines of thoughts? In addition to the usual physicist's education, the minimal additional equipment are the basics of probability theory and the concept of entropy. Most of the other concepts used in the articles rest on those and are introduced there. Let A, B, and C be propositions (or possibilities). The probability P ( A | B ) of A being true assuming that B is true is a number between 0 and 1, with P ( A | B ) = 1 expressing certainty of A under B ( B ⇒ A ) and P ( A | B ) = 0 expressing certainty of not A being the case under B ( B ⇒ ¬ A ).
Since every substance has a price tag of information that includes all the building blocks in our universe, one cannot simply ignore information when dealing with science. We have shown that there is a profound connection between information and entropy, a quantity that has been well accepted in science. Without this connection, information would be more difficult to apply in science. Two of the most important pillars in modern physics must be Einstein’s relativity theory and Schrödinger’s quantum mechanics. However, there exists a profound connection between them, by means of Heisenberg’s uncertainty principle. Due to the uncertainty relation, we see that every bit of information takes time and energy to transfer, create, and observe. Since one cannot create something from nothing, anything to be created needs a huge amount of energy and a great deal of entropy to make it happen.