Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

The journal of the Institution of Electrical Engineers. Part 3, Radio and communication engineering

Theory of communication. Part 1: The analysis of information

Деннис Габор

Published Nov 1, 1946• 1,956 citations
Publisher

Abstract

Hitherto communication theory was based on two alternative methods of signal analysis. One is the description of the signal as a function of time; the other is Fourier analysis. Both are idealizations, as the first method operates with sharply defined instants of time, the second with infinite wave-trains of rigorously defined frequencies. But our everyday experiences—especially our auditory sensations—insist on a description in terms of both time and frequency. In the present paper this point of view is developed in quantitative language. Signals are represented in two dimensions, with time and frequency as co-ordinates. Such two-dimensional representations can be called “information diagrams,” as areas in them are proportional to the number of independent data which they can convey. This is a consequence of the fact that the frequency of a signal which is not of infinite duration can be defined only with a certain inaccuracy, which is inversely proportional to the duration, and vice versa. This “uncertainty relation” suggests a new method of description, intermediate between the two extremes of time analysis and spectral analysis. There are certain “elementary signals” which occupy the smallest possible area in the information diagram. They are harmonic oscillations modulated by a “probability pulse.” Each elementary signal can be considered as conveying exactly one datum, or one “quantum of information.” Any signal can be expanded in terms of these by a process which includes time analysis and Fourier analysis as extreme cases.These new methods of analysis, which involve some of the mathematical apparatus of quantum theory, are illustrated by application to some problems of transmission theory, such as direct generation of single sidebands, signals transmitted in minimum time through limited frequency channels, frequency modulation and time-division multiplex telephony.

DOI
10.1049/ji-3-2.1946.0074

Related papers

Structural information theory

Terence William Barrett

A method of defining structural information in Hilbert space is described. Instead of commencing an information theory analysis with a simple signal and progressing to an n-dimensional information space, the reverse procedure can be followed: the signal is defined completely in both real and imaginary spaces, and is then represented as a dimensionless number in Hilbert space. Thus, a signal can be analyzed into a Hilbert space measure of information. This measure has similarities to the relativity of states of Everett's (1957) reformulation of quantum mechanics involving observer-observed interaction. Whereas Everett's theory deals with the totality of all possible ways in which a state function can be decomposed into the sum of products of state functions for subsystems of the overall system, the theory presented here deals with the totality of possible ways in which a Hilbert space measure of signal state can be decomposed by signal definition into reciprocally related measures of the state for subsystems of the overall system. In the overall system presented here, a signal is given a concise representation either as a quadratic form on a Hilbert space, or as a Fourier coefficients in isomorphic function space. The total information content of a signal qualified as a dimensionless number in Hilbert space may be given a representation in familiar units by the use of such methods. A primary postulate of quantum mechanics is obeyed in that all physically relevant information about a system is derivable from the knowledge of the state function of the system. Thus, a signal is defined firstly as an information measure, and secondly in the familiar units of frequency, bandwidth, midperiod, and duration.

The Journal of the Acoustical Society of America•Oct 1, 1973•13 citations

Communication theory and physics

Деннис Габор

The electromagnetic signals used in communication are subject to the general laws of radiation. One obtains a complete representation of a signal by dividing the time-frequency plane into cells of unit area and associating with every cell a "ladder" of distinguishable steps in signal intensity. The steps are determined by Einstein's law of energy fluctuation, involving both waves and photons. This representation, however, gives only one datum per cell, viz. the energy, while in the classical description one has two data; an amplitude and a phase. It is shown in the second part of the paper that both descriptions are practically equivalent in the long-wave region, or for strong signals, as they contain approximately the same number of independent, distinguishable data, but the classical description is always a little less complete than the quantum description. In the best possible experimental analysis the number of distinguishable steps in the measurement of amplitude and phase is only the fourth root of the number of photons. Thus it takes a hundred million photons per cell in order to define amplitude and phase to one percent each.

Transactions of the IRE Professional Group on Information Theory•Feb 1, 1953•111 citations

The Physics of Information

Torsten A. Enßlin, Jens Jasche, John Skilling

What is information? A short answer could be: Anything that changes our minds and states of thinking! Information is virtual. It can be carried by speech, an image, scratches on a stone, patterns in a photon field, the connections of neurons in our brains or even by the wavefunction of an electron. Information does not depend on the actual means of transmission nor does its identity change when changing the carrier. Information is physical. It needs to be sustained by a physical substrate and rearranging that substrate to contain the wanted information requires to spend energy or work. Without a physical world, information can not be stored, processed, or transmitted. Our world is permeated with different representations of information. Actually Information about the physical laws governing our Universe can be found everywhere and in everything. Could it then be that the real fundamental elements of this world are tiny bits of information? Could we get it from bit?1 A number of researcher investigate this possibility, and several of their attempts to recover physical laws from the principles governing information are reported about in this special issue on physics of information. The articles by Gregg Jaeger,2 by Ariel Caticha,3 and by John Skilling and Kevin Knuth4 address the reconstruction of quantum mechanics from information theory. Furthermore, Kevin Knuth and James Walsh5 show how to recover space-time from particles sending each others signals in an initially geometry-free setting. A central element of most works on information is the concept of a probability. Probabilities can be defined via various routes. Most familiar might be their definitions by the frequentists school as relative frequencies of events (in the limit of infinite amounts of such). A more general definition of probabilities is the Bayesians' one, which regards probabilities as quantifiers of statements, expressing how much those should be expected to be true. Although this definition looks subjective on the first glance, it rests on a solid mathematical theorem by Richard Cox6 that any extension of binary logic to a continuum of single valued truthfulness quantifier that respects a minimum of requirements must be isomorphic to probability theory. And this definition turns out to embrace the frequentists' definition in case that infinite numbers of comparable events are actually available and can be counted. The majority of authors of this special issues seem to favor the Bayesian perspective, which is probably a result of our own, the guest editors', preference and not necessarily a reflection of the prevailing position of contemporary scientists. The different views on probabilities of frequentists and Bayesians are addressed by the article of Allen Caldwell.7 He builds a bridge between these antagonistic camps by explaining frequentists' constructions in a Bayesian language. In particular, his argumentation why the omnipresent p-value in statistical and experimental literature might often capture a relevant signal of model misfit is reassuring, given that a large fraction of our medical system is based on decisions backed up by p-values. A Bayesian might add that it would be even more reassuring, if a system rigorously build on logic and its continuous extension would be used for decisions affecting live-or-death questions. The laws governing probabilities themselves seem to reflect that of more elementary mathematical structures. Kevin Knuth shows how these emerge from lattice theory, which deals with relations in partially ordered sets like that of collections of possibilities.8 The sum rule of probability theory is a direct consequence of the underlying lattice structure. Interestingly, a number of other theories are resting also on such lattices and therefore exhibit their own versions of sum rules: measures of sets, mutual information, the Euler characteristics of topological spaces, as well as quantum mechanical interactions that are quantified by pairs of numbers, the real and imaginary parts of complex probability amplitudes (see also4). The theory of information has very practical application in physics and elsewhere. Manfred Opper discusses how the solutions of stochastic differential equations can be inferred via variational methods, which have their origin in thermodynamics.9 Torsten Enßlin introduces information field theory (IFT), the information theory for fields, as a means to infer the configuration of a physical field from incomplete and noisy data.10 The mathematical apparatus for this is that of quantum field theory (QFT), just with ordinary probabilities instead of complex probability amplitudes as in the latter. Could it be that the difference between IFT and QFT is just be the same as between classical information theory and quantum mechanics, the transition from real valued to complex valued quantifier for statements? Anyhow, any practical inference machinery, be it for dynamical systems or for fields, requires sophisticated numerical methods. Michael Betancourt reviews Markov Chain Monte Carlo Methods to calculate expectation values over high dimensional probabilities.11 Theo Steininger and coworkers present the NIFTy3 software package for numerical information field theory calculations, which can handle very high dimensional field inference problems.12 Finally, in an article focused on the subtleties of the Monty Hall problem and mostly aiming at information theoretical entertainment, Torsten Enßlin and Margret Westercamp investigate the possibility that human intuition might be more rational than contemporary psychology thinks.13 A number of possible topics for an issue on physics of information are not addressed here. We would have loved to have articles on Landauer's principle, which states that erasing information has to cost energy, on QBism, a Bayesian version of quantum mechanics, on artificial and biological neural networks, as well as any other aspect of the information-soaked biological world. What has a reader of this special issue to be equipped with in order to follow the lines of thoughts? In addition to the usual physicist's education, the minimal additional equipment are the basics of probability theory and the concept of entropy. Most of the other concepts used in the articles rest on those and are introduced there. Let A, B, and C be propositions (or possibilities). The probability P ( A | B ) of A being true assuming that B is true is a number between 0 and 1, with P ( A | B ) = 1 expressing certainty of A under B ( B ⇒ A ) and P ( A | B ) = 0 expressing certainty of not A being the case under B ( B ⇒ ¬ A ).

Annalen der Physik•Mar 1, 2019•2 citations

Quantum Multiplexing

William J. Munro

Multiplexing is an extremely well-established technique in the telecommunication industry [1] allowing multiple independent massages generated by multiple users to share a common transmission line. It works by the multiplexer dividing the capacity of the communication channel into a number of ‘logical’ channels which allow each of the users signal to be transmitted before a demultiplexer extracts them. There are various forms of it including space-division, frequency-division, time-division, code-division multiplexing to mention a few. Recently new form of ‘telecommunication’ has arisen. The principle of quantum mechanics and their associated quantum technologies [2] allow new forms of communication governed by superposition/entanglement and it is an open question as to where multiplexing will fit into it. Further those quantum principles may allow new forms of multiplexing unavailable to the classical world.

Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC)•Jun 21, 2021•0 citations

After 100 Years of Quantum Mechanics: Toward a Constructive Observation-Centered Perspective

Timothy Stroschein, Markus Reiher

Quantum mechanics owes much of its extraordinary success to a Hilbertian program of mathematical formalization. Yet, the formalism remains poorly aligned with the practical limitations of computations in finite dimensions and under finite accuracy. In this perspective, we argue that this mismatch points to the need for a new mathematical program: a rigorous constructive theory for effective descriptions to identify essential degrees of freedom. We propose an observation-centered point of view in which signals are treated as the primary objects of analysis, while wave functions and Hamiltonians are reconstructed as auxiliary structures to rationalize the observed data. Our starting point is a signal-based spectral equation that reformulates frequency analysis as an operator problem. We connect this point of view to results on prolate Fourier theory, spectral analysis with finite observation time, and short-time quantum simulation. We highlight a sharp accuracy transition relating necessary observation time to the effective spectral density of a signal for achieving accurate resolution. The resulting framework integrates approximation as a fundamental necessity more directly into the foundations of quantum mechanics and points toward a broader program for the effective description of complex quantum systems, such as those found in the molecular sciences.

quant-pharXiv:2604.11814•Journal of Chemical Theory and Computation•Apr 13, 2026•0 citations

Quantum theory of human communication

W. Słowikowski, Erik Nielsen

We use notions and techniques of Quantum Field Theory to formulate and investigate basic concepts and mechanisms of human communication. We start with attitudes which correspond to photons frequencies, then we introduce states-of-mind which correspond to wave functions. Finally, by way of the second quantization, we come to states-of-opinions which correspond to states of quantized radiation fields. In the present paper we shall only investigate superpositions of pairs of coherent states (e.g. the government and the opposition in a democratic country).

arXiv:physics/0404146•Apr 30, 2004•0 citations
Hitherto communication theory was based on two alternative methods of signal analysis. One is the description of the signal as a function of time; the other is Fourier analysis. Both are idealizations, as the first method operates with sharply defined instants of time, the second with infinite wave-trains of rigorously defined frequencies. But our everyday experiences—especially our auditory sensations—insist on a description in terms of both time and frequency. In the present paper this point of view is developed in quantitative language. Signals are represented in two dimensions, with time and frequency as co-ordinates. Such two-dimensional representations can be called “information diagrams,” as areas in them are proportional to the number of independent data which they can convey. This is a consequence of the fact that the frequency of a signal which is not of infinite duration can be defined only with a certain inaccuracy, which is inversely proportional to the duration, and vice versa. This “uncertainty relation” suggests a new method of description, intermediate between the two extremes of time analysis and spectral analysis. There are certain “elementary signals” which occupy the smallest possible area in the information diagram. They are harmonic oscillations modulated by a “probability pulse.” Each elementary signal can be considered as conveying exactly one datum, or one “quantum of information.” Any signal can be expanded in terms of these by a process which includes time analysis and Fourier analysis as extreme cases.These new methods of analysis, which involve some of the mathematical apparatus of quantum theory, are illustrated by application to some problems of transmission theory, such as direct generation of single sidebands, signals transmitted in minimum time through limited frequency channels, frequency modulation and time-division multiplex telephony.
A method of defining structural information in Hilbert space is described. Instead of commencing an information theory analysis with a simple signal and progressing to an n-dimensional information space, the reverse procedure can be followed: the signal is defined completely in both real and imaginary spaces, and is then represented as a dimensionless number in Hilbert space. Thus, a signal can be analyzed into a Hilbert space measure of information. This measure has similarities to the relativity of states of Everett's (1957) reformulation of quantum mechanics involving observer-observed interaction. Whereas Everett's theory deals with the totality of all possible ways in which a state function can be decomposed into the sum of products of state functions for subsystems of the overall system, the theory presented here deals with the totality of possible ways in which a Hilbert space measure of signal state can be decomposed by signal definition into reciprocally related measures of the state for subsystems of the overall system. In the overall system presented here, a signal is given a concise representation either as a quadratic form on a Hilbert space, or as a Fourier coefficients in isomorphic function space. The total information content of a signal qualified as a dimensionless number in Hilbert space may be given a representation in familiar units by the use of such methods. A primary postulate of quantum mechanics is obeyed in that all physically relevant information about a system is derivable from the knowledge of the state function of the system. Thus, a signal is defined firstly as an information measure, and secondly in the familiar units of frequency, bandwidth, midperiod, and duration.
The electromagnetic signals used in communication are subject to the general laws of radiation. One obtains a complete representation of a signal by dividing the time-frequency plane into cells of unit area and associating with every cell a "ladder" of distinguishable steps in signal intensity. The steps are determined by Einstein's law of energy fluctuation, involving both waves and photons. This representation, however, gives only one datum per cell, viz. the energy, while in the classical description one has two data; an amplitude and a phase. It is shown in the second part of the paper that both descriptions are practically equivalent in the long-wave region, or for strong signals, as they contain approximately the same number of independent, distinguishable data, but the classical description is always a little less complete than the quantum description. In the best possible experimental analysis the number of distinguishable steps in the measurement of amplitude and phase is only the fourth root of the number of photons. Thus it takes a hundred million photons per cell in order to define amplitude and phase to one percent each.
What is information? A short answer could be: Anything that changes our minds and states of thinking! Information is virtual. It can be carried by speech, an image, scratches on a stone, patterns in a photon field, the connections of neurons in our brains or even by the wavefunction of an electron. Information does not depend on the actual means of transmission nor does its identity change when changing the carrier. Information is physical. It needs to be sustained by a physical substrate and rearranging that substrate to contain the wanted information requires to spend energy or work. Without a physical world, information can not be stored, processed, or transmitted. Our world is permeated with different representations of information. Actually Information about the physical laws governing our Universe can be found everywhere and in everything. Could it then be that the real fundamental elements of this world are tiny bits of information? Could we get it from bit?1 A number of researcher investigate this possibility, and several of their attempts to recover physical laws from the principles governing information are reported about in this special issue on physics of information. The articles by Gregg Jaeger,2 by Ariel Caticha,3 and by John Skilling and Kevin Knuth4 address the reconstruction of quantum mechanics from information theory. Furthermore, Kevin Knuth and James Walsh5 show how to recover space-time from particles sending each others signals in an initially geometry-free setting. A central element of most works on information is the concept of a probability. Probabilities can be defined via various routes. Most familiar might be their definitions by the frequentists school as relative frequencies of events (in the limit of infinite amounts of such). A more general definition of probabilities is the Bayesians' one, which regards probabilities as quantifiers of statements, expressing how much those should be expected to be true. Although this definition looks subjective on the first glance, it rests on a solid mathematical theorem by Richard Cox6 that any extension of binary logic to a continuum of single valued truthfulness quantifier that respects a minimum of requirements must be isomorphic to probability theory. And this definition turns out to embrace the frequentists' definition in case that infinite numbers of comparable events are actually available and can be counted. The majority of authors of this special issues seem to favor the Bayesian perspective, which is probably a result of our own, the guest editors', preference and not necessarily a reflection of the prevailing position of contemporary scientists. The different views on probabilities of frequentists and Bayesians are addressed by the article of Allen Caldwell.7 He builds a bridge between these antagonistic camps by explaining frequentists' constructions in a Bayesian language. In particular, his argumentation why the omnipresent p-value in statistical and experimental literature might often capture a relevant signal of model misfit is reassuring, given that a large fraction of our medical system is based on decisions backed up by p-values. A Bayesian might add that it would be even more reassuring, if a system rigorously build on logic and its continuous extension would be used for decisions affecting live-or-death questions. The laws governing probabilities themselves seem to reflect that of more elementary mathematical structures. Kevin Knuth shows how these emerge from lattice theory, which deals with relations in partially ordered sets like that of collections of possibilities.8 The sum rule of probability theory is a direct consequence of the underlying lattice structure. Interestingly, a number of other theories are resting also on such lattices and therefore exhibit their own versions of sum rules: measures of sets, mutual information, the Euler characteristics of topological spaces, as well as quantum mechanical interactions that are quantified by pairs of numbers, the real and imaginary parts of complex probability amplitudes (see also4). The theory of information has very practical application in physics and elsewhere. Manfred Opper discusses how the solutions of stochastic differential equations can be inferred via variational methods, which have their origin in thermodynamics.9 Torsten Enßlin introduces information field theory (IFT), the information theory for fields, as a means to infer the configuration of a physical field from incomplete and noisy data.10 The mathematical apparatus for this is that of quantum field theory (QFT), just with ordinary probabilities instead of complex probability amplitudes as in the latter. Could it be that the difference between IFT and QFT is just be the same as between classical information theory and quantum mechanics, the transition from real valued to complex valued quantifier for statements? Anyhow, any practical inference machinery, be it for dynamical systems or for fields, requires sophisticated numerical methods. Michael Betancourt reviews Markov Chain Monte Carlo Methods to calculate expectation values over high dimensional probabilities.11 Theo Steininger and coworkers present the NIFTy3 software package for numerical information field theory calculations, which can handle very high dimensional field inference problems.12 Finally, in an article focused on the subtleties of the Monty Hall problem and mostly aiming at information theoretical entertainment, Torsten Enßlin and Margret Westercamp investigate the possibility that human intuition might be more rational than contemporary psychology thinks.13 A number of possible topics for an issue on physics of information are not addressed here. We would have loved to have articles on Landauer's principle, which states that erasing information has to cost energy, on QBism, a Bayesian version of quantum mechanics, on artificial and biological neural networks, as well as any other aspect of the information-soaked biological world. What has a reader of this special issue to be equipped with in order to follow the lines of thoughts? In addition to the usual physicist's education, the minimal additional equipment are the basics of probability theory and the concept of entropy. Most of the other concepts used in the articles rest on those and are introduced there. Let A, B, and C be propositions (or possibilities). The probability P ( A | B ) of A being true assuming that B is true is a number between 0 and 1, with P ( A | B ) = 1 expressing certainty of A under B ( B ⇒ A ) and P ( A | B ) = 0 expressing certainty of not A being the case under B ( B ⇒ ¬ A ).
Multiplexing is an extremely well-established technique in the telecommunication industry [1] allowing multiple independent massages generated by multiple users to share a common transmission line. It works by the multiplexer dividing the capacity of the communication channel into a number of ‘logical’ channels which allow each of the users signal to be transmitted before a demultiplexer extracts them. There are various forms of it including space-division, frequency-division, time-division, code-division multiplexing to mention a few. Recently new form of ‘telecommunication’ has arisen. The principle of quantum mechanics and their associated quantum technologies [2] allow new forms of communication governed by superposition/entanglement and it is an open question as to where multiplexing will fit into it. Further those quantum principles may allow new forms of multiplexing unavailable to the classical world.
Quantum mechanics owes much of its extraordinary success to a Hilbertian program of mathematical formalization. Yet, the formalism remains poorly aligned with the practical limitations of computations in finite dimensions and under finite accuracy. In this perspective, we argue that this mismatch points to the need for a new mathematical program: a rigorous constructive theory for effective descriptions to identify essential degrees of freedom. We propose an observation-centered point of view in which signals are treated as the primary objects of analysis, while wave functions and Hamiltonians are reconstructed as auxiliary structures to rationalize the observed data. Our starting point is a signal-based spectral equation that reformulates frequency analysis as an operator problem. We connect this point of view to results on prolate Fourier theory, spectral analysis with finite observation time, and short-time quantum simulation. We highlight a sharp accuracy transition relating necessary observation time to the effective spectral density of a signal for achieving accurate resolution. The resulting framework integrates approximation as a fundamental necessity more directly into the foundations of quantum mechanics and points toward a broader program for the effective description of complex quantum systems, such as those found in the molecular sciences.
We use notions and techniques of Quantum Field Theory to formulate and investigate basic concepts and mechanisms of human communication. We start with attitudes which correspond to photons frequencies, then we introduce states-of-mind which correspond to wave functions. Finally, by way of the second quantization, we come to states-of-opinions which correspond to states of quantized radiation fields. In the present paper we shall only investigate superpositions of pairs of coherent states (e.g. the government and the opposition in a democratic country).