Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Elsevier eBooks

Entropy and Information Sources

Roman F. Nalewajski

Published Jan 1, 2023• 0 citations
Publisher
DOI
10.1016/b978-0-323-95622-2.50006-3

Related papers

Information and Entropy

Springer eBooks•Jan 1, 2006•0 citations

Smooth Rényi Entropy of Ergodic Quantum Information Sources

Berry Schoenmakers, Jilles Tjoelker, Pim Tuyls +1 more

We investigate the recently introduced notion of smooth Renyi entropy for the case of ergodic information sources, thereby generalizing previous work which concentrated mainly on i.i.d. information sources. We will actually consider ergodic quantum information sources, of which ergodic classical information sources are a special case. We prove that the average smooth Renyi entropy rate will approach the entropy rate of a stationary, ergodic source, which is equal to the Shannon entropy rate for a classical source and the von Neumann entropy rate for a quantum source.

IEEE International Symposium on Information Theory (ISIT)•Jun 1, 2007•6 citations

Smooth Rényi Entropy of Ergodic Quantum Information Sources

Berry Schoenmakers, Jilles Tjoelker, Pim Tuyls +1 more

We prove that the average smooth Renyi entropy rate will approach the entropy rate of a stationary, ergodic information source, which is equal to the Shannon entropy rate for a classical information source and the von Neumann entropy rate for a quantum information source.

arXiv:0704.3504•Apr 26, 2007•8 citations

2. Entropy Sources

David Johnston

De Gruyter eBooks•Sep 12, 2018•0 citations

On Information, Quanta, and Context

J. Acácio de Barros

Classical information theory relies on the probabilities that signals appear in a source. As such, information depends on Kolmogorov’s probability theory. However, it is well known that some quantum sources are context-dependent, and therefore may not conform to classical probability theory. For such sources, information can be defined through von Neumann’s entropy. However, there are possible contextual sources that are neither quantum nor classical. In this chapter, we explore a simple example of one such source, and show that, similarly to the quantum case, the presence of contextuality increases the amount of information. We also show that, by extending Shannon’s entropy to accommodate negative quasi-probability distributions, we are able to provide a measure of informational content that is neither described by Shannon nor von Neumann’s entropies.

WORLD SCIENTIFIC eBooks•Feb 1, 2020•0 citations

Information and Entropies

Ramona Wolf

Lecture notes in physics•Jan 1, 2021•2 citations
We investigate the recently introduced notion of smooth Renyi entropy for the case of ergodic information sources, thereby generalizing previous work which concentrated mainly on i.i.d. information sources. We will actually consider ergodic quantum information sources, of which ergodic classical information sources are a special case. We prove that the average smooth Renyi entropy rate will approach the entropy rate of a stationary, ergodic source, which is equal to the Shannon entropy rate for a classical source and the von Neumann entropy rate for a quantum source.
Classical information theory relies on the probabilities that signals appear in a source. As such, information depends on Kolmogorov’s probability theory. However, it is well known that some quantum sources are context-dependent, and therefore may not conform to classical probability theory. For such sources, information can be defined through von Neumann’s entropy. However, there are possible contextual sources that are neither quantum nor classical. In this chapter, we explore a simple example of one such source, and show that, similarly to the quantum case, the presence of contextuality increases the amount of information. We also show that, by extending Shannon’s entropy to accommodate negative quasi-probability distributions, we are able to provide a measure of informational content that is neither described by Shannon nor von Neumann’s entropies.