I introduce rate-distortion theory for the coding of quantum information, and derive a lower bound, involving the coherent information, on the rate at which qubits must be used to store or compress an entangled quantum source with a given maximum level of distortion per source emission.
Rate-distortion theory provides bounds for compressing data produced by an information source to a specified encoding rate that is strictly less than the source's entropy. This necessarily entails some loss, or distortion, between the original source data and the best approximation after decompression. The so-called Information Bottleneck Method is designed to compress only “relevant” information. Which information is relevant is determined by the correlation between the data being compressed and a variable of interest, so-called side information. In this paper, an Information Bottleneck Method is introduced for the compression of quantum data. The channel communication picture is used for compression and decompression. The rate of compression is derived using an entanglement-assisted protocol with classical communication, and under an unproved conjecture that the rate function is convex in the distortion parameter. The optimum channel achieving this rate for a given input state is characterized. The conceptual difficulties arising due to differences in the mathematical formalism between quantum and classical probability theory are discussed and solutions are presented.
We derive quantum counterparts of two key theorems of classical information theory, namely, the rate-distortion theorem and the source-channel separation theorem. The rate-distortion theorem gives the ultimate limits on lossy data compression, and the source-channel separation theorem implies that a two-stage protocol consisting of compression and channel coding is optimal for transmitting a memoryless source over a memoryless channel. In spite of their importance in the classical domain, there has been surprisingly little work in these areas for quantum information theory. In this paper, we prove that the quantum rate-distortion function is given in terms of the regularized entanglement of purification. We also determine a single-letter expression for the entanglement-assisted quantum rate-distortion function, and we prove that it serves as a lower bound on the unassisted quantum rate-distortion function. This implies that the unassisted quantum rate-distortion function is nonnegative and generally not equal to the coherent information between the source and distorted output (in spite of Barnum's conjecture that the coherent information would be relevant here). Moreover, we prove several quantum source-channel separation theorems. The strongest of these are in the entanglement-assisted setting, in which we establish a necessary and sufficient condition for transmitting a memoryless source over a memoryless quantum channel up to a given distortion.
We provide a framework for one-shot quantum rate distortion coding, in which the goal is to determine the minimum number of qubits required to compress quantum information as a function of the probability that the distortion incurred upon decompression exceeds some specified level. We obtain a one-shot characterization of the minimum qubit compression size for an entanglement-assisted quantum rate-distortion code in terms of the smooth max-information, a quantity previously employed in the one-shot quantum reverse Shannon theorem. Next, we show how this characterization converges to the known expression for the entanglement-assisted quantum rate distortion function for asymptotically many copies of a memoryless quantum information source. Finally, we give a tight, finite blocklength characterization for the entanglement-assisted minimum qubit compression size of a memoryless isotropic qubit source subject to an average symbolwise distortion constraint.
We formulate quantum rate-distortion theory in the most general setting where classical side information is included in the tradeoff. Using a natural distortion measure based on entanglement fidelity and specializing to the case of an unrestricted classical side channel, we find the exact quantum rate-distortion function for a source of isotropic qubits. An upper bound we believe to be exact is found in the case of biased sources. We establish that in this scenario optimal rate-distortion codes produce no entropy exchange with the environment of any individual qubit.
We extend quantum rate-distortion theory by considering auxiliary resources that might be available to a sender and receiver performing lossy quantum data compression. The first setting we consider is that of quantum rate-distortion coding with the help of a classical side channel. Our result here is that the regularized entanglement of formation characterizes the quantum rate-distortion function, extending earlier work of Devetak and Berger. We also combine this bound with the entanglement-assisted bound from our prior work to obtain the best known bounds on the quantum rate-distortion function for an isotropic qubit source. The second setting we consider is that of quantum rate-distortion coding with quantum side information (QSI) available to the receiver. In order to prove results in this setting, we first state and prove a quantum reverse Shannon theorem with QSI (for tensor-power states), which extends the known tensor-power quantum reverse Shannon theorem. The achievability part of this theorem relies on the quantum state redistribution protocol, while the converse relies on the fact that the protocol can cause only a negligible disturbance to the joint state of the reference and the receiver's QSI. This quantum reverse Shannon theorem with QSI naturally leads to quantum rate-distortion theorems with QSI, with or without entanglement assistance.