IEEE Transactions on Information Theory
Chain Independence and Common Information
Konstantin Makarychev, Yury Makarychev
Abstract
We present a new proof of a celebrated result of Gács and Körner that the common information is far less than the mutual information. Consider two sequences$\alpha_{1},\ldots\alpha_{n}$and$\beta_{1},\ldots,\beta_{n}$of random variables, where pairs$(\alpha_{1},\beta_{1}),\ldots, (\alpha_{n},\beta_{n})$are independent and identically distributed. Gács and Körner proved that it is not possible to extract “common information” from these two sequences unless the joint distribution matrix of random variables$(\alpha_{i},\beta_{i})$is a block matrix.