Motivated by Hall's recent comment in quant-ph/0007116 we point out in some detail the essence of our reasoning why we believe that Shannon's information is not an adequate choice when defining the information gain in quantum measurements as opposed to classical observations.
In a classical measurement the Shannon information is a natural measure of our ignorance about properties of a system. There, observation removes that ignorance in revealing properties of the system which can be considered to preexist prior to and independent of observation. Because of the completely different root of a quantum measurement as compared to a classical measurement, conceptual difficulties arise when we try to define the information gain in a quantum measurement using the notion of Shannon information. The reason is that, in contrast to classical measurements, quantum measurements, with very few exceptions, cannot be claimed to reveal a property of the individual quantum system existing before the measurement is performed.
It is pointed out that the case for Shannon entropy and von Neumann entropy, as measures of uncertainty in quantum mechanics, is not as bleak as suggested in quant-ph/0006087. The main argument of the latter is based on one particular interpretation of Shannon's H-function (related to consecutive measurements), and is shown explicitly to fail for other physical interpretations. Further, it is shown that Shannon and von Neumann entropies have in fact a common fundamental significance, connected to the existence of a unique geometric measure of uncertainty for classical and quantum ensembles. Some new properties of the ``total information'' measure proposed in quant-ph/0006087 are also given.