Failures of information geometry
John Skilling
Information H is a unique relationship between probabilities, based on the property of independence which is central to scientific methodology. Information Geometry makes the tempting but fallacious assumption that a local metric (conventionally based on information) can be used to endow the space of probability distributions with a preferred global Riemannian metric. No such global metric can conform to H, which is “from-to” asymmetric whereas geometrical length is by definition symmetric. Accordingly, any Riemannian metric will contradict the required structure of the very distributions which are supposedly being triangulated. It follows that probabilities do not form a metric space. We give counter-examples in which alternative formulations of information, and the use of information geometry, lead to unacceptable results.
AIP conference proceedings•Jan 1, 2015•1 citation