Cox's theorem

Cox's assumptions

Cox wanted his system to satisfy the following conditions:

1. Divisibility and comparability – The plausibility of a proposition is a real number and is dependent on information we have related to the proposition.
2. Common sense – Plausibilities should vary sensibly with the assessment of plausibilities in the model.
3. Consistency – If the plausibility of a proposition can be derived in many ways, all the results must be equal.

The postulates as stated here are taken from Arnborg and Sjödin. "Common sense" includes consistency with Aristotelian logic in the sense that logically equivalent propositions shall have the same plausibility.

The postulates as originally stated by Cox were not mathematically rigorous (although better than the informal description above), e.g., as noted by Halpern. However it appears to be possible to augment them with various mathematical assumptions made either implicitly or explicitly by Cox to produce a valid proof.

Cox's notation:

The plausibility of a proposition A given some related information X is denoted by A ∣ X .

Cox's postulates and functional equations are:

The plausibility of the conjunction A B of two propositions A , B , given some related information X , is determined by the plausibility of A given X and that of B given A X .

In form of a functional equation Because of the associative nature of the conjunction in propositional logic, the consistency with logic gives a functional equation saying that the function g is an associative binary operation.

Addtitionally, Cox postulates the function g to be monotonic.

All strictly increasing associative binary operations on the real numbers are isomorphic to multiplication of numbers in the interval [0, 1], which means that there is a function w mapping plausibilities to interval [0, 1] such that w ( A B ∣ X ) = w ( A ∣ X ) w ( B ∣ A X )

The plausibility of a proposition determines the plausibility of the proposition's negation.

This postulates the existence of a function f such that w ( not  A ∣ X ) = f ( w ( A ∣ X ) ) Because "a double negative is an affirmative", consistency with logic gives a functional equation saying that the function f is an involution, i.e., it is its own inverse.

Furthermore, Cox postulates the function f to be monotonic.

The above functional equations and consistency with logic imply that Since A B is logically equivalent to B A , we also get w ( A ∣ X ) f ( w ( A  not  B ∣ X ) w ( A ∣ X ) ) = w ( B ∣ X ) f ( w ( B  not  A ∣ X ) w ( B ∣ X ) ) If, in particular, B =  not  ( A D ) , then also A  not  B = not  B and B  not  A =  not  A and we get w ( A  not  B ∣ X ) = w ( not  B ∣ X ) = f ( w ( B ∣ X ) ) and Abbreviating w ( A ∣ X ) = x and w ( B ∣ X ) = y we get the functional equation x f ( f ( y ) x ) = y f ( f ( x ) y )

Implications of Cox's postulates

The laws of probability derivable from these postulates are the following. Let A ∣ B be the plausibility of the proposition A given B satisfying Cox's postulates. Then there is a function w mapping plausibilities to interval [0,1] and a positive number m such that

1. Certainty is represented by w ( A ∣ B ) = 1.
2. w m ( A | B ) + w m ( not  A ∣ B ) = 1.
3. w ( A B ∣ C ) = w ( A ∣ C ) w ( B ∣ A C ) = w ( B ∣ C ) w ( A ∣ B C ) .

It is important to note that the postulates imply only these general properties. We may recover the usual laws of probability by setting a new function, conventionally denoted P or Pr , equal to w m . Then we obtain the laws of probability in a more familiar form:

1. Certain truth is represented by Pr ( A ∣ B ) = 1 , and certain falsehood by Pr ( A ∣ B ) = 0.
2. Pr ( A ∣ B ) + Pr ( not  A ∣ B ) = 1.
3. Pr ( A B ∣ C ) = Pr ( A ∣ C ) Pr ( B ∣ A C ) = Pr ( B ∣ C ) Pr ( A ∣ B C ) .

Rule 2 is a rule for negation, and rule 3 is a rule for conjunction. Given that any proposition containing conjunction, disjunction, and negation can be equivalently rephrased using conjunction and negation alone (the conjunctive normal form), we can now handle any compound proposition.

The laws thus derived yield finite additivity of probability, but not countable additivity. The measure-theoretic formulation of Kolmogorov assumes that a probability measure is countably additive. This slightly stronger condition is necessary for the proof of certain theorems.

Interpretation and further discussion

Cox's theorem has come to be used as one of the justifications for the use of Bayesian probability theory. For example, in Jaynes it is discussed in detail in chapters 1 and 2 and is a cornerstone for the rest of the book. Probability is interpreted as a formal system of logic, the natural extension of Aristotelian logic (in which every statement is either true or false) into the realm of reasoning in the presence of uncertainty.

It has been debated to what degree the theorem excludes alternative models for reasoning about uncertainty. For example, if certain "unintuitive" mathematical assumptions were dropped then alternatives could be devised, e.g., an example provided by Halpern. However Arnborg and Sjödin suggest additional "common sense" postulates, which would allow the assumptions to be relaxed in some cases while still ruling out the Halpern example. Other approaches were devised by Hardy or Dupré and Tipler.

The original formulation of Cox's theorem is in Cox (1946) which is extended with additional results and more discussion in Cox (1961). Jaynes cites Abel for the first known use of the associativity functional equation. Aczél provides a long proof of the "associativity equation" (pages 256-267). Jaynes (p27) reproduces the shorter proof by Cox in which differentiability is assumed. A guide to Cox's theorem by Van Horn aims at comprehensively introducing the reader to all these references.