Samiksha Jaiswal (Editor)

Bradley–Terry model

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit

The Bradley–Terry model is a probability model that can predict the outcome of a comparison. Given a pair of individuals i and j drawn from some population, it estimates the probability that the pairwise comparison i > j turns out true, as

Contents

P ( i > j ) = p i p i + p j

where pi is a positive real-valued score assigned to individual i. The comparison i > j can be read as "i is preferred to j", "i ranks higher than j", or "i beats j", depending on the application.

For example, pi may represent the skill of a team in a sports tournament, estimated from the number of times i has won a match. P ( i > j ) then represents the probability that i will win a match against j. Another example used to explain the model's purpose is that of scoring products in a certain category by quality. While it's hard for a person to draft a direct ranking of (many) brands of wine, it may be feasible to compare a sample of pairs of wines and say, for each pair, which one is better. The Bradley–Terry model can then be used to derive a full ranking.

History and applications

The model is named after R. A. Bradley and M. E. Terry, who presented it in 1952, although it had already been studied by Zermelo in the 1920s.

Real-world applications of the model include estimation of the influence of statistical journals, or ranking documents by relevance in machine-learned search engines. In the latter application, P ( i > j ) may reflect that document i is more relevant to the user's query than document j, so it should be displayed earlier in the results list. The individual pi then express the relevance of the document, and can be estimated from the frequency with which users click particular "hits" when presented with a result list.

Definition

The Bradley–Terry model can be parametrized in various ways. One way to do so is to pick a single parameter per observation, leading to a model of n parameters p1, ..., pn. Another variant, in fact the version considered by Bradley and Terry, uses exponential score functions p i = e β i so that

P ( i > j ) = e β i e β i + e β j

or, using the logit (and disallowing ties),

logit ⁡ ( P ( i > j ) ) = log ⁡ ( P ( i > j ) 1 − P ( i > j ) ) = log ⁡ ( P ( i > j ) P ( j > i ) ) = β i − β j

reducing the model to logistic regression on pairs of individuals.

Estimating the parameters

The following algorithm computes the parameters pi of the basic version of the model from a sample of observations. Formally, it computes a maximum likelihood estimate, i.e., it maximizes the likelihood of the observed data. The algorithm dates back to the work of Zermelo.

The observations required are the outcomes of previous comparisons, for example, pairs (i, j) where i beats j. Summarizing these outcomes as wij, the number of times i has beaten j, we obtain the log-likelihood of the parameter vector p = p1, ..., pn as

L ( p ) = ∑ i n ∑ j n w i j ln ⁡ p i − w i j ln ⁡ ( p i + p j ) .

Denote the number of comparisons "won" by i as Wi, and the number of comparisons made between i and j as Nij. Starting from an arbitrary vector p, the algorithm iteratively performs the update

p i ′ = W i ( ∑ j ≠ i N i j p i + p j ) − 1

for all i. After computing all of the new parameters, they should be renormalized,

p i ← p i ′ ∑ j n p j ′ .

This estimation procedure improves the log-likelihood in every iteration, and eventually converges to a unique maximum.

References

Bradley–Terry model Wikipedia
(Text) CC BY-SA