Girish Mahajan (Editor)

Fisher–Tippett–Gnedenko theorem

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit
Fisher–Tippett–Gnedenko theorem

In statistics, the Fisher–Tippett–Gnedenko theorem (also the Fisher–Tippett theorem or the extreme value theorem) is a general result in extreme value theory regarding asymptotic distribution of extreme order statistics. The maximum of a sample of iid random variables after proper renormalization can only converge in distribution to one of 3 possible distributions, the Gumbel distribution, the Fréchet distribution, or the Weibull distribution. Credit for the extreme value theorem (or convergence to types theorem) is given to Gnedenko (1948), previous versions were stated by Ronald Fisher and Leonard Henry Caleb Tippett in 1928 and Fréchet in 1927.

Contents

The role of the extremal types theorem for maxima is similar to that of central limit theorem for averages, except that the central limit theorem applies to the average of a sample from any distribution with finite variance, while the Fisher-Tippet-Gnedenko theorem only states that if the distribution of a normalized maximum converges, then the limit has to be one of a particular class of distributions. It does not state that the distribution of the normalized maximum does converge.

Statement

Let X 1 , X 2 … , X n … be a sequence of independent and identically-distributed random variables, and M n = max { X 1 , … , X n } . If a sequence of pairs of real numbers ( a n , b n ) exists such that each a n > 0 and lim n → ∞ P ( M n − b n a n ≤ x ) = F ( x ) , where F is a non degenerate distribution function, then the limit distribution F belongs to either the Gumbel, the Fréchet or the Weibull family. These can be grouped into the generalized extreme value distribution.

Conditions of convergence

If G is the distribution function of X, then Mn can be rescaled to converge in distribution to

  • a Fréchet if and only if G (x) < 1 for all real x and 1 − G ( t x ) 1 − G ( t ) → t → + ∞ x − θ , x > 0 . In this case, possible sequences are
  • a Weibull if and only if ω = sup { G < 1 } < + ∞ and 1 − G ( ω + t x ) 1 − G ( ω − t ) → t → 0 + ( − x ) θ , x < 0 . In this case possible sequences are

    • Convergence conditions for the Gumbel distribution are more involved.

    References

    Fisher–Tippett–Gnedenko theorem Wikipedia
    (Text) CC BY-SA