Harmonic distribution - Alchetron, The Free Social Encyclopedia

Parameters m ≥ 0, a ≥ 0		Support x > 0

Notation H a r m ( m , a ) {displaystyle mathrm {Harm} (m,a),} PDF 1 2 x K 0 ( a ) exp ⁡ ( − a 2 ( x m + m x ) ) {displaystyle {rac {1}{2xK_{0}(a)}}exp left(-{rac {a}{2}}left({rac {x}{m}}+{rac {m}{x}}ight)ight)} CDF ∫ 0 X 1 2 x K 0 ( a ) exp ⁡ ( − a 2 ( x m + m x ) ) d x {displaystyle int _{0}^{X}{rac {1}{2xK_{0}(a)}}exp left(-{rac {a}{2}}left({rac {x}{m}}+{rac {m}{x}}ight)ight),dx} Mean m K 1 ( a ) K 0 ( a ) {displaystyle m{rac {K_{1}(a)}{K_{0}(a)}}}

In probability theory and statistics, the harmonic distribution is a continuous probability distribution. It was discovered by Étienne Halphen, who had become interested in the statistical modeling of natural events. His practical experience in data analysis motivated him to pioneer a new system of distributions that provided sufficient flexibility to fit a large variety of data sets. Halphen restricted his search to distributions whose parameters could be estimated using simple statistical approaches. Then, Halphen introduced for the first time what he called the Harmonic distribution pr Harmonic Law.. The harmonic law is a special case of the generalized inverse Gaussian distribution family when γ = 0 .

History

One of Halphen’s tasks,while working as statistician for Electricité de France, was the modeling of the monthly flow of water in hydroelectric stations. Halphen realized that the Pearson system of probability distributions could not be solved, it was inadequate for his purpose despite its remarkable properties. Therefore, Halphen's objective was to obtain a probability distribution with two parameters, subject a exponential decay both for large and small flows.

In 1941, Halphen decided that, in suitably scaled units, the density of X should be the same as 1/X. Taken this consideration, Halphen found the Harmonic density function. Nowadays known as an hyperbolic distribution, has been studied by Rukhin (1974) and Barndorff-Nielsen (1978).

The Harmonic Law is the only one two-parameter family of distributions that is closed under change of scale and under reciprocals, such that the maximum likelihood estimator of the population mean is the sample mean (Gauss' principle).

In 1946, Halphen realized that introducing an additional parameter, flexibility could be improved. His efforts led him to generalize the Harmonic Law to obtain the Generalized Inverse Gaussian Distribution density.

Notation

The Harmonic distribution will be denoted by θ ( m , a ) . As a result, when a random variable X is distributed following a Harmonic Law, the parameter of scale m is the population median and a is the parameter of shape.

X ∼ Harm ⁡ ( m , a )

Probability density function

The density function of the harmonic law, which depends of two parameters, has the form,

f ( x ; m , a ) = 1 2 x K 0 ( a ) exp ⁡ ( − a 2 ( x m + m x ) )

where:

K 0 ( a ) denotes the third kind of the modified Bessel function with index 0.

m ≥ 0 ,

a ≥ 0.

Cumulative distribution function

The cumulative distribution function for the Harmonic Law does not have a closed form, and consequently it is not possible to derive an explicit expression. The cumulative distribution function must be calculated solving numerically an integral,

F ( x ; m , a ) = ∫ 0 x 1 2 t K 0 ( a ) exp ⁡ ( − a 2 ( t m + m t ) ) d t

Quantiles

The quantiles of the harmonic law are calculated with the cumulative distribution. In general does not exist a closed form except for the second quantile. We can only get the quantiles numerically.

Q1

The first quantile, can be obtained solving the following equation expressed in terms of the integral of the probability density function:,

∫ 0 q 1 1 2 x K 0 ( a ) exp ⁡ ( − a 2 ( x m + m x ) ) d x = 1 4

Q2

In this distribution, m is the median, that is, q2 = m. Therefore,

∫ 0 m 1 2 x K 0 ( a ) exp ⁡ ( − a 2 ( x m + m x ) ) d x = 1 2

Q3

Finally, the third quantile, comes from the solution of the equation,

∫ 0 q 3 1 2 x K 0 ( a ) exp ⁡ ( − a 2 ( x m + m x ) ) d x = 3 4

Moments

To derive an expression for the non-central moment of order r, the integral representation of the Bessel function can be used.

μ r ′ = ∫ 0 ∞ x r f ( x ; m , a ) d x = m r K r ( a ) K 0 ( a )

where:

r denotes the order of the moment.

Hence the mean and the succeeding three moments about it are

Skewness

Skewness is the third standardized moment around the mean divided by the 3/2 power of the standard deviation, we work with,

γ 1 = μ 3 μ 2 3 / 2 = K 0 2 ( a ) K 3 ( a ) − 3 K 0 ( a ) K 1 ( a ) K 2 ( a ) + 2 K 1 3 ( a ) ( K 0 ( a ) K 2 ( a ) − K 1 2 ( a ) ) 3 / 2

Always γ 1 > 0 , so the mass of the distribution is concentrated on the left.

Kurtosis

The coefficient of kurtosis is the fourth standardized moment divided by the square of the variance., for the harmonic distribution it is

γ 2 = μ 4 μ 2 2 = K 0 3 ( a ) K 4 ( a ) − 4 K 0 2 ( a ) K 1 ( a ) K 3 ( a ) + 6 K 0 ( a ) K 1 2 ( a ) K 2 ( a ) − 3 K 1 4 ( a ) ( K 0 ( a ) K 2 ( a ) − K 1 2 ( a ) ) 2

Always γ 2 > 0 the distribution has a high acute peak around the mean and fatter tails.

Maximum likelihood estimation

The likelihood function is

L ( X ∣ θ ) = ∏ i = 1 n f ( x i ∣ θ ) = ∏ i = 1 n 1 2 x K 0 ( a ) exp ⁡ [ − a 2 ( x m + m x ) ]

After that, the log-likelihood function is

ln ⁡ L ( X ∣ θ ) = n ln ⁡ ( 2 K 0 ( a ) ) + ∑ i = 1 n ln ⁡ ( x i ) + a 2 m ∑ i = 1 n x i + a m 2 ∑ i = 1 n 1 x i

From the log-likelihood function, the likelihood equations are,

∂ l ∂ a = n ( ln ⁡ ( 2 K 0 ( a ) ) ) ′ + 1 2 m ∑ i = 1 n x i + m 2 ∑ i = 1 n 1 x i = 0 ∂ l ∂ m = 1 2 m 2 ∑ i = 1 n x i + a 2 ∑ i = 1 n 1 x i = 0

To calculate the estimator a only can be resolve numerically, but m can see the formula.

m ^ = H ¯ H ¯ − 1 H ¯ H ¯ − 1 = K 1 ( a ^ ) K 0 ( a ^ )

Method of moments

The mean and the variance for the harmonic distribution are,

{ μ = m K 1 ( a ) K 0 ( a ) σ 2 = m 2 ( 1 + 2 K 1 ( a ) K 0 ( a ) a − K 1 2 ( a ) K 0 2 ( a ) )

Note that,

σ 2 = μ 2 ( 2 K 0 ( a ) K 1 ( a ) ) 2 + 2 K 0 ( a ) μ 2 K 1 ( a ) a − μ 2

The method of moments consists in to solve the following equations:

{ H ¯ = m K 1 ( a ) K 0 ( a ) s 2 = H ¯ 2 ( 2 K 0 ( a ) K 1 ( a ) ) 2 + 2 K 0 ( a ) H ¯ 2 K 1 ( a ) a − H ¯ 2

where s 2 is the sample variance and H ¯ is the sample mean. Solving the second equation we obtain a ^ , and then we calculate m ^ using,

m ^ = H ¯ K 0 ( a ^ ) K 1 ( a ^ )

The harmonic law is a sub-family of the generalized inverse Gaussian distribution. The density of GIG family have the form

f ( x ∣ m , γ ) = x γ − 1 2 m γ K γ ( a ) exp ⁡ [ − a 2 ( x m + m x ) ]

The density of the Generalized Inverse Gaussian Distribution family corresponds to the Harmonic Law when γ = 0 .

When a tends to infinity, the harmonic law can be approximated by a normal distribution. This is indicated by demonstrating that if a tends to infinity, then U = a ( X m − 1 ) , which is a linear transformation of X, tends to a normal distribution ( N ( 0 , 1 ) ).

This explains why the normal distribution can be used successfully for certain data sets of ratios.

Another related distribution is the log-harmonic law, which is the probability distribution of a random variable whose logarithm follows an harmonic law.

This family has an interesting property, the Pitman estimator of the location parameter does not depend on the choice of the loss function. Only two statistical models satisfy this property: One is the normal family of distributions and the other one is a three-parameter statistical model which contains the log-harmonic law.

References

Harmonic distribution Wikipedia

(Text) CC BY-SA

Contents