Neha Patil (Editor)

First order second moment method

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit

In probability theory, the first-order second-moment (FOSM) method, also referenced as mean value first-order second-moment (MVFOSM) method, is a probabilistic method to determine the stochastic moments of a function with random input variables. The name is based on the derivation, which uses a first-order Taylor series and the first and second moments of the input variables.

Contents

Approximation

Consider the objective function g ( x ) , where the input vector x is a realization of the random vector X with probability density function f X ( x ) . As X is randomly distributed, also g is randomly distributed. Following the FOSM method, the mean value of g is approximated by

μ g g ( μ )

The variance of g is approximated by

σ g 2 i = 1 n j = 1 n g ( μ ) x i g ( μ ) x j cov ( X i , X j )

where n is the length/dimension of x and g ( μ ) x i is the partial derivative of g at the mean vector μ with respect to the i-th entry of x .

Derivation

The objective function is approximated by a Taylor series at the mean vector μ .

g ( x ) = g ( μ ) + i = 1 n g ( μ ) x i ( x i μ i ) + 1 2 i = 1 n j = 1 n 2 g ( μ ) x i x j ( x i μ i ) ( x j μ j ) +

The mean value of g is given by the integral

μ g = E [ g ( x ) ] = g ( x ) f X ( x ) d x

Inserting the first-order Taylor series yields

μ g [ g ( μ ) + i = 1 n g ( μ ) x i ( x i μ i ) ] f X ( x ) d x = g ( μ ) f X ( x ) d x + i = 1 n g ( μ ) x i ( x i μ i ) f X ( x ) d x = g ( μ ) f X ( x ) d x 1 + i = 1 n g ( μ ) x i ( x i μ i ) f X ( x ) d x 0 = g ( μ ) .

The variance of g is given by the integral

σ g 2 = E ( [ g ( x ) μ g ] 2 ) = [ g ( x ) μ g ] 2 f X ( x ) d x .

According to the computational formula for the variance, this can be written as

σ g 2 = E ( [ g ( x ) μ g ] 2 ) = E ( g ( x ) 2 ) μ g 2 = g ( x ) 2 f X ( x ) d x μ g 2

Inserting the Taylor series yields

σ g 2 [ g ( μ ) + i = 1 n g ( μ ) x i ( x i μ i ) ] 2 f X ( x ) d x μ g 2 = { g ( μ ) 2 + 2 g μ i = 1 n g ( μ ) x i ( x i μ i ) + [ i = 1 n g ( μ ) x i ( x i μ i ) ] 2 } f X ( x ) d x μ g 2 = g ( μ ) 2 f X ( x ) d x + 2 g μ i = 1 n g ( μ ) x i ( x i μ i ) f X ( x ) d x + [ i = 1 n g ( μ ) x i ( x i μ i ) ] 2 f X ( x ) d x μ g 2 = g μ 2 f X ( x ) d x 1 + 2 g μ i = 1 n g ( μ ) x i ( x i μ i ) f X ( x ) d x 0 + [ i = 1 n j = 1 n g ( μ ) x i g ( μ ) x j ( x i μ i ) ( x j μ j ) ] f X ( x ) d x μ g 2 = g ( μ ) 2 μ g 2 + i = 1 n j = 1 n g ( μ ) x i g ( μ ) x j ( x i μ i ) ( x j μ j ) f ( x ) d x cov ( X i , X j ) μ g 2 = i = 1 n j = 1 n g ( μ ) x i g ( μ ) x j cov ( X i , X j ) .

Higher-order approaches

The following abbreviations are introduced.

g μ = g ( μ ) , g , i = g ( μ ) x i , g , i j = 2 g ( μ ) x i x j , μ i , j = E [ ( x i μ i ) j ]

In the following, the entries of the random vector X are assumed to be independent. Considering also the second-order terms of the Taylor expansion, the approximation of the mean value is given by

μ g g μ + 1 2 i = 1 n g , i i μ i , 2

The second-order approximation of the variance is given by

σ g 2 g μ 2 + i = 1 n g , i 2 μ i , 2 + 1 4 i = 1 n g , i i 2 μ i , 4 + g μ i = 1 n g , i i μ i , 2 + i = 1 n g , i g , i i μ i , 3 + 1 2 i = 1 n j = i + 1 n g , i i g , j j μ i , 2 μ j , 2 + i = 1 n j = i + 1 n g , i j 2 μ i , 2 μ j , 2 μ g 2

The skewness of g can be determined from the third central moment μ g , 3 . When considering only linear terms of the Taylor series, but higher-order moments, the third central moment is approximated by

μ g , 3 i = 1 n g , i 3 μ i , 3

For the second-order approximations of the third central moment as well as for the derivation of all higher-order approximations see Appendix D of Ref. Taking into account the quadratic terms of the Taylor series and the third moments of the input variables is referred to as second-order third-moment method. However, the full second-order approach of the variance (given above) also includes fourth-order moments of input parameters, and the full second-order approach of the skewness 6th-order moments

Practical application

There are several examples in the literature where the FOSM method is employed to estimate the stochastic distribution of the buckling load of axially compressed structures (see e.g. Ref.). For structures which are very sensitive to deviations from the ideal structure (like cylindrical shells) it has been proposed to use the FOSM method as a design approach. Often the applicability is checked by comparison with a Monte Carlo simulation. In engineering practice, the objective function often is not given as analytic expression, but for instance as a result of a finite-element simulation. Then the derivatives of the objective function need to be estimated by the central differences method. The number of evaluations of the objective function equals 2 n + 1 . Depending on the number of random variables this still can mean a significantly smaller number of evaluations than performing a Monte Carlo simulation. However, when using the FOSM method as a design procedure, a lower bound shall be estimated, which is actually not given by the FOSM approach. Therefore, a type of distribution needs to be assumed for the distribution of the objective function, taking into account the approximated mean value and standard deviation.

References

First-order second-moment method Wikipedia