Samiksha Jaiswal (Editor)

Polynomial SOS

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit

In mathematics, a form (i.e. a homogeneous polynomial) h(x) of degree 2m in the real n-dimensional vector x is sum of squares of forms (SOS) if and only if there exist forms g 1 ( x ) , … , g k ( x ) of degree m such that

Contents

h ( x ) = ∑ i = 1 k g i ( x ) 2 .

Every form that is SOS is also a positive polynomial, and although the converse is not always true, Hilbert proved that for n = 2, m = 1 or n = 3 and 2m = 4 a form is SOS if and only if is positive. The same is also valid for the analog problem on positive symmetric forms.

Although not every form can be represented as SOS, explicit sufficient conditions for a form to be SOS have been found. Moreover, every real nonnegative form can be approximated as closely as desired (in the l 1 -norm of its coefficient vector) by a sequence of forms { f ϵ } that are SOS.

Square matricial representation (SMR)

To establish whether a form h(x) is SOS amounts to solving a convex optimization problem. Indeed, any h(x) can be written as

h ( x ) = x { m } ′ ( H + L ( α ) ) x { m }

where x { m } is a vector containing a base for the forms of degree m in x (such as all monomials of degree m in x), the prime ′ denotes the transpose, H is any symmetric matrix satisfying

h ( x ) = x { m } ′ H x { m }

and L ( α ) is a linear parameterization of the linear space

L = { L = L ′ :   x { m } ′ L x { m } = 0 } .

The dimension of the vector x { m } is given by

σ ( n , m ) = ( n + m − 1 m )

whereas the dimension of the vector α is given by

ω ( n , 2 m ) = 1 2 σ ( n , m ) ( 1 + σ ( n , m ) ) − σ ( n , 2 m ) .

Then, h(x) is SOS if and only if there exists a vector α such that

H + L ( α ) ≥ 0 ,

meaning that the matrix H + L ( α ) is positive-semidefinite. This is a linear matrix inequality (LMI) feasibility test, which is a convex optimization problem. The expression h ( x ) = x { m } ′ ( H + L ( α ) ) x { m } was introduced in with the name square matricial representation (SMR) in order to establish whether a form is SOS via an LMI. This representation is also known as Gram matrix.

Examples

  • Consider the form of degree 4 in two variables h ( x ) = x 1 4 − x 1 2 x 2 2 + x 2 4 . We have
    • m = 2 ,   x { m } = ( x 1 2 x 1 x 2 x 2 2 ) ,   H + L ( α ) = ( 1 0 − α 1 0 − 1 + 2 α 1 0 − α 1 0 1 ) . Since there exists α such that H + L ( α ) ≥ 0 , namely α = 1 , it follows that h(x) is SOS.
  • Consider the form of degree 4 in three variables h ( x ) = 2 x 1 4 − 2.5 x 1 3 x 2 + x 1 2 x 2 x 3 − 2 x 1 x 3 3 + 5 x 2 4 + x 3 4 . We have
    • m = 2 ,   x { m } = ( x 1 2 x 1 x 2 x 1 x 3 x 2 2 x 2 x 3 x 3 2 ) ,   H + L ( α ) = ( 2 − 1.25 0 − α 1 − α 2 − α 3 − 1.25 2 α 1 0.5 + α 2 0 − α 4 − α 5 0 0.5 + α 2 2 α 3 α 4 α 5 − 1 − α 1 0 α 4 5 0 − α 6 − α 2 − α 4 α 5 0 2 α 6 0 − α 3 − α 5 − 1 − α 6 0 1 ) . Since H + L ( α ) ≥ 0 for α = ( 1.18 , − 0.43 , 0.73 , 1.13 , − 0.37 , 0.57 ) , it follows that h(x) is SOS.

    Matrix SOS

    A matrix form F(x) (i.e., a matrix whose entries are forms) of dimension r and degree 2m in the real n-dimensional vector x is SOS if and only if there exist matrix forms G 1 ( x ) , … , G k ( x ) of degree m such that

    F ( x ) = ∑ i = 1 k G i ( x ) ′ G i ( x ) .

    Matrix SMR

    To establish whether a matrix form F(x) is SOS amounts to solving a convex optimization problem. Indeed, similarly to the scalar case any F(x) can be written according to the SMR as

    F ( x ) = ( x { m } ⊗ I r ) ′ ( H + L ( α ) ) ( x { m } ⊗ I r )

    where ⊗ is the Kronecker product of matrices, H is any symmetric matrix satisfying

    F ( x ) = ( x { m } ⊗ I r ) ′ H ( x { m } ⊗ I r )

    and L ( α ) is a linear parameterization of the linear space

    L = { L = L ′ :   ( x { m } ⊗ I r ) ′ L ( x { m } ⊗ I r ) = 0 } .

    The dimension of the vector α is given by

    ω ( n , 2 m , r ) = 1 2 r ( σ ( n , m ) ( r σ ( n , m ) + 1 ) − ( r + 1 ) σ ( n , 2 m ) ) .

    Then, F(x) is SOS if and only if there exists a vector α such that the following LMI holds:

    H + L ( α ) ≥ 0.

    The expression F ( x ) = ( x { m } ⊗ I r ) ′ ( H + L ( α ) ) ( x { m } ⊗ I r ) was introduced in in order to establish whether a matrix form is SOS via an LMI.

    Noncommutative polynomial SOS

    Consider the free algebra R⟨X⟩ generated by the n noncommuting letters X = (X1,...,Xn) and equipped with the involution T, such that T fixes R and X1,...,Xn and reverse words formed by X1,...,Xn. By analogy with the commutative case, the noncommutative symmetric polynomials f are the noncommutative polynomials of the form f=fT. When any real matrix of any dimension r x r is evaluated at a symmetric noncommutative polynomial f results in a positive semi-definite matrix, f is said to be matrix-positive.

    A noncommutative polynomial is SOS if there exists noncommutative polynomials h 1 , … , h k such that

    f ( X ) = ∑ i = 1 k h i ( X ) T h i ( X ) .

    Surprisingly, in the noncommutative scenario a noncommutative polynomial is SoS if and only if is matrix-positive. Moreover, there exist algorithms available to decompose matrix-positive polynomials in sum of squares of noncommutative polynomials.

    References

    Polynomial SOS Wikipedia
    (Text) CC BY-SA